Jul 24 19:24:40.096788 ip-10-0-131-150 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 24 19:24:40.096797 ip-10-0-131-150 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 24 19:24:40.096804 ip-10-0-131-150 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 24 19:24:40.097043 ip-10-0-131-150 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 24 19:24:50.215589 ip-10-0-131-150 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found.
Jul 24 19:24:50.215605 ip-10-0-131-150 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot a8275a9c0d864d76b5b135fb582aa3d2 --
Jul 24 19:26:41.692047 ip-10-0-131-150 systemd[1]: Starting Kubernetes Kubelet...
Jul 24 19:26:42.127475 ip-10-0-131-150 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 19:26:42.127475 ip-10-0-131-150 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 24 19:26:42.127475 ip-10-0-131-150 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 19:26:42.127475 ip-10-0-131-150 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 24 19:26:42.127475 ip-10-0-131-150 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 19:26:42.129162 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.129069    2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 24 19:26:42.132683 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132665    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 19:26:42.132683 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132685    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 19:26:42.132771 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132689    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 19:26:42.132771 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132692    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 19:26:42.132771 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132695    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 19:26:42.132771 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132698    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 19:26:42.132771 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132701    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 19:26:42.132771 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132704    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 19:26:42.132771 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132707    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 19:26:42.132771 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132710    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 19:26:42.132771 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132712    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 19:26:42.132771 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132716    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 19:26:42.132771 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132735    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 19:26:42.132771 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132739    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 19:26:42.132771 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132750    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 19:26:42.132771 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132753    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 19:26:42.132771 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132755    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 19:26:42.132771 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132758    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 19:26:42.132771 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132760    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 19:26:42.132771 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132763    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 19:26:42.132771 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132765    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 19:26:42.133221 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132768    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 19:26:42.133221 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132770    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 19:26:42.133221 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132772    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 19:26:42.133221 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132776    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 19:26:42.133221 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132778    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 19:26:42.133221 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132781    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 19:26:42.133221 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132784    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 19:26:42.133221 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132787    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 19:26:42.133221 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132789    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 19:26:42.133221 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132792    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 19:26:42.133221 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132794    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 19:26:42.133221 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132796    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 19:26:42.133221 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132799    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 19:26:42.133221 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132801    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 19:26:42.133221 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132804    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 19:26:42.133221 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132806    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 19:26:42.133221 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132808    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 19:26:42.133221 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132811    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 19:26:42.133221 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132813    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 19:26:42.133221 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132816    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 19:26:42.133700 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132818    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 19:26:42.133700 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132820    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 19:26:42.133700 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132823    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 19:26:42.133700 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132827    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 19:26:42.133700 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132831    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 19:26:42.133700 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132833    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 19:26:42.133700 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132836    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 19:26:42.133700 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132839    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 19:26:42.133700 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132842    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 19:26:42.133700 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132845    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 19:26:42.133700 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132848    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 19:26:42.133700 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132850    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 19:26:42.133700 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132853    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 19:26:42.133700 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132856    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 19:26:42.133700 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132859    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 19:26:42.133700 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132861    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 19:26:42.133700 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132864    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 19:26:42.133700 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132867    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 19:26:42.133700 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132869    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 19:26:42.133700 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132871    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 19:26:42.134255 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132874    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 19:26:42.134255 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132876    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 19:26:42.134255 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132878    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 19:26:42.134255 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132881    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 19:26:42.134255 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132883    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 19:26:42.134255 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132885    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 19:26:42.134255 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132888    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 19:26:42.134255 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132890    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 19:26:42.134255 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132892    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 19:26:42.134255 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132895    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 19:26:42.134255 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132900    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 19:26:42.134255 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132903    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 19:26:42.134255 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132905    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 19:26:42.134255 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132908    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 19:26:42.134255 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132910    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 19:26:42.134255 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132912    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 19:26:42.134255 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132915    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 19:26:42.134255 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132917    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 19:26:42.134255 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132919    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 19:26:42.134255 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132922    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 19:26:42.134751 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132924    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 19:26:42.134751 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132929    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 19:26:42.134751 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132931    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 19:26:42.134751 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132934    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 19:26:42.134751 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132936    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 19:26:42.134751 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132939    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 19:26:42.134751 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132942    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 19:26:42.134751 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132944    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 19:26:42.134751 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132947    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 19:26:42.134751 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132950    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 19:26:42.134751 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132955    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 19:26:42.134751 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132958    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 19:26:42.134751 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132961    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 19:26:42.134751 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132964    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 19:26:42.134751 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132967    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 19:26:42.134751 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132970    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 19:26:42.134751 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132972    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 19:26:42.134751 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.132975    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 19:26:42.134751 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.133672    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 19:26:42.135204 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.133678    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 19:26:42.135204 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.133681    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 19:26:42.135204 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134402    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 19:26:42.135204 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134409    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 19:26:42.135204 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134415    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 19:26:42.135204 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134418    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 19:26:42.135204 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134421    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 19:26:42.135204 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134424    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 19:26:42.135204 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134427    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 19:26:42.135204 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134430    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 19:26:42.135204 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134433    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 19:26:42.135204 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134435    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 19:26:42.135204 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134438    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 19:26:42.135204 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134440    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 19:26:42.135204 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134443    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 19:26:42.135204 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134446    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 19:26:42.135204 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134450    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 19:26:42.135204 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134453    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 19:26:42.135204 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134456    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 19:26:42.135680 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134459    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 19:26:42.135680 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134462    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 19:26:42.135680 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134465    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 19:26:42.135680 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134467    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 19:26:42.135680 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134470    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 19:26:42.135680 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134472    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 19:26:42.135680 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134475    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 19:26:42.135680 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134477    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 19:26:42.135680 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134480    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 19:26:42.135680 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134482    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 19:26:42.135680 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134485    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 19:26:42.135680 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134487    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 19:26:42.135680 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134489    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 19:26:42.135680 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134492    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 19:26:42.135680 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134494    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 19:26:42.135680 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134497    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 19:26:42.135680 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134500    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 19:26:42.135680 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134502    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 19:26:42.135680 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134506    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 19:26:42.135680 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134508    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 19:26:42.136182 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134511    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 19:26:42.136182 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134513    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 19:26:42.136182 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134515    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 19:26:42.136182 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134518    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 19:26:42.136182 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134520    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 19:26:42.136182 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134522    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 19:26:42.136182 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134525    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 19:26:42.136182 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134527    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 19:26:42.136182 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134530    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 19:26:42.136182 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134532    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 19:26:42.136182 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134535    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 19:26:42.136182 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134538    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 19:26:42.136182 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134542    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 19:26:42.136182 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134545    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 19:26:42.136182 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134547    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 19:26:42.136182 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134549    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 19:26:42.136182 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134552    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 19:26:42.136182 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134555    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 19:26:42.136182 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134557    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 19:26:42.136640 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134559    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 19:26:42.136640 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134562    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 19:26:42.136640 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134564    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 19:26:42.136640 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134567    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 19:26:42.136640 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134569    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 19:26:42.136640 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134572    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 19:26:42.136640 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134574    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 19:26:42.136640 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134577    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 19:26:42.136640 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134580    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 19:26:42.136640 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134583    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 19:26:42.136640 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134586    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 19:26:42.136640 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134588    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 19:26:42.136640 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134591    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 19:26:42.136640 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134594    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 19:26:42.136640 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134596    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 19:26:42.136640 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134600    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 19:26:42.136640 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134603    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 19:26:42.136640 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134606    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 19:26:42.136640 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134609    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 19:26:42.136640 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134612    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 19:26:42.137153 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134615    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 19:26:42.137153 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134618    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 19:26:42.137153 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134620    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 19:26:42.137153 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134623    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 19:26:42.137153 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134626    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 19:26:42.137153 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134629    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 19:26:42.137153 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134631    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 19:26:42.137153 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134634    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 19:26:42.137153 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134636    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 19:26:42.137153 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134639    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 19:26:42.137153 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134641    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 19:26:42.137153 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134643    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 19:26:42.137153 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134646    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 19:26:42.137153 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134648    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 19:26:42.137153 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134650    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 19:26:42.137153 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134653    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 19:26:42.137153 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134655    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 19:26:42.137153 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134658    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 19:26:42.137153 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134660    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 19:26:42.137153 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.134663    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 19:26:42.137635 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135079    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 19:26:42.137635 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135085    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 19:26:42.137635 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135089    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 19:26:42.137635 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135092    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 19:26:42.137635 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135096    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 19:26:42.137635 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135100    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 19:26:42.137635 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135103    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 19:26:42.137635 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135107    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 19:26:42.137635 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135110    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 19:26:42.137635 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135112    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 19:26:42.137635 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135115    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 19:26:42.137635 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135117    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 19:26:42.137635 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135123    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 19:26:42.137635 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135125    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 19:26:42.137635 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135128    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 19:26:42.137635 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135130    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 19:26:42.137635 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135133    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 19:26:42.137635 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135136    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 19:26:42.137635 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135138    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 19:26:42.137635 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135141    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 19:26:42.138255 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135143    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 19:26:42.138255 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135146    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 19:26:42.138255 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135148    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 19:26:42.138255 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135150    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 19:26:42.138255 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135153    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 19:26:42.138255 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135155    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 19:26:42.138255 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135158    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 19:26:42.138255 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135160    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 19:26:42.138255 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135163    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 19:26:42.138255 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135165    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 19:26:42.138255 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135167    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 19:26:42.138255 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135171    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 19:26:42.138255 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135174    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 19:26:42.138255 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135177    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 19:26:42.138255 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135180    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 19:26:42.138255 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135182    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 19:26:42.138255 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135185    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 19:26:42.138255 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135188    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 19:26:42.138255 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135190    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 19:26:42.138735 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135193    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 19:26:42.138735 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135195    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 19:26:42.138735 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135198    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 19:26:42.138735 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135200    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 19:26:42.138735 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135202    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 19:26:42.138735 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135207    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 19:26:42.138735 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135210    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 19:26:42.138735 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135212    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 19:26:42.138735 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135215    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 19:26:42.138735 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135218    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 19:26:42.138735 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135220    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 19:26:42.138735 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135223    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 19:26:42.138735 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135227    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 19:26:42.138735 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135229    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 19:26:42.138735 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135232    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 19:26:42.138735 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135235    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 19:26:42.138735 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135238    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 19:26:42.138735 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135240    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 19:26:42.138735 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135242    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 19:26:42.138735 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135245    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 19:26:42.139266 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135247    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 19:26:42.139266 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135250    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 19:26:42.139266 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135252    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 19:26:42.139266 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135255    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 19:26:42.139266 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135258    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 19:26:42.139266 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135260    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 19:26:42.139266 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135262    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 19:26:42.139266 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135265    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 19:26:42.139266 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135267    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 19:26:42.139266 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135270    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 19:26:42.139266 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135272    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 19:26:42.139266 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135275    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 19:26:42.139266 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135278    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 19:26:42.139266 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135280    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 19:26:42.139266 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135283    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 19:26:42.139266 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135285    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 19:26:42.139266 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135288    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 19:26:42.139266 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135291    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 19:26:42.139266 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135293    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 19:26:42.139266 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135296    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 19:26:42.139760 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135298    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 19:26:42.139760 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135301    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 19:26:42.139760 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135303    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 19:26:42.139760 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135306    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 19:26:42.139760 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135308    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 19:26:42.139760 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135311    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 19:26:42.139760 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135313    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 19:26:42.139760 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135316    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 19:26:42.139760 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135319    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 19:26:42.139760 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135321    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 19:26:42.139760 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135324    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 19:26:42.139760 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135326    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 19:26:42.139760 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135329    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 19:26:42.139760 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135331    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 19:26:42.139760 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135335    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 19:26:42.139760 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135339    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 19:26:42.139760 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135341    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 19:26:42.139760 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135344    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 19:26:42.139760 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135346    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 19:26:42.140221 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.135349    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 19:26:42.140221 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135413    2579 flags.go:64] FLAG: --address="0.0.0.0"
Jul 24 19:26:42.140221 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135425    2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 24 19:26:42.140221 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135431    2579 flags.go:64] FLAG: --anonymous-auth="true"
Jul 24 19:26:42.140221 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135435    2579 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 24 19:26:42.140221 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135440    2579 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 24 19:26:42.140221 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135443    2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 24 19:26:42.140221 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135447    2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 24 19:26:42.140221 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135452    2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 24 19:26:42.140221 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135455    2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 24 19:26:42.140221 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135458    2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 24 19:26:42.140221 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135462    2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 24 19:26:42.140221 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135465    2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 24 19:26:42.140221 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135468    2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 24 19:26:42.140221 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135471    2579 flags.go:64] FLAG: --cgroup-root=""
Jul 24 19:26:42.140221 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135475    2579 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 24 19:26:42.140221 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135478    2579 flags.go:64] FLAG: --client-ca-file=""
Jul 24 19:26:42.140221 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135481    2579 flags.go:64] FLAG: --cloud-provider="external"
Jul 24 19:26:42.140221 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135483    2579 flags.go:64] FLAG: --cluster-dns="[]"
Jul 24 19:26:42.140221 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135488    2579 flags.go:64] FLAG: --cluster-domain=""
Jul 24 19:26:42.140221 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135491    2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 24 19:26:42.140221 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135494    2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 24 19:26:42.140221 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135497    2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 24 19:26:42.140221 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135500    2579 flags.go:64] FLAG: --container-log-max-files="5"
Jul 24 19:26:42.140800 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135504    2579 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 24 19:26:42.140800 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135507    2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 24 19:26:42.140800 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135510    2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 24 19:26:42.140800 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135513    2579 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 24 19:26:42.140800 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135516    2579 flags.go:64] FLAG: --contention-profiling="false"
Jul 24 19:26:42.140800 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135519    2579 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 24 19:26:42.140800 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135522    2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 24 19:26:42.140800 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135525    2579 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 24 19:26:42.140800 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135528    2579 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 24 19:26:42.140800 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135532    2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 24 19:26:42.140800 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135535    2579 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 24 19:26:42.140800 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135539    2579 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 24 19:26:42.140800 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135541    2579 flags.go:64] FLAG: --enable-load-reader="false"
Jul 24 19:26:42.140800 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135544    2579 flags.go:64] FLAG: --enable-server="true"
Jul 24 19:26:42.140800 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135547    2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 24 19:26:42.140800 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135552    2579 flags.go:64] FLAG: --event-burst="100"
Jul 24 19:26:42.140800 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135555    2579 flags.go:64] FLAG: --event-qps="50"
Jul 24 19:26:42.140800 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135558    2579 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 24 19:26:42.140800 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135561    2579 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 24 19:26:42.140800 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135564    2579 flags.go:64] FLAG: --eviction-hard=""
Jul 24 19:26:42.140800 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135567    2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 24 19:26:42.140800 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135570    2579 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 24 19:26:42.140800 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135573    2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 24 19:26:42.140800 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135576    2579 flags.go:64] FLAG: --eviction-soft=""
Jul 24 19:26:42.140800 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135578    2579 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 24 19:26:42.141380 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135581    2579 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 24 19:26:42.141380 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135584    2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 24 19:26:42.141380 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135586    2579 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 24 19:26:42.141380 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135589    2579 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 24 19:26:42.141380 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135592    2579 flags.go:64] FLAG: --fail-swap-on="true"
Jul 24 19:26:42.141380 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135594    2579 flags.go:64] FLAG: --feature-gates=""
Jul 24 19:26:42.141380 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135598    2579 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 24 19:26:42.141380 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135601    2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 24 19:26:42.141380 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135604    2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 24 19:26:42.141380 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135607    2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 24 19:26:42.141380 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135610    2579 flags.go:64] FLAG: --healthz-port="10248"
Jul 24 19:26:42.141380 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135612    2579 flags.go:64] FLAG: --help="false"
Jul 24 19:26:42.141380 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135615    2579 flags.go:64] FLAG: --hostname-override="ip-10-0-131-150.ec2.internal"
Jul 24 19:26:42.141380 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135618    2579 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 24 19:26:42.141380 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135621    2579 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 24 19:26:42.141380 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135624    2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 24 19:26:42.141380 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135627    2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 24 19:26:42.141380 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135630    2579 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 24 19:26:42.141380 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135633    2579 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 24 19:26:42.141380 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135635    2579 flags.go:64] FLAG: --image-service-endpoint=""
Jul 24 19:26:42.141380 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135638    2579 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 24 19:26:42.141380 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135640    2579 flags.go:64] FLAG: --kube-api-burst="100"
Jul 24 19:26:42.141380 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135643    2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 24 19:26:42.142008 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135646    2579 flags.go:64] FLAG: --kube-api-qps="50"
Jul 24 19:26:42.142008 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135649    2579 flags.go:64] FLAG: --kube-reserved=""
Jul 24 19:26:42.142008 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135652    2579 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 24 19:26:42.142008 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135654    2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 24 19:26:42.142008 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135657    2579 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 24 19:26:42.142008 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135660    2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 24 19:26:42.142008 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135662    2579 flags.go:64] FLAG: --lock-file=""
Jul 24 19:26:42.142008 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135665    2579 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 24 19:26:42.142008 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135668    2579 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 24 19:26:42.142008 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135671    2579 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 24 19:26:42.142008 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135676    2579 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 24 19:26:42.142008 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135679    2579 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 24 19:26:42.142008 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135681    2579 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 24 19:26:42.142008 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135684    2579 flags.go:64] FLAG: --logging-format="text"
Jul 24 19:26:42.142008 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135687    2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 24 19:26:42.142008 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135690    2579 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 24 19:26:42.142008 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135693    2579 flags.go:64] FLAG: --manifest-url=""
Jul 24 19:26:42.142008 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135696    2579 flags.go:64] FLAG: --manifest-url-header=""
Jul 24 19:26:42.142008 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135701    2579 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 24 19:26:42.142008 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135703    2579 flags.go:64] FLAG: --max-open-files="1000000"
Jul 24 19:26:42.142008 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135707    2579 flags.go:64] FLAG: --max-pods="110"
Jul 24 19:26:42.142008 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135710    2579 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 24 19:26:42.142008 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135713    2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 24 19:26:42.142008 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135715    2579 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 24 19:26:42.142008 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135732    2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 24 19:26:42.142771 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135736    2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 24 19:26:42.142771 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135738    2579 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 24 19:26:42.142771 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135741    2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 24 19:26:42.142771 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135749    2579 flags.go:64] FLAG: --node-status-max-images="50"
Jul 24 19:26:42.142771 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135752    2579 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 24 19:26:42.142771 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135756    2579 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 24 19:26:42.142771 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135759    2579 flags.go:64] FLAG: --pod-cidr=""
Jul 24 19:26:42.142771 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135763    2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 24 19:26:42.142771 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135768    2579 flags.go:64] FLAG: --pod-manifest-path=""
Jul 24 19:26:42.142771 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135771    2579 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 24 19:26:42.142771 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135774    2579 flags.go:64] FLAG: --pods-per-core="0"
Jul 24 19:26:42.142771 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135777    2579 flags.go:64] FLAG: --port="10250"
Jul 24 19:26:42.142771 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135780    2579 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 24 19:26:42.142771 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135783    2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0045e5230a3f299bb"
Jul 24 19:26:42.142771 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135786    2579 flags.go:64] FLAG: --qos-reserved=""
Jul 24 19:26:42.142771 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135789    2579 flags.go:64] FLAG: --read-only-port="10255"
Jul 24 19:26:42.142771 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135791    2579 flags.go:64] FLAG: --register-node="true"
Jul 24 19:26:42.142771 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135794    2579 flags.go:64] FLAG: --register-with-taints=""
Jul 24 19:26:42.142771 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135798    2579 flags.go:64] FLAG: --registry-burst="10"
Jul 24 19:26:42.142771 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135800    2579 flags.go:64] FLAG: --registry-qps="5"
Jul 24 19:26:42.142771 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135803    2579 flags.go:64] FLAG: --reserved-cpus=""
Jul 24 19:26:42.142771 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135806    2579 flags.go:64] FLAG: --reserved-memory=""
Jul 24 19:26:42.142771 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135809    2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 24 19:26:42.142771 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135812    2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 24 19:26:42.142771 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135815    2579 flags.go:64] FLAG: --rotate-certificates="false"
Jul 24 19:26:42.143478 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135818    2579 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 24 19:26:42.143478 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135820    2579 flags.go:64] FLAG: --runonce="false"
Jul 24 19:26:42.143478 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135823    2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 24 19:26:42.143478 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135826    2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 24 19:26:42.143478 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135829    2579 flags.go:64] FLAG: --seccomp-default="false"
Jul 24 19:26:42.143478 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135832    2579 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 24 19:26:42.143478 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135835    2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 24 19:26:42.143478 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135838    2579 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 24 19:26:42.143478 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135841    2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 24 19:26:42.143478 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135844    2579 flags.go:64] FLAG: --storage-driver-password="root"
Jul 24 19:26:42.143478 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135846    2579 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 24 19:26:42.143478 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135849    2579 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 24 19:26:42.143478 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135852    2579 flags.go:64] FLAG: --storage-driver-user="root"
Jul 24 19:26:42.143478 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135856    2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 24 19:26:42.143478 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135859    2579 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 24 19:26:42.143478 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135863    2579 flags.go:64] FLAG: --system-cgroups=""
Jul 24 19:26:42.143478 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135865    2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 24 19:26:42.143478 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135871    2579 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 24 19:26:42.143478 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135874    2579 flags.go:64] FLAG: --tls-cert-file=""
Jul 24 19:26:42.143478 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135877    2579 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 24 19:26:42.143478 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135881    2579 flags.go:64] FLAG: --tls-min-version=""
Jul 24 19:26:42.143478 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135884    2579 flags.go:64] FLAG: --tls-private-key-file=""
Jul 24 19:26:42.143478 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135887    2579 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 24 19:26:42.143478 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135890    2579 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 24 19:26:42.143478 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135892    2579 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 24 19:26:42.144197 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135895    2579 flags.go:64] FLAG: --v="2"
Jul 24 19:26:42.144197 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135899    2579 flags.go:64] FLAG: --version="false"
Jul 24 19:26:42.144197 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135903    2579 flags.go:64] FLAG: --vmodule=""
Jul 24 19:26:42.144197 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135907    2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 24 19:26:42.144197 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.135910    2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 24 19:26:42.144197 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136021    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 19:26:42.144197 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136025    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 19:26:42.144197 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136028    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 19:26:42.144197 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136031    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 19:26:42.144197 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136034    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 19:26:42.144197 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136036    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 19:26:42.144197 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136039    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 19:26:42.144197 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136044    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 19:26:42.144197 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136046    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 19:26:42.144197 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136049    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 19:26:42.144197 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136052    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 19:26:42.144197 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136054    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 19:26:42.144197 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136056    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 19:26:42.144197 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136059    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 19:26:42.144197 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136062    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 19:26:42.144975 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136066    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 19:26:42.144975 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136069    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 19:26:42.144975 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136071    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 19:26:42.144975 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136074    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 19:26:42.144975 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136077    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 19:26:42.144975 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136080    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 19:26:42.144975 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136082    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 19:26:42.144975 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136085    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 19:26:42.144975 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136087    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 19:26:42.144975 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136089    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 19:26:42.144975 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136092    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 19:26:42.144975 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136095    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 19:26:42.144975 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136097    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 19:26:42.144975 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136099    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 19:26:42.144975 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136102    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 19:26:42.144975 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136104    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 19:26:42.144975 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136107    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 19:26:42.144975 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136109    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 19:26:42.144975 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136111    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 19:26:42.144975 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136114    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 19:26:42.145814 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136117    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 19:26:42.145814 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136120    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 19:26:42.145814 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136122    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 19:26:42.145814 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136124    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 19:26:42.145814 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136128    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 19:26:42.145814 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136130    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 19:26:42.145814 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136133    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 19:26:42.145814 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136135    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 19:26:42.145814 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136138    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 19:26:42.145814 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136140    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 19:26:42.145814 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136143    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 19:26:42.145814 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136147    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 19:26:42.145814 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136151    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 19:26:42.145814 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136154    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 19:26:42.145814 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136158    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 19:26:42.145814 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136161    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 19:26:42.145814 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136170    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 19:26:42.145814 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136173    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 19:26:42.145814 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136177    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 19:26:42.146304 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136180    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 19:26:42.146304 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136183    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 19:26:42.146304 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136186    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 19:26:42.146304 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136189    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 19:26:42.146304 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136193    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 19:26:42.146304 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136196    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 19:26:42.146304 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136199    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 19:26:42.146304 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136202    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 19:26:42.146304 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136204    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 19:26:42.146304 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136207    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 19:26:42.146304 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136210    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 19:26:42.146304 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136212    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 19:26:42.146304 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136215    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 19:26:42.146304 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136217    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 19:26:42.146304 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136220    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 19:26:42.146304 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136222    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 19:26:42.146304 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136225    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 19:26:42.146304 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136229    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 19:26:42.146304 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136232    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 19:26:42.146304 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136236    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 19:26:42.146827 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136239    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 19:26:42.146827 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136241    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 19:26:42.146827 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136244    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 19:26:42.146827 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136246    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 19:26:42.146827 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136248    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 19:26:42.146827 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136252    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 19:26:42.146827 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136255    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 19:26:42.146827 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136258    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 19:26:42.146827 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136260    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 19:26:42.146827 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136263    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 19:26:42.146827 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136265    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 19:26:42.146827 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136268    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 19:26:42.146827 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136270    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 19:26:42.146827 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136273    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 19:26:42.146827 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136275    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 19:26:42.146827 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136278    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 19:26:42.146827 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136280    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 19:26:42.146827 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136283    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 19:26:42.146827 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136285    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 19:26:42.146827 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136288    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 19:26:42.147309 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136290    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 19:26:42.147309 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136293    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 19:26:42.147309 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136295    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 19:26:42.147309 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136297    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 19:26:42.147309 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.136300    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 19:26:42.147309 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.136305    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 19:26:42.147309 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.143463    2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 24 19:26:42.147309 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.143480    2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 24 19:26:42.147309 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.143498    2579 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 24 19:26:42.147309 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.143503    2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 24 19:26:42.147309 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143558    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 19:26:42.147309 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143563    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 19:26:42.147309 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143567    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 19:26:42.147309 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143570    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 19:26:42.147309 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143573    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 19:26:42.147678 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143576    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 19:26:42.147678 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143580    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 19:26:42.147678 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143583    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 19:26:42.147678 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143585    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 19:26:42.147678 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143588    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 19:26:42.147678 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143591    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 19:26:42.147678 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143594    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 19:26:42.147678 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143597    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 19:26:42.147678 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143600    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 19:26:42.147678 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143602    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 19:26:42.147678 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143605    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 19:26:42.147678 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143608    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 19:26:42.147678 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143610    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 19:26:42.147678 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143613    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 19:26:42.147678 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143615    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 19:26:42.147678 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143618    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 19:26:42.147678 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143622    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 19:26:42.147678 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143625    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 19:26:42.147678 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143629    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 19:26:42.147678 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143631    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 19:26:42.148183 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143634    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 19:26:42.148183 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143637    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 19:26:42.148183 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143640    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 19:26:42.148183 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143642    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 19:26:42.148183 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143646    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 19:26:42.148183 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143649    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 19:26:42.148183 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143652    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 19:26:42.148183 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143655    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 19:26:42.148183 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143657    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 19:26:42.148183 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143660    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 19:26:42.148183 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143663    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 19:26:42.148183 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143665    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 19:26:42.148183 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143668    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 19:26:42.148183 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143670    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 19:26:42.148183 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143673    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 19:26:42.148183 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143676    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 19:26:42.148183 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143678    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 19:26:42.148183 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143680    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 19:26:42.148183 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143683    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 19:26:42.148183 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143685    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 19:26:42.148671 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143688    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 19:26:42.148671 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143690    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 19:26:42.148671 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143693    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 19:26:42.148671 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143695    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 19:26:42.148671 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143699    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 19:26:42.148671 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143703    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 19:26:42.148671 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143706    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 19:26:42.148671 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143708    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 19:26:42.148671 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143711    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 19:26:42.148671 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143714    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 19:26:42.148671 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143716    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 19:26:42.148671 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143735    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 19:26:42.148671 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143740    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 19:26:42.148671 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143745    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 19:26:42.148671 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143749    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 19:26:42.148671 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143752    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 19:26:42.148671 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143755    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 19:26:42.148671 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143758    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 19:26:42.148671 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143762    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 19:26:42.149147 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143765    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 19:26:42.149147 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143767    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 19:26:42.149147 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143770    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 19:26:42.149147 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143772    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 19:26:42.149147 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143775    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 19:26:42.149147 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143777    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 19:26:42.149147 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143780    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 19:26:42.149147 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143782    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 19:26:42.149147 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143785    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 19:26:42.149147 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143787    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 19:26:42.149147 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143789    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 19:26:42.149147 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143792    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 19:26:42.149147 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143794    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 19:26:42.149147 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143797    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 19:26:42.149147 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143799    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 19:26:42.149147 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143802    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 19:26:42.149147 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143804    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 19:26:42.149147 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143807    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 19:26:42.149147 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143809    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 19:26:42.149147 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143812    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 19:26:42.149628 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143815    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 19:26:42.149628 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143818    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 19:26:42.149628 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143820    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 19:26:42.149628 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143822    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 19:26:42.149628 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143825    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 19:26:42.149628 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143827    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 19:26:42.149628 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143830    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 19:26:42.149628 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143832    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 19:26:42.149628 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143835    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 19:26:42.149628 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143837    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 19:26:42.149628 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143840    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 19:26:42.149628 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143843    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 19:26:42.149628 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143845    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 19:26:42.149628 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143847    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 19:26:42.149628 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143850    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 19:26:42.150023 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.143855    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 19:26:42.150023 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143969    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 19:26:42.150023 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143973    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 19:26:42.150023 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143976    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 19:26:42.150023 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143979    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 19:26:42.150023 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143982    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 19:26:42.150023 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143985    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 19:26:42.150023 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143987    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 19:26:42.150023 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143990    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 19:26:42.150023 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143992    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 19:26:42.150023 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143995    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 19:26:42.150023 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.143999    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 19:26:42.150023 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144003    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 19:26:42.150023 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144005    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 19:26:42.150023 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144008    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 19:26:42.150391 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144011    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 19:26:42.150391 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144014    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 19:26:42.150391 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144017    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 19:26:42.150391 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144020    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 19:26:42.150391 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144022    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 19:26:42.150391 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144025    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 19:26:42.150391 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144027    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 19:26:42.150391 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144030    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 19:26:42.150391 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144032    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 19:26:42.150391 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144034    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 19:26:42.150391 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144036    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 19:26:42.150391 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144039    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 19:26:42.150391 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144041    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 19:26:42.150391 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144045    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 19:26:42.150391 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144048    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 19:26:42.150391 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144051    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 19:26:42.150391 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144053    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 19:26:42.150391 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144056    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 19:26:42.150391 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144058    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 19:26:42.150865 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144061    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 19:26:42.150865 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144063    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 19:26:42.150865 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144065    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 19:26:42.150865 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144068    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 19:26:42.150865 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144071    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 19:26:42.150865 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144073    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 19:26:42.150865 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144075    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 19:26:42.150865 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144078    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 19:26:42.150865 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144080    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 19:26:42.150865 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144083    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 19:26:42.150865 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144086    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 19:26:42.150865 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144088    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 19:26:42.150865 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144090    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 19:26:42.150865 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144093    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 19:26:42.150865 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144095    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 19:26:42.150865 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144098    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 19:26:42.150865 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144100    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 19:26:42.150865 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144103    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 19:26:42.150865 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144105    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 19:26:42.150865 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144108    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 19:26:42.151355 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144110    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 19:26:42.151355 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144113    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 19:26:42.151355 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144115    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 19:26:42.151355 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144117    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 19:26:42.151355 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144121    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 19:26:42.151355 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144124    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 19:26:42.151355 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144127    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 19:26:42.151355 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144130    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 19:26:42.151355 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144132    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 19:26:42.151355 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144135    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 19:26:42.151355 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144137    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 19:26:42.151355 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144140    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 19:26:42.151355 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144142    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 19:26:42.151355 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144145    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 19:26:42.151355 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144147    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 19:26:42.151355 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144150    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 19:26:42.151355 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144152    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 19:26:42.151355 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144154    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 19:26:42.151355 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144157    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 19:26:42.151817 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144159    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 19:26:42.151817 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144161    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 19:26:42.151817 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144164    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 19:26:42.151817 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144166    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 19:26:42.151817 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144169    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 19:26:42.151817 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144171    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 19:26:42.151817 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144174    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 19:26:42.151817 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144176    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 19:26:42.151817 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144179    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 19:26:42.151817 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144181    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 19:26:42.151817 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144183    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 19:26:42.151817 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144186    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 19:26:42.151817 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144188    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 19:26:42.151817 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144191    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 19:26:42.151817 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144193    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 19:26:42.151817 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144196    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 19:26:42.151817 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144198    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 19:26:42.151817 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144201    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 19:26:42.151817 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144204    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 19:26:42.151817 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144206    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 19:26:42.152299 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144209    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 19:26:42.152299 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144212    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 19:26:42.152299 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144264    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 19:26:42.152299 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144317    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 19:26:42.152299 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144321    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 19:26:42.152299 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144324    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 19:26:42.152299 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:42.144327    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 19:26:42.152299 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.144333    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 19:26:42.152299 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.144686    2579 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 24 19:26:42.152299 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.147256    2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 24 19:26:42.152299 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.148633    2579 server.go:1019] "Starting client certificate rotation"
Jul 24 19:26:42.152299 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.148750    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 19:26:42.152299 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.148779    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 19:26:42.152637 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.151848    2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 19:26:42.153396 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.153378    2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 19:26:42.165258 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.165231    2579 log.go:25] "Validated CRI v1 runtime API"
Jul 24 19:26:42.168555 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.168537    2579 log.go:25] "Validated CRI v1 image API"
Jul 24 19:26:42.169438 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.169422    2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 24 19:26:42.171672 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.171640    2579 fs.go:135] Filesystem UUIDs: map[57693798-096f-4b89-b864-ae9907e1a0c5:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 be6a22b0-f28c-4984-a43a-3edde507a464:/dev/nvme0n1p3]
Jul 24 19:26:42.171786 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.171664    2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 24 19:26:42.175712 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.175691    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 19:26:42.178098 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.177984    2579 manager.go:216] Machine: {Timestamp:2026-07-24 19:26:42.176642914 +0000 UTC m=+0.365717218 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100059 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2948833109bdcec2d72cc2f59f05fb SystemUUID:ec294883-3109-bdce-c2d7-2cc2f59f05fb BootID:a8275a9c-0d86-4d76-b5b1-35fb582aa3d2 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:9b:65:17:c9:d7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:9b:65:17:c9:d7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:aa:9a:53:ab:bf:0d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 24 19:26:42.178098 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.178091    2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 24 19:26:42.178248 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.178207    2579 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 24 19:26:42.180575 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.180547    2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 24 19:26:42.180712 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.180578    2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-150.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 24 19:26:42.181270 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.181259    2579 topology_manager.go:138] "Creating topology manager with none policy"
Jul 24 19:26:42.181302 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.181272    2579 container_manager_linux.go:309] "Creating device plugin manager"
Jul 24 19:26:42.181302 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.181279    2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 19:26:42.181891 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.181880    2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 19:26:42.182790 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.182780    2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 24 19:26:42.184450 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.184439    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 19:26:42.184569 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.184560    2579 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 24 19:26:42.184600 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.184591    2579 kubelet.go:486] "Attempting to sync node with API server"
Jul 24 19:26:42.185799 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.185787    2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 24 19:26:42.185836 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.185813    2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 24 19:26:42.185836 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.185823    2579 kubelet.go:398] "Adding apiserver pod source"
Jul 24 19:26:42.185836 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.185832    2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 24 19:26:42.186247 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.186221    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 19:26:42.186304 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.186252    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 19:26:42.189700 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.189673    2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 24 19:26:42.191647 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.191630    2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 24 19:26:42.191706 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.191674    2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 24 19:26:42.194985 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:42.194961    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-150.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 19:26:42.194985 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:42.194977    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 19:26:42.195171 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.195159    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 24 19:26:42.195215 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.195177    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 24 19:26:42.195215 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.195184    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 24 19:26:42.195215 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.195189    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 24 19:26:42.195215 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.195197    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 24 19:26:42.195215 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.195203    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 24 19:26:42.195215 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.195210    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 24 19:26:42.195215 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.195215    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 24 19:26:42.195429 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.195222    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 24 19:26:42.195429 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.195228    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 24 19:26:42.195429 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.195236    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 24 19:26:42.195429 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.195241    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 24 19:26:42.196608 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.196597    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 24 19:26:42.196608 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.196606    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 24 19:26:42.199557 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.199540    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p8br7"
Jul 24 19:26:42.199810 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.199798    2579 server.go:1268] "Started kubelet"
Jul 24 19:26:42.199886 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.199862    2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 24 19:26:42.200072 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.200004    2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 24 19:26:42.200184 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.200110    2579 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 24 19:26:42.200770 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.200752    2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-150.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 19:26:42.200913 ip-10-0-131-150 systemd[1]: Started Kubernetes Kubelet.
Jul 24 19:26:42.202608 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.202591    2579 server.go:310] "Adding debug handlers to kubelet server"
Jul 24 19:26:42.204712 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.204687    2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 24 19:26:42.205929 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:42.205913    2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 24 19:26:42.207058 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.207036    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p8br7"
Jul 24 19:26:42.209853 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:42.208831    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-150.ec2.internal.18c55060612e2dd6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-150.ec2.internal,UID:ip-10-0-131-150.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-150.ec2.internal,},FirstTimestamp:2026-07-24 19:26:42.199768534 +0000 UTC m=+0.388842838,LastTimestamp:2026-07-24 19:26:42.199768534 +0000 UTC m=+0.388842838,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-150.ec2.internal,}"
Jul 24 19:26:42.212020 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.212005    2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 24 19:26:42.212083 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.212006    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 24 19:26:42.212172 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:42.212155    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-150.ec2.internal\" not found"
Jul 24 19:26:42.212851 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.212833    2579 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 24 19:26:42.212945 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.212853    2579 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 24 19:26:42.212945 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.212830    2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 24 19:26:42.213040 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.213004    2579 reconstruct.go:97] "Volume reconstruction finished"
Jul 24 19:26:42.213040 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.213014    2579 reconciler.go:29] "Reconciler: start to sync state"
Jul 24 19:26:42.213040 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.213036    2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 24 19:26:42.213153 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.213049    2579 factory.go:55] Registering systemd factory
Jul 24 19:26:42.213153 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.213058    2579 factory.go:223] Registration of the systemd container factory successfully
Jul 24 19:26:42.213325 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.213309    2579 factory.go:153] Registering CRI-O factory
Jul 24 19:26:42.213325 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.213326    2579 factory.go:223] Registration of the crio container factory successfully
Jul 24 19:26:42.213458 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.213349    2579 factory.go:103] Registering Raw factory
Jul 24 19:26:42.213458 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.213363    2579 manager.go:1196] Started watching for new ooms in manager
Jul 24 19:26:42.213870 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:42.213849    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 24 19:26:42.214064 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:42.214024    2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-150.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 24 19:26:42.214064 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.214040    2579 manager.go:349] Starting recovery of all containers
Jul 24 19:26:42.224965 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.224816    2579 manager.go:354] Recovery completed
Jul 24 19:26:42.226396 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:42.226375    2579 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 24 19:26:42.229307 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.229295    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 19:26:42.231931 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.231917    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 19:26:42.232011 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.231943    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 19:26:42.232011 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.231954    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasSufficientPID"
Jul 24 19:26:42.232491 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.232477    2579 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 24 19:26:42.232491 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.232490    2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 24 19:26:42.232584 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.232504    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 19:26:42.232584 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.232543    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 19:26:42.233188 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.233171    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 19:26:42.233262 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.233203    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 19:26:42.233262 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.233218    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasSufficientPID"
Jul 24 19:26:42.234156 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.234144    2579 policy_none.go:49] "None policy: Start"
Jul 24 19:26:42.234212 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.234159    2579 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 24 19:26:42.234212 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.234170    2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 24 19:26:42.235267 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.235257    2579 policy_none.go:47] "Start"
Jul 24 19:26:42.272604 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.272584    2579 manager.go:337] "Starting Device Plugin manager"
Jul 24 19:26:42.272763 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:42.272635    2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 24 19:26:42.272763 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.272649    2579 server.go:87] "Starting device plugin registration server"
Jul 24 19:26:42.272984 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.272971    2579 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 24 19:26:42.273048 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.272985    2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 24 19:26:42.273099 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.273058    2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 24 19:26:42.273145 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.273129    2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 24 19:26:42.273145 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.273137    2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 24 19:26:42.273764 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:42.273743    2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 24 19:26:42.273851 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:42.273791    2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-150.ec2.internal\" not found"
Jul 24 19:26:42.360128 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.360087    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 24 19:26:42.361472 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.361457    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 24 19:26:42.361525 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.361503    2579 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 24 19:26:42.361568 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.361528    2579 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 24 19:26:42.361623 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:42.361564    2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 24 19:26:42.363713 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.363688    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 19:26:42.373885 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.373852    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 19:26:42.375168 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.375148    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 19:26:42.375274 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.375186    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 19:26:42.375274 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.375197    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasSufficientPID"
Jul 24 19:26:42.375274 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.375220    2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-150.ec2.internal"
Jul 24 19:26:42.380582 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.380528    2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-150.ec2.internal"
Jul 24 19:26:42.380582 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:42.380553    2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-150.ec2.internal\": node \"ip-10-0-131-150.ec2.internal\" not found"
Jul 24 19:26:42.393147 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:42.393128    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-150.ec2.internal\" not found"
Jul 24 19:26:42.462565 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.462531    2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-150.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal"]
Jul 24 19:26:42.462655 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.462612    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 19:26:42.463683 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.463666    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 19:26:42.463799 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.463696    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 19:26:42.463799 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.463707    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasSufficientPID"
Jul 24 19:26:42.464999 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.464986    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 19:26:42.465117 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.465096    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-150.ec2.internal"
Jul 24 19:26:42.465157 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.465147    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 19:26:42.465687 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.465670    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 19:26:42.465779 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.465700    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 19:26:42.465779 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.465714    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasSufficientPID"
Jul 24 19:26:42.466294 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.465781    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 19:26:42.466334 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.466319    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 19:26:42.466365 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.466334    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasSufficientPID"
Jul 24 19:26:42.467803 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.467790    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal"
Jul 24 19:26:42.467847 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.467820    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 19:26:42.468656 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.468638    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 19:26:42.468716 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.468673    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 19:26:42.468716 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.468689    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasSufficientPID"
Jul 24 19:26:42.493295 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:42.493271    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-150.ec2.internal\" not found"
Jul 24 19:26:42.493449 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:42.493430    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-150.ec2.internal\" not found" node="ip-10-0-131-150.ec2.internal"
Jul 24 19:26:42.497881 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:42.497865    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-150.ec2.internal\" not found" node="ip-10-0-131-150.ec2.internal"
Jul 24 19:26:42.514632 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.514608    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1188e37e92b4900d2886b98231ddef72-config\") pod \"kube-apiserver-proxy-ip-10-0-131-150.ec2.internal\" (UID: \"1188e37e92b4900d2886b98231ddef72\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-150.ec2.internal"
Jul 24 19:26:42.514748 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.514641    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3d8b400053bfa9f9c637aaf70e5d75ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal\" (UID: \"3d8b400053bfa9f9c637aaf70e5d75ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal"
Jul 24 19:26:42.514748 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.514659    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d8b400053bfa9f9c637aaf70e5d75ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal\" (UID: \"3d8b400053bfa9f9c637aaf70e5d75ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal"
Jul 24 19:26:42.593786 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:42.593747    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-150.ec2.internal\" not found"
Jul 24 19:26:42.615151 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.615119    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1188e37e92b4900d2886b98231ddef72-config\") pod \"kube-apiserver-proxy-ip-10-0-131-150.ec2.internal\" (UID: \"1188e37e92b4900d2886b98231ddef72\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-150.ec2.internal"
Jul 24 19:26:42.615258 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.615155    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3d8b400053bfa9f9c637aaf70e5d75ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal\" (UID: \"3d8b400053bfa9f9c637aaf70e5d75ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal"
Jul 24 19:26:42.615258 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.615175    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d8b400053bfa9f9c637aaf70e5d75ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal\" (UID: \"3d8b400053bfa9f9c637aaf70e5d75ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal"
Jul 24 19:26:42.615258 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.615223    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d8b400053bfa9f9c637aaf70e5d75ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal\" (UID: \"3d8b400053bfa9f9c637aaf70e5d75ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal"
Jul 24 19:26:42.615258 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.615228    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1188e37e92b4900d2886b98231ddef72-config\") pod \"kube-apiserver-proxy-ip-10-0-131-150.ec2.internal\" (UID: \"1188e37e92b4900d2886b98231ddef72\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-150.ec2.internal"
Jul 24 19:26:42.615258 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.615245    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3d8b400053bfa9f9c637aaf70e5d75ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal\" (UID: \"3d8b400053bfa9f9c637aaf70e5d75ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal"
Jul 24 19:26:42.694634 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:42.694556    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-150.ec2.internal\" not found"
Jul 24 19:26:42.795177 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:42.795137    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-150.ec2.internal\" not found"
Jul 24 19:26:42.797337 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.797318    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-150.ec2.internal"
Jul 24 19:26:42.801270 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:42.801249    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal"
Jul 24 19:26:42.896232 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:42.896184    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-150.ec2.internal\" not found"
Jul 24 19:26:42.997046 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:42.996998    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-150.ec2.internal\" not found"
Jul 24 19:26:43.097166 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:43.097121    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-150.ec2.internal\" not found"
Jul 24 19:26:43.143703 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:43.143500    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 19:26:43.148673 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:43.148650    2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 24 19:26:43.148830 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:43.148803    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 19:26:43.148883 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:43.148863    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 19:26:43.198251 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:43.198212    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-150.ec2.internal\" not found"
Jul 24 19:26:43.212341 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:43.212254    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 19:21:42 +0000 UTC" deadline="2028-02-22 04:54:48.635140854 +0000 UTC"
Jul 24 19:26:43.212341 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:43.212286    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13857h28m5.422857759s"
Jul 24 19:26:43.299151 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:43.299118    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-150.ec2.internal\" not found"
Jul 24 19:26:43.308508 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:43.308480    2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 19:26:43.312772 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:43.312751    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-150.ec2.internal"
Jul 24 19:26:43.322216 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:43.322195    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 19:26:43.324106 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:43.324090    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal"
Jul 24 19:26:43.337982 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:43.337964    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 19:26:43.363369 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:43.363338    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d8b400053bfa9f9c637aaf70e5d75ea.slice/crio-59f5e74b21920340af312ee0d00277af910c1bb244f04f8f67d92e15e7219b4b WatchSource:0}: Error finding container 59f5e74b21920340af312ee0d00277af910c1bb244f04f8f67d92e15e7219b4b: Status 404 returned error can't find the container with id 59f5e74b21920340af312ee0d00277af910c1bb244f04f8f67d92e15e7219b4b
Jul 24 19:26:43.363564 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:43.363546    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1188e37e92b4900d2886b98231ddef72.slice/crio-caadf4aca0a21d2c5ea46886fdd2688d18f3cc01a5ab225e31a240b88e6cf122 WatchSource:0}: Error finding container caadf4aca0a21d2c5ea46886fdd2688d18f3cc01a5ab225e31a240b88e6cf122: Status 404 returned error can't find the container with id caadf4aca0a21d2c5ea46886fdd2688d18f3cc01a5ab225e31a240b88e6cf122
Jul 24 19:26:43.367459 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:43.367445    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 19:26:43.752128 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:43.752096    2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 19:26:44.127863 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.127775    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 19:26:44.187437 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.187400    2579 apiserver.go:52] "Watching apiserver"
Jul 24 19:26:44.194180 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.194147    2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 24 19:26:44.195711 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.195685    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-7s5nj","openshift-multus/multus-additional-cni-plugins-4zz8w","openshift-multus/network-metrics-daemon-slw87","openshift-network-operator/iptables-alerter-4xmjp","kube-system/global-pull-secret-syncer-gkd6m","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmm2w","openshift-cluster-node-tuning-operator/tuned-zmlbg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal","openshift-network-diagnostics/network-check-target-v4htc","openshift-ovn-kubernetes/ovnkube-node-vclnd","kube-system/konnectivity-agent-v4nt7","kube-system/kube-apiserver-proxy-ip-10-0-131-150.ec2.internal","openshift-dns/node-resolver-ctz4q","openshift-image-registry/node-ca-d8zx6"]
Jul 24 19:26:44.197632 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.197610    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmm2w"
Jul 24 19:26:44.201494 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.201471    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 24 19:26:44.201704 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.201689    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 24 19:26:44.201943 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.201918    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-l4bwj\""
Jul 24 19:26:44.202079 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.202058    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 24 19:26:44.204418 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.203349    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.207862 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.206171    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 24 19:26:44.207862 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.206426    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 24 19:26:44.207862 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.206793    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 24 19:26:44.207862 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.207056    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4z9h8\""
Jul 24 19:26:44.207862 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.207370    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 24 19:26:44.207862 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.207572    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 24 19:26:44.207862 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.207723    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 24 19:26:44.207862 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.207785    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.208424 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.207886    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4xmjp"
Jul 24 19:26:44.209226 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.209202    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gkd6m"
Jul 24 19:26:44.209329 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:44.209295    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gkd6m" podUID="73db2676-b431-4046-8290-c4813da2ee8a"
Jul 24 19:26:44.210627 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.210606    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slw87"
Jul 24 19:26:44.210732 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:44.210677    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slw87" podUID="088489c0-3c4a-4b1d-8724-d9ca828ea309"
Jul 24 19:26:44.210986 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.210970    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6k9tg\""
Jul 24 19:26:44.211167 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.211149    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 24 19:26:44.211235 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.211222    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jjdz6\""
Jul 24 19:26:44.211344 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.211329    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 24 19:26:44.211447 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.211430    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 24 19:26:44.211509 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.211461    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 24 19:26:44.211509 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.211499    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 24 19:26:44.211611 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.211581    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 24 19:26:44.211911 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.211698    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 24 19:26:44.213288 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.212600    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 24 19:26:44.213649 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.213608    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zmlbg"
Jul 24 19:26:44.215325 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.215307    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4htc"
Jul 24 19:26:44.215430 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:44.215375    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4htc" podUID="8417d154-2680-412f-b5dc-c9980030f61b"
Jul 24 19:26:44.215829 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.215806    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lfk6v\""
Jul 24 19:26:44.216149 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.216128    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 24 19:26:44.216349 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.216333    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 24 19:26:44.219122 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.219101    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4zz8w"
Jul 24 19:26:44.220867 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.220846    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v4nt7"
Jul 24 19:26:44.223059 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.222336    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 24 19:26:44.223059 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.222441    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 24 19:26:44.223059 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.222741    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-sv8pt\""
Jul 24 19:26:44.223693 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.223662    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 24 19:26:44.223869 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.223850    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wm7w2\""
Jul 24 19:26:44.224466 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.224389    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 24 19:26:44.226235 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.224486    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b352627c-bfb7-4f1b-8422-590916dc322b-etc-sysconfig\") pod \"tuned-zmlbg\" (UID: \"b352627c-bfb7-4f1b-8422-590916dc322b\") " pod="openshift-cluster-node-tuning-operator/tuned-zmlbg"
Jul 24 19:26:44.226235 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.224646    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b352627c-bfb7-4f1b-8422-590916dc322b-etc-sysctl-conf\") pod \"tuned-zmlbg\" (UID: \"b352627c-bfb7-4f1b-8422-590916dc322b\") " pod="openshift-cluster-node-tuning-operator/tuned-zmlbg"
Jul 24 19:26:44.226235 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.224688    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b352627c-bfb7-4f1b-8422-590916dc322b-var-lib-kubelet\") pod \"tuned-zmlbg\" (UID: \"b352627c-bfb7-4f1b-8422-590916dc322b\") " pod="openshift-cluster-node-tuning-operator/tuned-zmlbg"
Jul 24 19:26:44.226235 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.224722    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b352627c-bfb7-4f1b-8422-590916dc322b-tmp\") pod \"tuned-zmlbg\" (UID: \"b352627c-bfb7-4f1b-8422-590916dc322b\") " pod="openshift-cluster-node-tuning-operator/tuned-zmlbg"
Jul 24 19:26:44.226235 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.224759    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f803e90d-0eb9-4061-873e-e0a5a6a3b19f-device-dir\") pod \"aws-ebs-csi-driver-node-cmm2w\" (UID: \"f803e90d-0eb9-4061-873e-e0a5a6a3b19f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmm2w"
Jul 24 19:26:44.226235 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.224973    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fa8789c9-6c39-46cd-a540-657dea710eb8-run-ovn\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.226235 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.225013    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa8789c9-6c39-46cd-a540-657dea710eb8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.226235 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.225058    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1a57aec4-d102-4483-a562-53ae8ed51e6e-multus-conf-dir\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.226235 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.225103    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a57aec4-d102-4483-a562-53ae8ed51e6e-etc-kubernetes\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.226235 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.225125    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 19:26:44.226235 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.225145    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/73db2676-b431-4046-8290-c4813da2ee8a-dbus\") pod \"global-pull-secret-syncer-gkd6m\" (UID: \"73db2676-b431-4046-8290-c4813da2ee8a\") " pod="kube-system/global-pull-secret-syncer-gkd6m"
Jul 24 19:26:44.226235 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.225188    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/73db2676-b431-4046-8290-c4813da2ee8a-original-pull-secret\") pod \"global-pull-secret-syncer-gkd6m\" (UID: \"73db2676-b431-4046-8290-c4813da2ee8a\") " pod="kube-system/global-pull-secret-syncer-gkd6m"
Jul 24 19:26:44.226235 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.225236    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/77089fa0-e8af-4044-8ca5-acbbdd5bc2f7-iptables-alerter-script\") pod \"iptables-alerter-4xmjp\" (UID: \"77089fa0-e8af-4044-8ca5-acbbdd5bc2f7\") " pod="openshift-network-operator/iptables-alerter-4xmjp"
Jul 24 19:26:44.226235 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.225264    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77089fa0-e8af-4044-8ca5-acbbdd5bc2f7-host-slash\") pod \"iptables-alerter-4xmjp\" (UID: \"77089fa0-e8af-4044-8ca5-acbbdd5bc2f7\") " pod="openshift-network-operator/iptables-alerter-4xmjp"
Jul 24 19:26:44.226235 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.225303    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1a57aec4-d102-4483-a562-53ae8ed51e6e-cni-binary-copy\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.226235 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.225338    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1a57aec4-d102-4483-a562-53ae8ed51e6e-multus-daemon-config\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.226235 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.225371    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjq5p\" (UniqueName: \"kubernetes.io/projected/77089fa0-e8af-4044-8ca5-acbbdd5bc2f7-kube-api-access-vjq5p\") pod \"iptables-alerter-4xmjp\" (UID: \"77089fa0-e8af-4044-8ca5-acbbdd5bc2f7\") " pod="openshift-network-operator/iptables-alerter-4xmjp"
Jul 24 19:26:44.227113 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.225395    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b352627c-bfb7-4f1b-8422-590916dc322b-etc-modprobe-d\") pod \"tuned-zmlbg\" (UID: \"b352627c-bfb7-4f1b-8422-590916dc322b\") " pod="openshift-cluster-node-tuning-operator/tuned-zmlbg"
Jul 24 19:26:44.227113 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.225430    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b352627c-bfb7-4f1b-8422-590916dc322b-host\") pod \"tuned-zmlbg\" (UID: \"b352627c-bfb7-4f1b-8422-590916dc322b\") " pod="openshift-cluster-node-tuning-operator/tuned-zmlbg"
Jul 24 19:26:44.227113 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.225468    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fa8789c9-6c39-46cd-a540-657dea710eb8-ovn-node-metrics-cert\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.227113 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.225508    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1a57aec4-d102-4483-a562-53ae8ed51e6e-host-run-k8s-cni-cncf-io\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.227113 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.225552    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1a57aec4-d102-4483-a562-53ae8ed51e6e-host-var-lib-cni-bin\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.227113 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.225595    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1a57aec4-d102-4483-a562-53ae8ed51e6e-hostroot\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.227113 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.225634    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1a57aec4-d102-4483-a562-53ae8ed51e6e-host-run-multus-certs\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.227113 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.225670    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fa8789c9-6c39-46cd-a540-657dea710eb8-host-cni-bin\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.227113 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.225702    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1a57aec4-d102-4483-a562-53ae8ed51e6e-multus-socket-dir-parent\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.227113 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.225741    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1a57aec4-d102-4483-a562-53ae8ed51e6e-host-run-netns\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.227113 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.225774    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f803e90d-0eb9-4061-873e-e0a5a6a3b19f-sys-fs\") pod \"aws-ebs-csi-driver-node-cmm2w\" (UID: \"f803e90d-0eb9-4061-873e-e0a5a6a3b19f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmm2w"
Jul 24 19:26:44.227113 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.225826    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv4cw\" (UniqueName: \"kubernetes.io/projected/f803e90d-0eb9-4061-873e-e0a5a6a3b19f-kube-api-access-hv4cw\") pod \"aws-ebs-csi-driver-node-cmm2w\" (UID: \"f803e90d-0eb9-4061-873e-e0a5a6a3b19f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmm2w"
Jul 24 19:26:44.227113 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.225865    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/088489c0-3c4a-4b1d-8724-d9ca828ea309-metrics-certs\") pod \"network-metrics-daemon-slw87\" (UID: \"088489c0-3c4a-4b1d-8724-d9ca828ea309\") " pod="openshift-multus/network-metrics-daemon-slw87"
Jul 24 19:26:44.227113 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.225903    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b352627c-bfb7-4f1b-8422-590916dc322b-sys\") pod \"tuned-zmlbg\" (UID: \"b352627c-bfb7-4f1b-8422-590916dc322b\") " pod="openshift-cluster-node-tuning-operator/tuned-zmlbg"
Jul 24 19:26:44.227113 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.225949    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fa8789c9-6c39-46cd-a540-657dea710eb8-run-openvswitch\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.227113 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.225978    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a57aec4-d102-4483-a562-53ae8ed51e6e-system-cni-dir\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.227113 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.226011    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f803e90d-0eb9-4061-873e-e0a5a6a3b19f-etc-selinux\") pod \"aws-ebs-csi-driver-node-cmm2w\" (UID: \"f803e90d-0eb9-4061-873e-e0a5a6a3b19f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmm2w"
Jul 24 19:26:44.227960 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.226054    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b352627c-bfb7-4f1b-8422-590916dc322b-etc-kubernetes\") pod \"tuned-zmlbg\" (UID: \"b352627c-bfb7-4f1b-8422-590916dc322b\") " pod="openshift-cluster-node-tuning-operator/tuned-zmlbg"
Jul 24 19:26:44.227960 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.226097    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b352627c-bfb7-4f1b-8422-590916dc322b-etc-systemd\") pod \"tuned-zmlbg\" (UID: \"b352627c-bfb7-4f1b-8422-590916dc322b\") " pod="openshift-cluster-node-tuning-operator/tuned-zmlbg"
Jul 24 19:26:44.227960 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.226133    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b352627c-bfb7-4f1b-8422-590916dc322b-lib-modules\") pod \"tuned-zmlbg\" (UID: \"b352627c-bfb7-4f1b-8422-590916dc322b\") " pod="openshift-cluster-node-tuning-operator/tuned-zmlbg"
Jul 24 19:26:44.227960 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.226166    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fa8789c9-6c39-46cd-a540-657dea710eb8-host-slash\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.227960 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.226207    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fa8789c9-6c39-46cd-a540-657dea710eb8-var-lib-openvswitch\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.227960 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.226234    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f803e90d-0eb9-4061-873e-e0a5a6a3b19f-socket-dir\") pod \"aws-ebs-csi-driver-node-cmm2w\" (UID: \"f803e90d-0eb9-4061-873e-e0a5a6a3b19f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmm2w"
Jul 24 19:26:44.227960 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.226268    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fa8789c9-6c39-46cd-a540-657dea710eb8-host-run-netns\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.227960 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.226299    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa8789c9-6c39-46cd-a540-657dea710eb8-host-run-ovn-kubernetes\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.227960 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.226336    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fa8789c9-6c39-46cd-a540-657dea710eb8-etc-openvswitch\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.227960 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.226369    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fa8789c9-6c39-46cd-a540-657dea710eb8-ovnkube-config\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.227960 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.226401    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b352627c-bfb7-4f1b-8422-590916dc322b-etc-sysctl-d\") pod \"tuned-zmlbg\" (UID: \"b352627c-bfb7-4f1b-8422-590916dc322b\") " pod="openshift-cluster-node-tuning-operator/tuned-zmlbg"
Jul 24 19:26:44.227960 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.226436    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fa8789c9-6c39-46cd-a540-657dea710eb8-systemd-units\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.227960 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.226476    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fa8789c9-6c39-46cd-a540-657dea710eb8-node-log\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.227960 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.226513    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a57aec4-d102-4483-a562-53ae8ed51e6e-host-var-lib-kubelet\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.227960 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.226565    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa8789c9-6c39-46cd-a540-657dea710eb8-host-kubelet\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.227960 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.226598    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b352627c-bfb7-4f1b-8422-590916dc322b-etc-tuned\") pod \"tuned-zmlbg\" (UID: \"b352627c-bfb7-4f1b-8422-590916dc322b\") " pod="openshift-cluster-node-tuning-operator/tuned-zmlbg"
Jul 24 19:26:44.228633 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.226639    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a57aec4-d102-4483-a562-53ae8ed51e6e-multus-cni-dir\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.228633 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.226675    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f803e90d-0eb9-4061-873e-e0a5a6a3b19f-registration-dir\") pod \"aws-ebs-csi-driver-node-cmm2w\" (UID: \"f803e90d-0eb9-4061-873e-e0a5a6a3b19f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmm2w"
Jul 24 19:26:44.228633 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.226711    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqgn8\" (UniqueName: \"kubernetes.io/projected/088489c0-3c4a-4b1d-8724-d9ca828ea309-kube-api-access-dqgn8\") pod \"network-metrics-daemon-slw87\" (UID: \"088489c0-3c4a-4b1d-8724-d9ca828ea309\") " pod="openshift-multus/network-metrics-daemon-slw87"
Jul 24 19:26:44.228633 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.226744    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b352627c-bfb7-4f1b-8422-590916dc322b-run\") pod \"tuned-zmlbg\" (UID: \"b352627c-bfb7-4f1b-8422-590916dc322b\") " pod="openshift-cluster-node-tuning-operator/tuned-zmlbg"
Jul 24 19:26:44.228633 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.226781    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqxm2\" (UniqueName: \"kubernetes.io/projected/b352627c-bfb7-4f1b-8422-590916dc322b-kube-api-access-zqxm2\") pod \"tuned-zmlbg\" (UID: \"b352627c-bfb7-4f1b-8422-590916dc322b\") " pod="openshift-cluster-node-tuning-operator/tuned-zmlbg"
Jul 24 19:26:44.228633 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.226832    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fa8789c9-6c39-46cd-a540-657dea710eb8-log-socket\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.228633 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.226866    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8xgz\" (UniqueName: \"kubernetes.io/projected/fa8789c9-6c39-46cd-a540-657dea710eb8-kube-api-access-z8xgz\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.228633 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.226912    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1a57aec4-d102-4483-a562-53ae8ed51e6e-os-release\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.228633 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.226945    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fa8789c9-6c39-46cd-a540-657dea710eb8-run-systemd\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.228633 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.226983    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fa8789c9-6c39-46cd-a540-657dea710eb8-ovnkube-script-lib\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.228633 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.227017    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1a57aec4-d102-4483-a562-53ae8ed51e6e-host-var-lib-cni-multus\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.228633 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.227070    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d8zx6"
Jul 24 19:26:44.228633 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.227050    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt2pl\" (UniqueName: \"kubernetes.io/projected/1a57aec4-d102-4483-a562-53ae8ed51e6e-kube-api-access-jt2pl\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.228633 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.227732    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ctz4q"
Jul 24 19:26:44.228633 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.228208    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fa8789c9-6c39-46cd-a540-657dea710eb8-env-overrides\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.228633 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.228238    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1a57aec4-d102-4483-a562-53ae8ed51e6e-cnibin\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.228633 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.228258    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f803e90d-0eb9-4061-873e-e0a5a6a3b19f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cmm2w\" (UID: \"f803e90d-0eb9-4061-873e-e0a5a6a3b19f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmm2w"
Jul 24 19:26:44.228633 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.228279    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fa8789c9-6c39-46cd-a540-657dea710eb8-host-cni-netd\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.229284 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.228303    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/73db2676-b431-4046-8290-c4813da2ee8a-kubelet-config\") pod \"global-pull-secret-syncer-gkd6m\" (UID: \"73db2676-b431-4046-8290-c4813da2ee8a\") " pod="kube-system/global-pull-secret-syncer-gkd6m"
Jul 24 19:26:44.229866 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.229842    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9rp86\""
Jul 24 19:26:44.230182 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.230017    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 24 19:26:44.230763 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.230719    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 24 19:26:44.230895 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.230848    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 24 19:26:44.231162 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.231141    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 24 19:26:44.231273 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.231212    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9wfvq\""
Jul 24 19:26:44.231608 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.231551    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 24 19:26:44.313790 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.313761    2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 24 19:26:44.328476 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.328442    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-l22f6"
Jul 24 19:26:44.328660 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.328507    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1a57aec4-d102-4483-a562-53ae8ed51e6e-multus-conf-dir\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.328660 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.328542    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a57aec4-d102-4483-a562-53ae8ed51e6e-etc-kubernetes\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.328660 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.328565    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/73db2676-b431-4046-8290-c4813da2ee8a-dbus\") pod \"global-pull-secret-syncer-gkd6m\" (UID: \"73db2676-b431-4046-8290-c4813da2ee8a\") " pod="kube-system/global-pull-secret-syncer-gkd6m"
Jul 24 19:26:44.328660 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.328590    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/73db2676-b431-4046-8290-c4813da2ee8a-original-pull-secret\") pod \"global-pull-secret-syncer-gkd6m\" (UID: \"73db2676-b431-4046-8290-c4813da2ee8a\") " pod="kube-system/global-pull-secret-syncer-gkd6m"
Jul 24 19:26:44.328660 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.328617    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/77089fa0-e8af-4044-8ca5-acbbdd5bc2f7-iptables-alerter-script\") pod \"iptables-alerter-4xmjp\" (UID: \"77089fa0-e8af-4044-8ca5-acbbdd5bc2f7\") " pod="openshift-network-operator/iptables-alerter-4xmjp"
Jul 24 19:26:44.328660 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.328638    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77089fa0-e8af-4044-8ca5-acbbdd5bc2f7-host-slash\") pod \"iptables-alerter-4xmjp\" (UID: \"77089fa0-e8af-4044-8ca5-acbbdd5bc2f7\") " pod="openshift-network-operator/iptables-alerter-4xmjp"
Jul 24 19:26:44.328660 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.328647    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a57aec4-d102-4483-a562-53ae8ed51e6e-etc-kubernetes\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.328660 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.328647    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1a57aec4-d102-4483-a562-53ae8ed51e6e-multus-conf-dir\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.329088 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.328662    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1a57aec4-d102-4483-a562-53ae8ed51e6e-cni-binary-copy\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.329088 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.328716    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1a57aec4-d102-4483-a562-53ae8ed51e6e-multus-daemon-config\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.329088 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.328766    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsvb4\" (UniqueName: \"kubernetes.io/projected/8417d154-2680-412f-b5dc-c9980030f61b-kube-api-access-lsvb4\") pod \"network-check-target-v4htc\" (UID: \"8417d154-2680-412f-b5dc-c9980030f61b\") " pod="openshift-network-diagnostics/network-check-target-v4htc"
Jul 24 19:26:44.329088 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.328791    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d2eb9885-1490-41e3-8e05-2a21ed230573-host\") pod \"node-ca-d8zx6\" (UID: \"d2eb9885-1490-41e3-8e05-2a21ed230573\") " pod="openshift-image-registry/node-ca-d8zx6"
Jul 24 19:26:44.329088 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:44.328807    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 19:26:44.329088 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.328818    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjq5p\" (UniqueName: \"kubernetes.io/projected/77089fa0-e8af-4044-8ca5-acbbdd5bc2f7-kube-api-access-vjq5p\") pod \"iptables-alerter-4xmjp\" (UID: \"77089fa0-e8af-4044-8ca5-acbbdd5bc2f7\") " pod="openshift-network-operator/iptables-alerter-4xmjp"
Jul 24 19:26:44.329088 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.328846    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b352627c-bfb7-4f1b-8422-590916dc322b-etc-modprobe-d\") pod \"tuned-zmlbg\" (UID: \"b352627c-bfb7-4f1b-8422-590916dc322b\") " pod="openshift-cluster-node-tuning-operator/tuned-zmlbg"
Jul 24 19:26:44.329088 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:44.328883    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73db2676-b431-4046-8290-c4813da2ee8a-original-pull-secret podName:73db2676-b431-4046-8290-c4813da2ee8a nodeName:}" failed. No retries permitted until 2026-07-24 19:26:44.828858916 +0000 UTC m=+3.017933232 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/73db2676-b431-4046-8290-c4813da2ee8a-original-pull-secret") pod "global-pull-secret-syncer-gkd6m" (UID: "73db2676-b431-4046-8290-c4813da2ee8a") : object "kube-system"/"original-pull-secret" not registered
Jul 24 19:26:44.329088 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.328900    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b352627c-bfb7-4f1b-8422-590916dc322b-host\") pod \"tuned-zmlbg\" (UID: \"b352627c-bfb7-4f1b-8422-590916dc322b\") " pod="openshift-cluster-node-tuning-operator/tuned-zmlbg"
Jul 24 19:26:44.329088 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.328924    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fa8789c9-6c39-46cd-a540-657dea710eb8-ovn-node-metrics-cert\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.329088 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.328949    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1a57aec4-d102-4483-a562-53ae8ed51e6e-host-run-k8s-cni-cncf-io\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.329088 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.328966    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b352627c-bfb7-4f1b-8422-590916dc322b-etc-modprobe-d\") pod \"tuned-zmlbg\" (UID: \"b352627c-bfb7-4f1b-8422-590916dc322b\") " pod="openshift-cluster-node-tuning-operator/tuned-zmlbg"
Jul 24 19:26:44.329088 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.328976    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1a57aec4-d102-4483-a562-53ae8ed51e6e-host-var-lib-cni-bin\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.329088 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.329019    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1a57aec4-d102-4483-a562-53ae8ed51e6e-host-var-lib-cni-bin\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.329821 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.329171    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/73db2676-b431-4046-8290-c4813da2ee8a-dbus\") pod \"global-pull-secret-syncer-gkd6m\" (UID: \"73db2676-b431-4046-8290-c4813da2ee8a\") " pod="kube-system/global-pull-secret-syncer-gkd6m"
Jul 24 19:26:44.329821 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.329474    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/77089fa0-e8af-4044-8ca5-acbbdd5bc2f7-iptables-alerter-script\") pod \"iptables-alerter-4xmjp\" (UID: \"77089fa0-e8af-4044-8ca5-acbbdd5bc2f7\") " pod="openshift-network-operator/iptables-alerter-4xmjp"
Jul 24 19:26:44.329821 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.329544    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1a57aec4-d102-4483-a562-53ae8ed51e6e-multus-daemon-config\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.329821 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.329588    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1a57aec4-d102-4483-a562-53ae8ed51e6e-hostroot\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.329821 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.329608    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1a57aec4-d102-4483-a562-53ae8ed51e6e-cni-binary-copy\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.329821 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.329620    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1a57aec4-d102-4483-a562-53ae8ed51e6e-host-run-multus-certs\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.329821 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.329646    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fa8789c9-6c39-46cd-a540-657dea710eb8-host-cni-bin\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.329821 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.329663    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b352627c-bfb7-4f1b-8422-590916dc322b-host\") pod \"tuned-zmlbg\" (UID: \"b352627c-bfb7-4f1b-8422-590916dc322b\") " pod="openshift-cluster-node-tuning-operator/tuned-zmlbg"
Jul 24 19:26:44.329821 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.329672    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1a57aec4-d102-4483-a562-53ae8ed51e6e-multus-socket-dir-parent\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.329821 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.329726    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1a57aec4-d102-4483-a562-53ae8ed51e6e-multus-socket-dir-parent\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.330315 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.329590    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77089fa0-e8af-4044-8ca5-acbbdd5bc2f7-host-slash\") pod \"iptables-alerter-4xmjp\" (UID: \"77089fa0-e8af-4044-8ca5-acbbdd5bc2f7\") " pod="openshift-network-operator/iptables-alerter-4xmjp"
Jul 24 19:26:44.330315 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.329914    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1a57aec4-d102-4483-a562-53ae8ed51e6e-hostroot\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.330315 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.329960    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1a57aec4-d102-4483-a562-53ae8ed51e6e-host-run-k8s-cni-cncf-io\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.330315 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.330004    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1a57aec4-d102-4483-a562-53ae8ed51e6e-host-run-multus-certs\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.330315 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.330016    2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 24 19:26:44.330315 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.330052    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fa8789c9-6c39-46cd-a540-657dea710eb8-host-cni-bin\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.330315 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.330109    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1a57aec4-d102-4483-a562-53ae8ed51e6e-host-run-netns\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.330315 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.330143    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aac7b50f-a1bd-40ba-9b16-f98984e5ed50-os-release\") pod \"multus-additional-cni-plugins-4zz8w\" (UID: \"aac7b50f-a1bd-40ba-9b16-f98984e5ed50\") " pod="openshift-multus/multus-additional-cni-plugins-4zz8w"
Jul 24 19:26:44.330315 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.330171    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dd30d02e-4ca3-4014-85f3-b809471d2ad8-hosts-file\") pod \"node-resolver-ctz4q\" (UID: \"dd30d02e-4ca3-4014-85f3-b809471d2ad8\") " pod="openshift-dns/node-resolver-ctz4q"
Jul 24 19:26:44.330315 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.330197    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c9faba17-c794-48f7-8416-b44094cd8946-agent-certs\") pod \"konnectivity-agent-v4nt7\" (UID: \"c9faba17-c794-48f7-8416-b44094cd8946\") " pod="kube-system/konnectivity-agent-v4nt7"
Jul 24 19:26:44.330315 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.330222    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c9faba17-c794-48f7-8416-b44094cd8946-konnectivity-ca\") pod \"konnectivity-agent-v4nt7\" (UID: \"c9faba17-c794-48f7-8416-b44094cd8946\") " pod="kube-system/konnectivity-agent-v4nt7"
Jul 24 19:26:44.330315 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.330253    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1a57aec4-d102-4483-a562-53ae8ed51e6e-host-run-netns\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.330315 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.330256    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f803e90d-0eb9-4061-873e-e0a5a6a3b19f-sys-fs\") pod \"aws-ebs-csi-driver-node-cmm2w\" (UID: \"f803e90d-0eb9-4061-873e-e0a5a6a3b19f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmm2w"
Jul 24 19:26:44.330315 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.330306    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hv4cw\" (UniqueName: \"kubernetes.io/projected/f803e90d-0eb9-4061-873e-e0a5a6a3b19f-kube-api-access-hv4cw\") pod \"aws-ebs-csi-driver-node-cmm2w\" (UID: \"f803e90d-0eb9-4061-873e-e0a5a6a3b19f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmm2w"
Jul 24 19:26:44.331024 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.330314    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f803e90d-0eb9-4061-873e-e0a5a6a3b19f-sys-fs\") pod \"aws-ebs-csi-driver-node-cmm2w\" (UID: \"f803e90d-0eb9-4061-873e-e0a5a6a3b19f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmm2w"
Jul 24 19:26:44.331024 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.330333    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/088489c0-3c4a-4b1d-8724-d9ca828ea309-metrics-certs\") pod \"network-metrics-daemon-slw87\" (UID: \"088489c0-3c4a-4b1d-8724-d9ca828ea309\") " pod="openshift-multus/network-metrics-daemon-slw87"
Jul 24 19:26:44.331024 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:44.330429    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:26:44.331024 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.330452    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b352627c-bfb7-4f1b-8422-590916dc322b-sys\") pod \"tuned-zmlbg\" (UID: \"b352627c-bfb7-4f1b-8422-590916dc322b\") " pod="openshift-cluster-node-tuning-operator/tuned-zmlbg"
Jul 24 19:26:44.331024 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.330586    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fa8789c9-6c39-46cd-a540-657dea710eb8-run-openvswitch\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.331024 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:44.330638    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/088489c0-3c4a-4b1d-8724-d9ca828ea309-metrics-certs podName:088489c0-3c4a-4b1d-8724-d9ca828ea309 nodeName:}" failed. No retries permitted until 2026-07-24 19:26:44.83060991 +0000 UTC m=+3.019684208 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/088489c0-3c4a-4b1d-8724-d9ca828ea309-metrics-certs") pod "network-metrics-daemon-slw87" (UID: "088489c0-3c4a-4b1d-8724-d9ca828ea309") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:26:44.331024 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.330646    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b352627c-bfb7-4f1b-8422-590916dc322b-sys\") pod \"tuned-zmlbg\" (UID: \"b352627c-bfb7-4f1b-8422-590916dc322b\") " pod="openshift-cluster-node-tuning-operator/tuned-zmlbg"
Jul 24 19:26:44.331024 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.330683    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a57aec4-d102-4483-a562-53ae8ed51e6e-system-cni-dir\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.331024 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.330686    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fa8789c9-6c39-46cd-a540-657dea710eb8-run-openvswitch\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.331024 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.330720    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f803e90d-0eb9-4061-873e-e0a5a6a3b19f-etc-selinux\") pod \"aws-ebs-csi-driver-node-cmm2w\" (UID: \"f803e90d-0eb9-4061-873e-e0a5a6a3b19f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmm2w"
Jul 24 19:26:44.331024 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.330783    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b352627c-bfb7-4f1b-8422-590916dc322b-etc-kubernetes\") pod \"tuned-zmlbg\" (UID: \"b352627c-bfb7-4f1b-8422-590916dc322b\") " pod="openshift-cluster-node-tuning-operator/tuned-zmlbg"
Jul 24 19:26:44.331024 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.330800    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a57aec4-d102-4483-a562-53ae8ed51e6e-system-cni-dir\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.331024 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.330826    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b352627c-bfb7-4f1b-8422-590916dc322b-etc-systemd\") pod \"tuned-zmlbg\" (UID: \"b352627c-bfb7-4f1b-8422-590916dc322b\") " pod="openshift-cluster-node-tuning-operator/tuned-zmlbg"
Jul 24 19:26:44.331024 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.330854    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b352627c-bfb7-4f1b-8422-590916dc322b-lib-modules\") pod \"tuned-zmlbg\" (UID: \"b352627c-bfb7-4f1b-8422-590916dc322b\") " pod="openshift-cluster-node-tuning-operator/tuned-zmlbg"
Jul 24 19:26:44.331024 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.330908    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f803e90d-0eb9-4061-873e-e0a5a6a3b19f-etc-selinux\") pod \"aws-ebs-csi-driver-node-cmm2w\" (UID: \"f803e90d-0eb9-4061-873e-e0a5a6a3b19f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmm2w"
Jul 24 19:26:44.331024 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.330908    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fa8789c9-6c39-46cd-a540-657dea710eb8-host-slash\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.331769 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.331039    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b352627c-bfb7-4f1b-8422-590916dc322b-lib-modules\") pod \"tuned-zmlbg\" (UID: \"b352627c-bfb7-4f1b-8422-590916dc322b\") " pod="openshift-cluster-node-tuning-operator/tuned-zmlbg"
Jul 24 19:26:44.331769 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.330952    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b352627c-bfb7-4f1b-8422-590916dc322b-etc-kubernetes\") pod \"tuned-zmlbg\" (UID: \"b352627c-bfb7-4f1b-8422-590916dc322b\") " pod="openshift-cluster-node-tuning-operator/tuned-zmlbg"
Jul 24 19:26:44.331769 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.331115    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fa8789c9-6c39-46cd-a540-657dea710eb8-var-lib-openvswitch\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.331769 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.331172    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aac7b50f-a1bd-40ba-9b16-f98984e5ed50-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4zz8w\" (UID: \"aac7b50f-a1bd-40ba-9b16-f98984e5ed50\") " pod="openshift-multus/multus-additional-cni-plugins-4zz8w"
Jul 24 19:26:44.331769 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.331202    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fa8789c9-6c39-46cd-a540-657dea710eb8-var-lib-openvswitch\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.331769 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.331211    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f803e90d-0eb9-4061-873e-e0a5a6a3b19f-socket-dir\") pod \"aws-ebs-csi-driver-node-cmm2w\" (UID: \"f803e90d-0eb9-4061-873e-e0a5a6a3b19f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmm2w"
Jul 24 19:26:44.331769 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.331177    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b352627c-bfb7-4f1b-8422-590916dc322b-etc-systemd\") pod \"tuned-zmlbg\" (UID: \"b352627c-bfb7-4f1b-8422-590916dc322b\") " pod="openshift-cluster-node-tuning-operator/tuned-zmlbg"
Jul 24 19:26:44.331769 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.331256    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fa8789c9-6c39-46cd-a540-657dea710eb8-host-run-netns\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.331769 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.331264    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fa8789c9-6c39-46cd-a540-657dea710eb8-host-slash\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.331769 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.331283    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa8789c9-6c39-46cd-a540-657dea710eb8-host-run-ovn-kubernetes\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.331769 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.331324    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fa8789c9-6c39-46cd-a540-657dea710eb8-host-run-netns\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.331769 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.331364    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa8789c9-6c39-46cd-a540-657dea710eb8-host-run-ovn-kubernetes\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.331769 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.331392    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f803e90d-0eb9-4061-873e-e0a5a6a3b19f-socket-dir\") pod \"aws-ebs-csi-driver-node-cmm2w\" (UID: \"f803e90d-0eb9-4061-873e-e0a5a6a3b19f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmm2w"
Jul 24 19:26:44.331769 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.331404    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fa8789c9-6c39-46cd-a540-657dea710eb8-etc-openvswitch\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.331769 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.331441    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fa8789c9-6c39-46cd-a540-657dea710eb8-etc-openvswitch\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.331769 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.331480    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fa8789c9-6c39-46cd-a540-657dea710eb8-ovnkube-config\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.331769 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.331546    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d2eb9885-1490-41e3-8e05-2a21ed230573-serviceca\") pod \"node-ca-d8zx6\" (UID: \"d2eb9885-1490-41e3-8e05-2a21ed230573\") " pod="openshift-image-registry/node-ca-d8zx6"
Jul 24 19:26:44.332627 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.331589    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b352627c-bfb7-4f1b-8422-590916dc322b-etc-sysctl-d\") pod \"tuned-zmlbg\" (UID: \"b352627c-bfb7-4f1b-8422-590916dc322b\") " pod="openshift-cluster-node-tuning-operator/tuned-zmlbg"
Jul 24 19:26:44.332627 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.331617    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fa8789c9-6c39-46cd-a540-657dea710eb8-systemd-units\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.332627 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.331675    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fa8789c9-6c39-46cd-a540-657dea710eb8-systemd-units\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.332627 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.331816    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b352627c-bfb7-4f1b-8422-590916dc322b-etc-sysctl-d\") pod \"tuned-zmlbg\" (UID: \"b352627c-bfb7-4f1b-8422-590916dc322b\") " pod="openshift-cluster-node-tuning-operator/tuned-zmlbg"
Jul 24 19:26:44.332627 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.331861    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fa8789c9-6c39-46cd-a540-657dea710eb8-node-log\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.332627 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.331911    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a57aec4-d102-4483-a562-53ae8ed51e6e-host-var-lib-kubelet\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.332627 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.331943    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aac7b50f-a1bd-40ba-9b16-f98984e5ed50-system-cni-dir\") pod \"multus-additional-cni-plugins-4zz8w\" (UID: \"aac7b50f-a1bd-40ba-9b16-f98984e5ed50\") " pod="openshift-multus/multus-additional-cni-plugins-4zz8w"
Jul 24 19:26:44.332627 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.331990    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aac7b50f-a1bd-40ba-9b16-f98984e5ed50-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4zz8w\" (UID: \"aac7b50f-a1bd-40ba-9b16-f98984e5ed50\") " pod="openshift-multus/multus-additional-cni-plugins-4zz8w"
Jul 24 19:26:44.332627 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.332018    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa8789c9-6c39-46cd-a540-657dea710eb8-host-kubelet\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.332627 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.332048    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmmqk\" (UniqueName: \"kubernetes.io/projected/d2eb9885-1490-41e3-8e05-2a21ed230573-kube-api-access-wmmqk\") pod \"node-ca-d8zx6\" (UID: \"d2eb9885-1490-41e3-8e05-2a21ed230573\") " pod="openshift-image-registry/node-ca-d8zx6"
Jul 24 19:26:44.332627 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.332074    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b352627c-bfb7-4f1b-8422-590916dc322b-etc-tuned\") pod \"tuned-zmlbg\" (UID: \"b352627c-bfb7-4f1b-8422-590916dc322b\") " pod="openshift-cluster-node-tuning-operator/tuned-zmlbg"
Jul 24 19:26:44.332627 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.332174    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a57aec4-d102-4483-a562-53ae8ed51e6e-multus-cni-dir\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.332627 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.332205    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f803e90d-0eb9-4061-873e-e0a5a6a3b19f-registration-dir\") pod \"aws-ebs-csi-driver-node-cmm2w\" (UID: \"f803e90d-0eb9-4061-873e-e0a5a6a3b19f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmm2w"
Jul 24 19:26:44.332627 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.332222    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fa8789c9-6c39-46cd-a540-657dea710eb8-ovnkube-config\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.332627 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.332234    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqgn8\" (UniqueName: \"kubernetes.io/projected/088489c0-3c4a-4b1d-8724-d9ca828ea309-kube-api-access-dqgn8\") pod \"network-metrics-daemon-slw87\" (UID: \"088489c0-3c4a-4b1d-8724-d9ca828ea309\") " pod="openshift-multus/network-metrics-daemon-slw87"
Jul 24 19:26:44.332627 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.332262    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b352627c-bfb7-4f1b-8422-590916dc322b-run\") pod \"tuned-zmlbg\" (UID: \"b352627c-bfb7-4f1b-8422-590916dc322b\") " pod="openshift-cluster-node-tuning-operator/tuned-zmlbg"
Jul 24 19:26:44.332627 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.332297    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqxm2\" (UniqueName: \"kubernetes.io/projected/b352627c-bfb7-4f1b-8422-590916dc322b-kube-api-access-zqxm2\") pod \"tuned-zmlbg\" (UID: \"b352627c-bfb7-4f1b-8422-590916dc322b\") " pod="openshift-cluster-node-tuning-operator/tuned-zmlbg"
Jul 24 19:26:44.333511 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.332324    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fa8789c9-6c39-46cd-a540-657dea710eb8-log-socket\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.333511 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.332402    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8xgz\" (UniqueName: \"kubernetes.io/projected/fa8789c9-6c39-46cd-a540-657dea710eb8-kube-api-access-z8xgz\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.333511 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.332431    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aac7b50f-a1bd-40ba-9b16-f98984e5ed50-cnibin\") pod \"multus-additional-cni-plugins-4zz8w\" (UID: \"aac7b50f-a1bd-40ba-9b16-f98984e5ed50\") " pod="openshift-multus/multus-additional-cni-plugins-4zz8w"
Jul 24 19:26:44.333511 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.332458    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aac7b50f-a1bd-40ba-9b16-f98984e5ed50-cni-binary-copy\") pod \"multus-additional-cni-plugins-4zz8w\" (UID: \"aac7b50f-a1bd-40ba-9b16-f98984e5ed50\") " pod="openshift-multus/multus-additional-cni-plugins-4zz8w"
Jul 24 19:26:44.333511 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.332491    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1a57aec4-d102-4483-a562-53ae8ed51e6e-os-release\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.333511 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.332517    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fa8789c9-6c39-46cd-a540-657dea710eb8-run-systemd\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.333511 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.332545    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fa8789c9-6c39-46cd-a540-657dea710eb8-ovnkube-script-lib\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.333511 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.332571    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1a57aec4-d102-4483-a562-53ae8ed51e6e-host-var-lib-cni-multus\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.333511 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.332597    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt2pl\" (UniqueName: \"kubernetes.io/projected/1a57aec4-d102-4483-a562-53ae8ed51e6e-kube-api-access-jt2pl\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.333511 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.332624    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aac7b50f-a1bd-40ba-9b16-f98984e5ed50-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4zz8w\" (UID: \"aac7b50f-a1bd-40ba-9b16-f98984e5ed50\") " pod="openshift-multus/multus-additional-cni-plugins-4zz8w"
Jul 24 19:26:44.333511 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.332651    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd30d02e-4ca3-4014-85f3-b809471d2ad8-tmp-dir\") pod \"node-resolver-ctz4q\" (UID: \"dd30d02e-4ca3-4014-85f3-b809471d2ad8\") " pod="openshift-dns/node-resolver-ctz4q"
Jul 24 19:26:44.333511 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.332680    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fa8789c9-6c39-46cd-a540-657dea710eb8-env-overrides\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.333511 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.332705    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1a57aec4-d102-4483-a562-53ae8ed51e6e-cnibin\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.333511 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.332884    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh44b\" (UniqueName: \"kubernetes.io/projected/dd30d02e-4ca3-4014-85f3-b809471d2ad8-kube-api-access-lh44b\") pod \"node-resolver-ctz4q\" (UID: \"dd30d02e-4ca3-4014-85f3-b809471d2ad8\") " pod="openshift-dns/node-resolver-ctz4q"
Jul 24 19:26:44.333511 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.332917    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f803e90d-0eb9-4061-873e-e0a5a6a3b19f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cmm2w\" (UID: \"f803e90d-0eb9-4061-873e-e0a5a6a3b19f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmm2w"
Jul 24 19:26:44.333511 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.332945    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fa8789c9-6c39-46cd-a540-657dea710eb8-host-cni-netd\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.333511 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.332974    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/73db2676-b431-4046-8290-c4813da2ee8a-kubelet-config\") pod \"global-pull-secret-syncer-gkd6m\" (UID: \"73db2676-b431-4046-8290-c4813da2ee8a\") " pod="kube-system/global-pull-secret-syncer-gkd6m"
Jul 24 19:26:44.334546 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.333004    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpvvm\" (UniqueName: \"kubernetes.io/projected/aac7b50f-a1bd-40ba-9b16-f98984e5ed50-kube-api-access-kpvvm\") pod \"multus-additional-cni-plugins-4zz8w\" (UID: \"aac7b50f-a1bd-40ba-9b16-f98984e5ed50\") " pod="openshift-multus/multus-additional-cni-plugins-4zz8w"
Jul 24 19:26:44.334546 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.333036    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b352627c-bfb7-4f1b-8422-590916dc322b-etc-sysconfig\") pod \"tuned-zmlbg\" (UID: \"b352627c-bfb7-4f1b-8422-590916dc322b\") " pod="openshift-cluster-node-tuning-operator/tuned-zmlbg"
Jul 24 19:26:44.334546 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.333065    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b352627c-bfb7-4f1b-8422-590916dc322b-etc-sysctl-conf\") pod \"tuned-zmlbg\" (UID: \"b352627c-bfb7-4f1b-8422-590916dc322b\") " pod="openshift-cluster-node-tuning-operator/tuned-zmlbg"
Jul 24 19:26:44.334546 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.333107    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fa8789c9-6c39-46cd-a540-657dea710eb8-node-log\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.334546 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.333125    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b352627c-bfb7-4f1b-8422-590916dc322b-var-lib-kubelet\") pod \"tuned-zmlbg\" (UID: \"b352627c-bfb7-4f1b-8422-590916dc322b\") " pod="openshift-cluster-node-tuning-operator/tuned-zmlbg"
Jul 24 19:26:44.334546 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.333152    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b352627c-bfb7-4f1b-8422-590916dc322b-tmp\") pod \"tuned-zmlbg\" (UID: \"b352627c-bfb7-4f1b-8422-590916dc322b\") " pod="openshift-cluster-node-tuning-operator/tuned-zmlbg"
Jul 24 19:26:44.334546 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.333156    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a57aec4-d102-4483-a562-53ae8ed51e6e-host-var-lib-kubelet\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.334546 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.333182    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f803e90d-0eb9-4061-873e-e0a5a6a3b19f-device-dir\") pod \"aws-ebs-csi-driver-node-cmm2w\" (UID: \"f803e90d-0eb9-4061-873e-e0a5a6a3b19f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmm2w"
Jul 24 19:26:44.334546 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.333210    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fa8789c9-6c39-46cd-a540-657dea710eb8-run-ovn\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.334546 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.333240    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa8789c9-6c39-46cd-a540-657dea710eb8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.334546 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.333334    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa8789c9-6c39-46cd-a540-657dea710eb8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.334546 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.333374    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1a57aec4-d102-4483-a562-53ae8ed51e6e-host-var-lib-cni-multus\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.334546 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.333837    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fa8789c9-6c39-46cd-a540-657dea710eb8-ovnkube-script-lib\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.334546 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.334023    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fa8789c9-6c39-46cd-a540-657dea710eb8-env-overrides\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.334546 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.334097    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1a57aec4-d102-4483-a562-53ae8ed51e6e-cnibin\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.334546 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.334134    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fa8789c9-6c39-46cd-a540-657dea710eb8-log-socket\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.334546 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.334176    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa8789c9-6c39-46cd-a540-657dea710eb8-host-kubelet\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.335511 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.334196    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fa8789c9-6c39-46cd-a540-657dea710eb8-run-systemd\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.335511 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.334221    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b352627c-bfb7-4f1b-8422-590916dc322b-etc-sysconfig\") pod \"tuned-zmlbg\" (UID: \"b352627c-bfb7-4f1b-8422-590916dc322b\") " pod="openshift-cluster-node-tuning-operator/tuned-zmlbg"
Jul 24 19:26:44.335511 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.334263    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a57aec4-d102-4483-a562-53ae8ed51e6e-multus-cni-dir\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.335511 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.334269    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f803e90d-0eb9-4061-873e-e0a5a6a3b19f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cmm2w\" (UID: \"f803e90d-0eb9-4061-873e-e0a5a6a3b19f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmm2w"
Jul 24 19:26:44.335511 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.334309    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fa8789c9-6c39-46cd-a540-657dea710eb8-host-cni-netd\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.335511 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.334315    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f803e90d-0eb9-4061-873e-e0a5a6a3b19f-registration-dir\") pod \"aws-ebs-csi-driver-node-cmm2w\" (UID: \"f803e90d-0eb9-4061-873e-e0a5a6a3b19f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmm2w"
Jul 24 19:26:44.335511 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.334349    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/73db2676-b431-4046-8290-c4813da2ee8a-kubelet-config\") pod \"global-pull-secret-syncer-gkd6m\" (UID: \"73db2676-b431-4046-8290-c4813da2ee8a\") " pod="kube-system/global-pull-secret-syncer-gkd6m"
Jul 24 19:26:44.335511 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.334575    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b352627c-bfb7-4f1b-8422-590916dc322b-run\") pod \"tuned-zmlbg\" (UID: \"b352627c-bfb7-4f1b-8422-590916dc322b\") " pod="openshift-cluster-node-tuning-operator/tuned-zmlbg"
Jul 24 19:26:44.335511 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.335021    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1a57aec4-d102-4483-a562-53ae8ed51e6e-os-release\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.335511 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.335376    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b352627c-bfb7-4f1b-8422-590916dc322b-var-lib-kubelet\") pod \"tuned-zmlbg\" (UID: \"b352627c-bfb7-4f1b-8422-590916dc322b\") " pod="openshift-cluster-node-tuning-operator/tuned-zmlbg"
Jul 24 19:26:44.335511 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.335500    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b352627c-bfb7-4f1b-8422-590916dc322b-etc-sysctl-conf\") pod \"tuned-zmlbg\" (UID: \"b352627c-bfb7-4f1b-8422-590916dc322b\") " pod="openshift-cluster-node-tuning-operator/tuned-zmlbg"
Jul 24 19:26:44.336258 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.335552    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f803e90d-0eb9-4061-873e-e0a5a6a3b19f-device-dir\") pod \"aws-ebs-csi-driver-node-cmm2w\" (UID: \"f803e90d-0eb9-4061-873e-e0a5a6a3b19f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmm2w"
Jul 24 19:26:44.336258 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.335590    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fa8789c9-6c39-46cd-a540-657dea710eb8-run-ovn\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.337060 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.337035    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fa8789c9-6c39-46cd-a540-657dea710eb8-ovn-node-metrics-cert\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.337378 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.337346    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b352627c-bfb7-4f1b-8422-590916dc322b-etc-tuned\") pod \"tuned-zmlbg\" (UID: \"b352627c-bfb7-4f1b-8422-590916dc322b\") " pod="openshift-cluster-node-tuning-operator/tuned-zmlbg"
Jul 24 19:26:44.338343 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.338305    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b352627c-bfb7-4f1b-8422-590916dc322b-tmp\") pod \"tuned-zmlbg\" (UID: \"b352627c-bfb7-4f1b-8422-590916dc322b\") " pod="openshift-cluster-node-tuning-operator/tuned-zmlbg"
Jul 24 19:26:44.367797 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.367729    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal" event={"ID":"3d8b400053bfa9f9c637aaf70e5d75ea","Type":"ContainerStarted","Data":"59f5e74b21920340af312ee0d00277af910c1bb244f04f8f67d92e15e7219b4b"}
Jul 24 19:26:44.369495 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.369466    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-150.ec2.internal" event={"ID":"1188e37e92b4900d2886b98231ddef72","Type":"ContainerStarted","Data":"caadf4aca0a21d2c5ea46886fdd2688d18f3cc01a5ab225e31a240b88e6cf122"}
Jul 24 19:26:44.370527 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.370509    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-l22f6"
Jul 24 19:26:44.373753 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.373684    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqgn8\" (UniqueName: \"kubernetes.io/projected/088489c0-3c4a-4b1d-8724-d9ca828ea309-kube-api-access-dqgn8\") pod \"network-metrics-daemon-slw87\" (UID: \"088489c0-3c4a-4b1d-8724-d9ca828ea309\") " pod="openshift-multus/network-metrics-daemon-slw87"
Jul 24 19:26:44.376261 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.376124    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt2pl\" (UniqueName: \"kubernetes.io/projected/1a57aec4-d102-4483-a562-53ae8ed51e6e-kube-api-access-jt2pl\") pod \"multus-7s5nj\" (UID: \"1a57aec4-d102-4483-a562-53ae8ed51e6e\") " pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.376678 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.376651    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqxm2\" (UniqueName: \"kubernetes.io/projected/b352627c-bfb7-4f1b-8422-590916dc322b-kube-api-access-zqxm2\") pod \"tuned-zmlbg\" (UID: \"b352627c-bfb7-4f1b-8422-590916dc322b\") " pod="openshift-cluster-node-tuning-operator/tuned-zmlbg"
Jul 24 19:26:44.377304 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.377282    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjq5p\" (UniqueName: \"kubernetes.io/projected/77089fa0-e8af-4044-8ca5-acbbdd5bc2f7-kube-api-access-vjq5p\") pod \"iptables-alerter-4xmjp\" (UID: \"77089fa0-e8af-4044-8ca5-acbbdd5bc2f7\") " pod="openshift-network-operator/iptables-alerter-4xmjp"
Jul 24 19:26:44.379236 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.379179    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv4cw\" (UniqueName: \"kubernetes.io/projected/f803e90d-0eb9-4061-873e-e0a5a6a3b19f-kube-api-access-hv4cw\") pod \"aws-ebs-csi-driver-node-cmm2w\" (UID: \"f803e90d-0eb9-4061-873e-e0a5a6a3b19f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmm2w"
Jul 24 19:26:44.386873 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.386845    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8xgz\" (UniqueName: \"kubernetes.io/projected/fa8789c9-6c39-46cd-a540-657dea710eb8-kube-api-access-z8xgz\") pod \"ovnkube-node-vclnd\" (UID: \"fa8789c9-6c39-46cd-a540-657dea710eb8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.434371 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.434332    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpvvm\" (UniqueName: \"kubernetes.io/projected/aac7b50f-a1bd-40ba-9b16-f98984e5ed50-kube-api-access-kpvvm\") pod \"multus-additional-cni-plugins-4zz8w\" (UID: \"aac7b50f-a1bd-40ba-9b16-f98984e5ed50\") " pod="openshift-multus/multus-additional-cni-plugins-4zz8w"
Jul 24 19:26:44.434569 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.434442    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsvb4\" (UniqueName: \"kubernetes.io/projected/8417d154-2680-412f-b5dc-c9980030f61b-kube-api-access-lsvb4\") pod \"network-check-target-v4htc\" (UID: \"8417d154-2680-412f-b5dc-c9980030f61b\") " pod="openshift-network-diagnostics/network-check-target-v4htc"
Jul 24 19:26:44.434569 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.434467    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d2eb9885-1490-41e3-8e05-2a21ed230573-host\") pod \"node-ca-d8zx6\" (UID: \"d2eb9885-1490-41e3-8e05-2a21ed230573\") " pod="openshift-image-registry/node-ca-d8zx6"
Jul 24 19:26:44.434569 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.434505    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aac7b50f-a1bd-40ba-9b16-f98984e5ed50-os-release\") pod \"multus-additional-cni-plugins-4zz8w\" (UID: \"aac7b50f-a1bd-40ba-9b16-f98984e5ed50\") " pod="openshift-multus/multus-additional-cni-plugins-4zz8w"
Jul 24 19:26:44.434569 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.434530    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dd30d02e-4ca3-4014-85f3-b809471d2ad8-hosts-file\") pod \"node-resolver-ctz4q\" (UID: \"dd30d02e-4ca3-4014-85f3-b809471d2ad8\") " pod="openshift-dns/node-resolver-ctz4q"
Jul 24 19:26:44.434569 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.434553    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c9faba17-c794-48f7-8416-b44094cd8946-agent-certs\") pod \"konnectivity-agent-v4nt7\" (UID: \"c9faba17-c794-48f7-8416-b44094cd8946\") " pod="kube-system/konnectivity-agent-v4nt7"
Jul 24 19:26:44.434870 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.434578    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c9faba17-c794-48f7-8416-b44094cd8946-konnectivity-ca\") pod \"konnectivity-agent-v4nt7\" (UID: \"c9faba17-c794-48f7-8416-b44094cd8946\") " pod="kube-system/konnectivity-agent-v4nt7"
Jul 24 19:26:44.434870 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.434583    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d2eb9885-1490-41e3-8e05-2a21ed230573-host\") pod \"node-ca-d8zx6\" (UID: \"d2eb9885-1490-41e3-8e05-2a21ed230573\") " pod="openshift-image-registry/node-ca-d8zx6"
Jul 24 19:26:44.434870 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.434655    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aac7b50f-a1bd-40ba-9b16-f98984e5ed50-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4zz8w\" (UID: \"aac7b50f-a1bd-40ba-9b16-f98984e5ed50\") " pod="openshift-multus/multus-additional-cni-plugins-4zz8w"
Jul 24 19:26:44.434870 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.434691    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dd30d02e-4ca3-4014-85f3-b809471d2ad8-hosts-file\") pod \"node-resolver-ctz4q\" (UID: \"dd30d02e-4ca3-4014-85f3-b809471d2ad8\") " pod="openshift-dns/node-resolver-ctz4q"
Jul 24 19:26:44.434870 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.434707    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d2eb9885-1490-41e3-8e05-2a21ed230573-serviceca\") pod \"node-ca-d8zx6\" (UID: \"d2eb9885-1490-41e3-8e05-2a21ed230573\") " pod="openshift-image-registry/node-ca-d8zx6"
Jul 24 19:26:44.434870 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.434764    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aac7b50f-a1bd-40ba-9b16-f98984e5ed50-system-cni-dir\") pod \"multus-additional-cni-plugins-4zz8w\" (UID: \"aac7b50f-a1bd-40ba-9b16-f98984e5ed50\") " pod="openshift-multus/multus-additional-cni-plugins-4zz8w"
Jul 24 19:26:44.434870 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.434778    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aac7b50f-a1bd-40ba-9b16-f98984e5ed50-os-release\") pod \"multus-additional-cni-plugins-4zz8w\" (UID: \"aac7b50f-a1bd-40ba-9b16-f98984e5ed50\") " pod="openshift-multus/multus-additional-cni-plugins-4zz8w"
Jul 24 19:26:44.434870 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.434795    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aac7b50f-a1bd-40ba-9b16-f98984e5ed50-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4zz8w\" (UID: \"aac7b50f-a1bd-40ba-9b16-f98984e5ed50\") " pod="openshift-multus/multus-additional-cni-plugins-4zz8w"
Jul 24 19:26:44.434870 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.434830    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmmqk\" (UniqueName: \"kubernetes.io/projected/d2eb9885-1490-41e3-8e05-2a21ed230573-kube-api-access-wmmqk\") pod \"node-ca-d8zx6\" (UID: \"d2eb9885-1490-41e3-8e05-2a21ed230573\") " pod="openshift-image-registry/node-ca-d8zx6"
Jul 24 19:26:44.434870 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.434863    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aac7b50f-a1bd-40ba-9b16-f98984e5ed50-cnibin\") pod \"multus-additional-cni-plugins-4zz8w\" (UID: \"aac7b50f-a1bd-40ba-9b16-f98984e5ed50\") " pod="openshift-multus/multus-additional-cni-plugins-4zz8w"
Jul 24 19:26:44.435437 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.434888    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aac7b50f-a1bd-40ba-9b16-f98984e5ed50-cni-binary-copy\") pod \"multus-additional-cni-plugins-4zz8w\" (UID: \"aac7b50f-a1bd-40ba-9b16-f98984e5ed50\") " pod="openshift-multus/multus-additional-cni-plugins-4zz8w"
Jul 24 19:26:44.435437 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.434918    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aac7b50f-a1bd-40ba-9b16-f98984e5ed50-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4zz8w\" (UID: \"aac7b50f-a1bd-40ba-9b16-f98984e5ed50\") " pod="openshift-multus/multus-additional-cni-plugins-4zz8w"
Jul 24 19:26:44.435437 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.434941    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd30d02e-4ca3-4014-85f3-b809471d2ad8-tmp-dir\") pod \"node-resolver-ctz4q\" (UID: \"dd30d02e-4ca3-4014-85f3-b809471d2ad8\") " pod="openshift-dns/node-resolver-ctz4q"
Jul 24 19:26:44.435437 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.434967    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lh44b\" (UniqueName: \"kubernetes.io/projected/dd30d02e-4ca3-4014-85f3-b809471d2ad8-kube-api-access-lh44b\") pod \"node-resolver-ctz4q\" (UID: \"dd30d02e-4ca3-4014-85f3-b809471d2ad8\") " pod="openshift-dns/node-resolver-ctz4q"
Jul 24 19:26:44.435437 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.435182    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aac7b50f-a1bd-40ba-9b16-f98984e5ed50-cnibin\") pod \"multus-additional-cni-plugins-4zz8w\" (UID: \"aac7b50f-a1bd-40ba-9b16-f98984e5ed50\") " pod="openshift-multus/multus-additional-cni-plugins-4zz8w"
Jul 24 19:26:44.435437 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.435250    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aac7b50f-a1bd-40ba-9b16-f98984e5ed50-system-cni-dir\") pod \"multus-additional-cni-plugins-4zz8w\" (UID: \"aac7b50f-a1bd-40ba-9b16-f98984e5ed50\") " pod="openshift-multus/multus-additional-cni-plugins-4zz8w"
Jul 24 19:26:44.435437 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.435276    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c9faba17-c794-48f7-8416-b44094cd8946-konnectivity-ca\") pod \"konnectivity-agent-v4nt7\" (UID: \"c9faba17-c794-48f7-8416-b44094cd8946\") " pod="kube-system/konnectivity-agent-v4nt7"
Jul 24 19:26:44.435437 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.435429    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aac7b50f-a1bd-40ba-9b16-f98984e5ed50-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4zz8w\" (UID: \"aac7b50f-a1bd-40ba-9b16-f98984e5ed50\") " pod="openshift-multus/multus-additional-cni-plugins-4zz8w"
Jul 24 19:26:44.435918 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.435894    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aac7b50f-a1bd-40ba-9b16-f98984e5ed50-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4zz8w\" (UID: \"aac7b50f-a1bd-40ba-9b16-f98984e5ed50\") " pod="openshift-multus/multus-additional-cni-plugins-4zz8w"
Jul 24 19:26:44.435976 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.435918    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d2eb9885-1490-41e3-8e05-2a21ed230573-serviceca\") pod \"node-ca-d8zx6\" (UID: \"d2eb9885-1490-41e3-8e05-2a21ed230573\") " pod="openshift-image-registry/node-ca-d8zx6"
Jul 24 19:26:44.436420 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.436235    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd30d02e-4ca3-4014-85f3-b809471d2ad8-tmp-dir\") pod \"node-resolver-ctz4q\" (UID: \"dd30d02e-4ca3-4014-85f3-b809471d2ad8\") " pod="openshift-dns/node-resolver-ctz4q"
Jul 24 19:26:44.436420 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.436369    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aac7b50f-a1bd-40ba-9b16-f98984e5ed50-cni-binary-copy\") pod \"multus-additional-cni-plugins-4zz8w\" (UID: \"aac7b50f-a1bd-40ba-9b16-f98984e5ed50\") " pod="openshift-multus/multus-additional-cni-plugins-4zz8w"
Jul 24 19:26:44.436782 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.436741    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aac7b50f-a1bd-40ba-9b16-f98984e5ed50-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4zz8w\" (UID: \"aac7b50f-a1bd-40ba-9b16-f98984e5ed50\") " pod="openshift-multus/multus-additional-cni-plugins-4zz8w"
Jul 24 19:26:44.437910 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.437889    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c9faba17-c794-48f7-8416-b44094cd8946-agent-certs\") pod \"konnectivity-agent-v4nt7\" (UID: \"c9faba17-c794-48f7-8416-b44094cd8946\") " pod="kube-system/konnectivity-agent-v4nt7"
Jul 24 19:26:44.474622 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.474588    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh44b\" (UniqueName: \"kubernetes.io/projected/dd30d02e-4ca3-4014-85f3-b809471d2ad8-kube-api-access-lh44b\") pod \"node-resolver-ctz4q\" (UID: \"dd30d02e-4ca3-4014-85f3-b809471d2ad8\") " pod="openshift-dns/node-resolver-ctz4q"
Jul 24 19:26:44.487059 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:44.486188    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 19:26:44.487059 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:44.486222    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 19:26:44.487059 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:44.486235    2579 projected.go:196] Error preparing data for projected volume kube-api-access-lsvb4 for pod openshift-network-diagnostics/network-check-target-v4htc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:26:44.487059 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:44.486303    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8417d154-2680-412f-b5dc-c9980030f61b-kube-api-access-lsvb4 podName:8417d154-2680-412f-b5dc-c9980030f61b nodeName:}" failed. No retries permitted until 2026-07-24 19:26:44.986285833 +0000 UTC m=+3.175360127 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lsvb4" (UniqueName: "kubernetes.io/projected/8417d154-2680-412f-b5dc-c9980030f61b-kube-api-access-lsvb4") pod "network-check-target-v4htc" (UID: "8417d154-2680-412f-b5dc-c9980030f61b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:26:44.490005 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.489963    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmmqk\" (UniqueName: \"kubernetes.io/projected/d2eb9885-1490-41e3-8e05-2a21ed230573-kube-api-access-wmmqk\") pod \"node-ca-d8zx6\" (UID: \"d2eb9885-1490-41e3-8e05-2a21ed230573\") " pod="openshift-image-registry/node-ca-d8zx6"
Jul 24 19:26:44.493619 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.493588    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpvvm\" (UniqueName: \"kubernetes.io/projected/aac7b50f-a1bd-40ba-9b16-f98984e5ed50-kube-api-access-kpvvm\") pod \"multus-additional-cni-plugins-4zz8w\" (UID: \"aac7b50f-a1bd-40ba-9b16-f98984e5ed50\") " pod="openshift-multus/multus-additional-cni-plugins-4zz8w"
Jul 24 19:26:44.517256 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.517215    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmm2w"
Jul 24 19:26:44.527503 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.527471    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:26:44.546563 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.546537    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7s5nj"
Jul 24 19:26:44.554528 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.554508    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4xmjp"
Jul 24 19:26:44.564303 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.564282    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zmlbg"
Jul 24 19:26:44.577530 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.577507    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4zz8w"
Jul 24 19:26:44.584479 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.584459    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v4nt7"
Jul 24 19:26:44.594358 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.594334    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d8zx6"
Jul 24 19:26:44.602390 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.602366    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ctz4q"
Jul 24 19:26:44.838581 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.838548    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/088489c0-3c4a-4b1d-8724-d9ca828ea309-metrics-certs\") pod \"network-metrics-daemon-slw87\" (UID: \"088489c0-3c4a-4b1d-8724-d9ca828ea309\") " pod="openshift-multus/network-metrics-daemon-slw87"
Jul 24 19:26:44.838815 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:44.838626    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/73db2676-b431-4046-8290-c4813da2ee8a-original-pull-secret\") pod \"global-pull-secret-syncer-gkd6m\" (UID: \"73db2676-b431-4046-8290-c4813da2ee8a\") " pod="kube-system/global-pull-secret-syncer-gkd6m"
Jul 24 19:26:44.838815 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:44.838764    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 19:26:44.838815 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:44.838777    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:26:44.838983 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:44.838864    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/088489c0-3c4a-4b1d-8724-d9ca828ea309-metrics-certs podName:088489c0-3c4a-4b1d-8724-d9ca828ea309 nodeName:}" failed. No retries permitted until 2026-07-24 19:26:45.83884287 +0000 UTC m=+4.027917178 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/088489c0-3c4a-4b1d-8724-d9ca828ea309-metrics-certs") pod "network-metrics-daemon-slw87" (UID: "088489c0-3c4a-4b1d-8724-d9ca828ea309") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:26:44.838983 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:44.838926    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73db2676-b431-4046-8290-c4813da2ee8a-original-pull-secret podName:73db2676-b431-4046-8290-c4813da2ee8a nodeName:}" failed. No retries permitted until 2026-07-24 19:26:45.838906532 +0000 UTC m=+4.027980831 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/73db2676-b431-4046-8290-c4813da2ee8a-original-pull-secret") pod "global-pull-secret-syncer-gkd6m" (UID: "73db2676-b431-4046-8290-c4813da2ee8a") : object "kube-system"/"original-pull-secret" not registered
Jul 24 19:26:45.040331 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:45.040289    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsvb4\" (UniqueName: \"kubernetes.io/projected/8417d154-2680-412f-b5dc-c9980030f61b-kube-api-access-lsvb4\") pod \"network-check-target-v4htc\" (UID: \"8417d154-2680-412f-b5dc-c9980030f61b\") " pod="openshift-network-diagnostics/network-check-target-v4htc"
Jul 24 19:26:45.040526 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:45.040500    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 19:26:45.040574 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:45.040535    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 19:26:45.040574 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:45.040551    2579 projected.go:196] Error preparing data for projected volume kube-api-access-lsvb4 for pod openshift-network-diagnostics/network-check-target-v4htc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:26:45.040651 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:45.040622    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8417d154-2680-412f-b5dc-c9980030f61b-kube-api-access-lsvb4 podName:8417d154-2680-412f-b5dc-c9980030f61b nodeName:}" failed. No retries permitted until 2026-07-24 19:26:46.040601981 +0000 UTC m=+4.229676299 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lsvb4" (UniqueName: "kubernetes.io/projected/8417d154-2680-412f-b5dc-c9980030f61b-kube-api-access-lsvb4") pod "network-check-target-v4htc" (UID: "8417d154-2680-412f-b5dc-c9980030f61b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:26:45.362019 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:45.361983    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4htc"
Jul 24 19:26:45.362527 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:45.362118    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4htc" podUID="8417d154-2680-412f-b5dc-c9980030f61b"
Jul 24 19:26:45.374059 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:45.374026    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 19:21:44 +0000 UTC" deadline="2028-04-22 00:30:17.014997614 +0000 UTC"
Jul 24 19:26:45.374059 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:45.374056    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15293h3m31.640945832s"
Jul 24 19:26:45.521419 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:45.521131    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb352627c_bfb7_4f1b_8422_590916dc322b.slice/crio-a07e8677f964903196f2b837dfc17325818463c5b4ba1cee8d782f70c59e59d1 WatchSource:0}: Error finding container a07e8677f964903196f2b837dfc17325818463c5b4ba1cee8d782f70c59e59d1: Status 404 returned error can't find the container with id a07e8677f964903196f2b837dfc17325818463c5b4ba1cee8d782f70c59e59d1
Jul 24 19:26:45.523220 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:45.523059    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaac7b50f_a1bd_40ba_9b16_f98984e5ed50.slice/crio-30ec2ea4c1eed2cd0fd9409eb09ea30a8b764313a925cff7d5919c6afb336bed WatchSource:0}: Error finding container 30ec2ea4c1eed2cd0fd9409eb09ea30a8b764313a925cff7d5919c6afb336bed: Status 404 returned error can't find the container with id 30ec2ea4c1eed2cd0fd9409eb09ea30a8b764313a925cff7d5919c6afb336bed
Jul 24 19:26:45.525309 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:45.525278    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa8789c9_6c39_46cd_a540_657dea710eb8.slice/crio-c8897b1ea09ff8c3dfe867169bfa5ab5d4be277634035d66c4fe63713575d666 WatchSource:0}: Error finding container c8897b1ea09ff8c3dfe867169bfa5ab5d4be277634035d66c4fe63713575d666: Status 404 returned error can't find the container with id c8897b1ea09ff8c3dfe867169bfa5ab5d4be277634035d66c4fe63713575d666
Jul 24 19:26:45.528845 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:45.528141    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77089fa0_e8af_4044_8ca5_acbbdd5bc2f7.slice/crio-ca355dcb0a88f4dd54095d13020a29f5c9fe9d153f4c9de3d7608ec007d21175 WatchSource:0}: Error finding container ca355dcb0a88f4dd54095d13020a29f5c9fe9d153f4c9de3d7608ec007d21175: Status 404 returned error can't find the container with id ca355dcb0a88f4dd54095d13020a29f5c9fe9d153f4c9de3d7608ec007d21175
Jul 24 19:26:45.531507 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:45.531460    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf803e90d_0eb9_4061_873e_e0a5a6a3b19f.slice/crio-8363da0a7d52cc4e15c301068a5265a7d298f032a1e6d019bb2de180ff3465ab WatchSource:0}: Error finding container 8363da0a7d52cc4e15c301068a5265a7d298f032a1e6d019bb2de180ff3465ab: Status 404 returned error can't find the container with id 8363da0a7d52cc4e15c301068a5265a7d298f032a1e6d019bb2de180ff3465ab
Jul 24 19:26:45.534643 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:26:45.534514    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9faba17_c794_48f7_8416_b44094cd8946.slice/crio-1c3a1e9c0e07df9aeca0cc670d9c5f2aa078b8ccfe37fcba42954da76c303410 WatchSource:0}: Error finding container 1c3a1e9c0e07df9aeca0cc670d9c5f2aa078b8ccfe37fcba42954da76c303410: Status 404 returned error can't find the container with id 1c3a1e9c0e07df9aeca0cc670d9c5f2aa078b8ccfe37fcba42954da76c303410
Jul 24 19:26:45.847289 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:45.847076    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/73db2676-b431-4046-8290-c4813da2ee8a-original-pull-secret\") pod \"global-pull-secret-syncer-gkd6m\" (UID: \"73db2676-b431-4046-8290-c4813da2ee8a\") " pod="kube-system/global-pull-secret-syncer-gkd6m"
Jul 24 19:26:45.847476 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:45.847331    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/088489c0-3c4a-4b1d-8724-d9ca828ea309-metrics-certs\") pod \"network-metrics-daemon-slw87\" (UID: \"088489c0-3c4a-4b1d-8724-d9ca828ea309\") " pod="openshift-multus/network-metrics-daemon-slw87"
Jul 24 19:26:45.847476 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:45.847238    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 19:26:45.847476 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:45.847419    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73db2676-b431-4046-8290-c4813da2ee8a-original-pull-secret podName:73db2676-b431-4046-8290-c4813da2ee8a nodeName:}" failed. No retries permitted until 2026-07-24 19:26:47.847398693 +0000 UTC m=+6.036472986 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/73db2676-b431-4046-8290-c4813da2ee8a-original-pull-secret") pod "global-pull-secret-syncer-gkd6m" (UID: "73db2676-b431-4046-8290-c4813da2ee8a") : object "kube-system"/"original-pull-secret" not registered
Jul 24 19:26:45.847476 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:45.847474    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:26:45.847656 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:45.847541    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/088489c0-3c4a-4b1d-8724-d9ca828ea309-metrics-certs podName:088489c0-3c4a-4b1d-8724-d9ca828ea309 nodeName:}" failed. No retries permitted until 2026-07-24 19:26:47.847521358 +0000 UTC m=+6.036595653 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/088489c0-3c4a-4b1d-8724-d9ca828ea309-metrics-certs") pod "network-metrics-daemon-slw87" (UID: "088489c0-3c4a-4b1d-8724-d9ca828ea309") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:26:46.050063 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:46.049966    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsvb4\" (UniqueName: \"kubernetes.io/projected/8417d154-2680-412f-b5dc-c9980030f61b-kube-api-access-lsvb4\") pod \"network-check-target-v4htc\" (UID: \"8417d154-2680-412f-b5dc-c9980030f61b\") " pod="openshift-network-diagnostics/network-check-target-v4htc"
Jul 24 19:26:46.050245 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:46.050155    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 19:26:46.050245 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:46.050179    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 19:26:46.050245 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:46.050194    2579 projected.go:196] Error preparing data for projected volume kube-api-access-lsvb4 for pod openshift-network-diagnostics/network-check-target-v4htc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:26:46.050399 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:46.050255    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8417d154-2680-412f-b5dc-c9980030f61b-kube-api-access-lsvb4 podName:8417d154-2680-412f-b5dc-c9980030f61b nodeName:}" failed. No retries permitted until 2026-07-24 19:26:48.050235514 +0000 UTC m=+6.239309806 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lsvb4" (UniqueName: "kubernetes.io/projected/8417d154-2680-412f-b5dc-c9980030f61b-kube-api-access-lsvb4") pod "network-check-target-v4htc" (UID: "8417d154-2680-412f-b5dc-c9980030f61b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:26:46.283850 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:46.283491    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 19:26:46.363094 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:46.362937    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slw87"
Jul 24 19:26:46.363503 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:46.363094    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slw87" podUID="088489c0-3c4a-4b1d-8724-d9ca828ea309"
Jul 24 19:26:46.363503 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:46.363465    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gkd6m"
Jul 24 19:26:46.363594 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:46.363571    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gkd6m" podUID="73db2676-b431-4046-8290-c4813da2ee8a"
Jul 24 19:26:46.374868 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:46.374791    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 19:21:44 +0000 UTC" deadline="2028-03-19 18:38:17.071647386 +0000 UTC"
Jul 24 19:26:46.374868 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:46.374844    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14495h11m30.696807315s"
Jul 24 19:26:46.386519 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:46.386431    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v4nt7" event={"ID":"c9faba17-c794-48f7-8416-b44094cd8946","Type":"ContainerStarted","Data":"1c3a1e9c0e07df9aeca0cc670d9c5f2aa078b8ccfe37fcba42954da76c303410"}
Jul 24 19:26:46.392758 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:46.392714    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d8zx6" event={"ID":"d2eb9885-1490-41e3-8e05-2a21ed230573","Type":"ContainerStarted","Data":"510d216d698ef46e270f56ad389dbf5c9cfc78fe679ff937b088a692123a2a29"}
Jul 24 19:26:46.403452 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:46.403413    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vclnd" event={"ID":"fa8789c9-6c39-46cd-a540-657dea710eb8","Type":"ContainerStarted","Data":"c8897b1ea09ff8c3dfe867169bfa5ab5d4be277634035d66c4fe63713575d666"}
Jul 24 19:26:46.409787 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:46.409702    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4zz8w" event={"ID":"aac7b50f-a1bd-40ba-9b16-f98984e5ed50","Type":"ContainerStarted","Data":"30ec2ea4c1eed2cd0fd9409eb09ea30a8b764313a925cff7d5919c6afb336bed"}
Jul 24 19:26:46.418288 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:46.417666    2579 generic.go:356] "Generic (PLEG): container finished" podID="3d8b400053bfa9f9c637aaf70e5d75ea" containerID="f7cef1d578d0a107e450ce116d69943513d9634cb390381080b2d4600dca201c" exitCode=0
Jul 24 19:26:46.418288 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:46.417756    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal" event={"ID":"3d8b400053bfa9f9c637aaf70e5d75ea","Type":"ContainerDied","Data":"f7cef1d578d0a107e450ce116d69943513d9634cb390381080b2d4600dca201c"}
Jul 24 19:26:46.424325 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:46.424264    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-150.ec2.internal" event={"ID":"1188e37e92b4900d2886b98231ddef72","Type":"ContainerStarted","Data":"72a89e0e84c784704b7428dff21119a37cdff83715bf9f2428da8355ccfa023a"}
Jul 24 19:26:46.436220 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:46.436187    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmm2w" event={"ID":"f803e90d-0eb9-4061-873e-e0a5a6a3b19f","Type":"ContainerStarted","Data":"8363da0a7d52cc4e15c301068a5265a7d298f032a1e6d019bb2de180ff3465ab"}
Jul 24 19:26:46.439588 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:46.439470    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4xmjp" event={"ID":"77089fa0-e8af-4044-8ca5-acbbdd5bc2f7","Type":"ContainerStarted","Data":"ca355dcb0a88f4dd54095d13020a29f5c9fe9d153f4c9de3d7608ec007d21175"}
Jul 24 19:26:46.442971 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:46.442886    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zmlbg" event={"ID":"b352627c-bfb7-4f1b-8422-590916dc322b","Type":"ContainerStarted","Data":"a07e8677f964903196f2b837dfc17325818463c5b4ba1cee8d782f70c59e59d1"}
Jul 24 19:26:46.451510 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:46.451422    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7s5nj" event={"ID":"1a57aec4-d102-4483-a562-53ae8ed51e6e","Type":"ContainerStarted","Data":"3c7f1ce899d0c71173cc19764958c8a906a9c15df7fa1863ffd0d2569ba882ed"}
Jul 24 19:26:46.467816 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:46.467721    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ctz4q" event={"ID":"dd30d02e-4ca3-4014-85f3-b809471d2ad8","Type":"ContainerStarted","Data":"88cade8be3e69731e59c5ca196349d7349f3413246e712b1560dc6f596c9deed"}
Jul 24 19:26:47.362070 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:47.361994    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4htc"
Jul 24 19:26:47.362281 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:47.362148    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4htc" podUID="8417d154-2680-412f-b5dc-c9980030f61b"
Jul 24 19:26:47.497635 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:47.497596    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal" event={"ID":"3d8b400053bfa9f9c637aaf70e5d75ea","Type":"ContainerStarted","Data":"52a8d6c702cdc319f789a59490b77308846636d127ab0536ca1a40c4e9d15bc3"}
Jul 24 19:26:47.519036 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:47.518972    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-150.ec2.internal" podStartSLOduration=4.518948506 podStartE2EDuration="4.518948506s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:26:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:26:46.454183643 +0000 UTC m=+4.643257961" watchObservedRunningTime="2026-07-24 19:26:47.518948506 +0000 UTC m=+5.708022824"
Jul 24 19:26:47.867056 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:47.866335    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/73db2676-b431-4046-8290-c4813da2ee8a-original-pull-secret\") pod \"global-pull-secret-syncer-gkd6m\" (UID: \"73db2676-b431-4046-8290-c4813da2ee8a\") " pod="kube-system/global-pull-secret-syncer-gkd6m"
Jul 24 19:26:47.867056 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:47.866423    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/088489c0-3c4a-4b1d-8724-d9ca828ea309-metrics-certs\") pod \"network-metrics-daemon-slw87\" (UID: \"088489c0-3c4a-4b1d-8724-d9ca828ea309\") " pod="openshift-multus/network-metrics-daemon-slw87"
Jul 24 19:26:47.867056 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:47.866576    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:26:47.867056 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:47.866655    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/088489c0-3c4a-4b1d-8724-d9ca828ea309-metrics-certs podName:088489c0-3c4a-4b1d-8724-d9ca828ea309 nodeName:}" failed. No retries permitted until 2026-07-24 19:26:51.866633812 +0000 UTC m=+10.055708110 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/088489c0-3c4a-4b1d-8724-d9ca828ea309-metrics-certs") pod "network-metrics-daemon-slw87" (UID: "088489c0-3c4a-4b1d-8724-d9ca828ea309") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:26:47.867056 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:47.866760    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 19:26:47.867056 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:47.866851    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73db2676-b431-4046-8290-c4813da2ee8a-original-pull-secret podName:73db2676-b431-4046-8290-c4813da2ee8a nodeName:}" failed. No retries permitted until 2026-07-24 19:26:51.866830734 +0000 UTC m=+10.055905049 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/73db2676-b431-4046-8290-c4813da2ee8a-original-pull-secret") pod "global-pull-secret-syncer-gkd6m" (UID: "73db2676-b431-4046-8290-c4813da2ee8a") : object "kube-system"/"original-pull-secret" not registered
Jul 24 19:26:48.068838 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:48.068184    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsvb4\" (UniqueName: \"kubernetes.io/projected/8417d154-2680-412f-b5dc-c9980030f61b-kube-api-access-lsvb4\") pod \"network-check-target-v4htc\" (UID: \"8417d154-2680-412f-b5dc-c9980030f61b\") " pod="openshift-network-diagnostics/network-check-target-v4htc"
Jul 24 19:26:48.068838 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:48.068357    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 19:26:48.068838 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:48.068376    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 19:26:48.068838 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:48.068391    2579 projected.go:196] Error preparing data for projected volume kube-api-access-lsvb4 for pod openshift-network-diagnostics/network-check-target-v4htc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:26:48.068838 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:48.068458    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8417d154-2680-412f-b5dc-c9980030f61b-kube-api-access-lsvb4 podName:8417d154-2680-412f-b5dc-c9980030f61b nodeName:}" failed. No retries permitted until 2026-07-24 19:26:52.068436157 +0000 UTC m=+10.257510475 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lsvb4" (UniqueName: "kubernetes.io/projected/8417d154-2680-412f-b5dc-c9980030f61b-kube-api-access-lsvb4") pod "network-check-target-v4htc" (UID: "8417d154-2680-412f-b5dc-c9980030f61b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:26:48.365876 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:48.365838    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gkd6m"
Jul 24 19:26:48.366077 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:48.366002    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gkd6m" podUID="73db2676-b431-4046-8290-c4813da2ee8a"
Jul 24 19:26:48.366158 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:48.366110    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slw87"
Jul 24 19:26:48.366219 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:48.366195    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slw87" podUID="088489c0-3c4a-4b1d-8724-d9ca828ea309"
Jul 24 19:26:49.362853 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:49.362815    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4htc"
Jul 24 19:26:49.363427 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:49.362962    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4htc" podUID="8417d154-2680-412f-b5dc-c9980030f61b"
Jul 24 19:26:50.365807 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:50.365151    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gkd6m"
Jul 24 19:26:50.365807 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:50.365284    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gkd6m" podUID="73db2676-b431-4046-8290-c4813da2ee8a"
Jul 24 19:26:50.365807 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:50.365646    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slw87"
Jul 24 19:26:50.365807 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:50.365761    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slw87" podUID="088489c0-3c4a-4b1d-8724-d9ca828ea309"
Jul 24 19:26:51.362255 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:51.362210    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4htc"
Jul 24 19:26:51.362446 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:51.362353    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4htc" podUID="8417d154-2680-412f-b5dc-c9980030f61b"
Jul 24 19:26:51.902588 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:51.902545    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/73db2676-b431-4046-8290-c4813da2ee8a-original-pull-secret\") pod \"global-pull-secret-syncer-gkd6m\" (UID: \"73db2676-b431-4046-8290-c4813da2ee8a\") " pod="kube-system/global-pull-secret-syncer-gkd6m"
Jul 24 19:26:51.903104 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:51.902624    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/088489c0-3c4a-4b1d-8724-d9ca828ea309-metrics-certs\") pod \"network-metrics-daemon-slw87\" (UID: \"088489c0-3c4a-4b1d-8724-d9ca828ea309\") " pod="openshift-multus/network-metrics-daemon-slw87"
Jul 24 19:26:51.903104 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:51.902783    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:26:51.903104 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:51.902842    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/088489c0-3c4a-4b1d-8724-d9ca828ea309-metrics-certs podName:088489c0-3c4a-4b1d-8724-d9ca828ea309 nodeName:}" failed. No retries permitted until 2026-07-24 19:26:59.902826033 +0000 UTC m=+18.091900323 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/088489c0-3c4a-4b1d-8724-d9ca828ea309-metrics-certs") pod "network-metrics-daemon-slw87" (UID: "088489c0-3c4a-4b1d-8724-d9ca828ea309") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:26:51.903299 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:51.903244    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 19:26:51.903299 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:51.903292    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73db2676-b431-4046-8290-c4813da2ee8a-original-pull-secret podName:73db2676-b431-4046-8290-c4813da2ee8a nodeName:}" failed. No retries permitted until 2026-07-24 19:26:59.903277302 +0000 UTC m=+18.092351599 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/73db2676-b431-4046-8290-c4813da2ee8a-original-pull-secret") pod "global-pull-secret-syncer-gkd6m" (UID: "73db2676-b431-4046-8290-c4813da2ee8a") : object "kube-system"/"original-pull-secret" not registered
Jul 24 19:26:52.105343 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:52.104696    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsvb4\" (UniqueName: \"kubernetes.io/projected/8417d154-2680-412f-b5dc-c9980030f61b-kube-api-access-lsvb4\") pod \"network-check-target-v4htc\" (UID: \"8417d154-2680-412f-b5dc-c9980030f61b\") " pod="openshift-network-diagnostics/network-check-target-v4htc"
Jul 24 19:26:52.105343 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:52.104909    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 19:26:52.105343 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:52.104932    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 19:26:52.105343 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:52.104946    2579 projected.go:196] Error preparing data for projected volume kube-api-access-lsvb4 for pod openshift-network-diagnostics/network-check-target-v4htc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:26:52.105343 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:52.105014    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8417d154-2680-412f-b5dc-c9980030f61b-kube-api-access-lsvb4 podName:8417d154-2680-412f-b5dc-c9980030f61b nodeName:}" failed. No retries permitted until 2026-07-24 19:27:00.104996352 +0000 UTC m=+18.294070649 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lsvb4" (UniqueName: "kubernetes.io/projected/8417d154-2680-412f-b5dc-c9980030f61b-kube-api-access-lsvb4") pod "network-check-target-v4htc" (UID: "8417d154-2680-412f-b5dc-c9980030f61b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:26:52.365994 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:52.365956    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slw87"
Jul 24 19:26:52.366181 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:52.366070    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slw87" podUID="088489c0-3c4a-4b1d-8724-d9ca828ea309"
Jul 24 19:26:52.366434 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:52.366409    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gkd6m"
Jul 24 19:26:52.366553 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:52.366512    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gkd6m" podUID="73db2676-b431-4046-8290-c4813da2ee8a"
Jul 24 19:26:53.362006 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:53.361968    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4htc"
Jul 24 19:26:53.362510 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:53.362124    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4htc" podUID="8417d154-2680-412f-b5dc-c9980030f61b"
Jul 24 19:26:54.362019 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:54.361937    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gkd6m"
Jul 24 19:26:54.362396 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:54.361953    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slw87"
Jul 24 19:26:54.362396 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:54.362082    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gkd6m" podUID="73db2676-b431-4046-8290-c4813da2ee8a"
Jul 24 19:26:54.362396 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:54.362132    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slw87" podUID="088489c0-3c4a-4b1d-8724-d9ca828ea309"
Jul 24 19:26:55.362133 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:55.362098    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4htc"
Jul 24 19:26:55.362508 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:55.362215    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4htc" podUID="8417d154-2680-412f-b5dc-c9980030f61b"
Jul 24 19:26:56.362602 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:56.362558    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slw87"
Jul 24 19:26:56.363039 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:56.362578    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gkd6m"
Jul 24 19:26:56.363039 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:56.362713    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slw87" podUID="088489c0-3c4a-4b1d-8724-d9ca828ea309"
Jul 24 19:26:56.363039 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:56.362807    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gkd6m" podUID="73db2676-b431-4046-8290-c4813da2ee8a"
Jul 24 19:26:57.362799 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:57.362761    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4htc"
Jul 24 19:26:57.363222 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:57.362899    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4htc" podUID="8417d154-2680-412f-b5dc-c9980030f61b"
Jul 24 19:26:58.361930 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:58.361894    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gkd6m"
Jul 24 19:26:58.362090 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:58.362033    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gkd6m" podUID="73db2676-b431-4046-8290-c4813da2ee8a"
Jul 24 19:26:58.362153 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:58.362092    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slw87"
Jul 24 19:26:58.362211 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:58.362193    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slw87" podUID="088489c0-3c4a-4b1d-8724-d9ca828ea309"
Jul 24 19:26:59.362533 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:59.362497    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4htc"
Jul 24 19:26:59.362937 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:59.362613    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4htc" podUID="8417d154-2680-412f-b5dc-c9980030f61b"
Jul 24 19:26:59.968598 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:59.968558    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/73db2676-b431-4046-8290-c4813da2ee8a-original-pull-secret\") pod \"global-pull-secret-syncer-gkd6m\" (UID: \"73db2676-b431-4046-8290-c4813da2ee8a\") " pod="kube-system/global-pull-secret-syncer-gkd6m"
Jul 24 19:26:59.968772 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:26:59.968629    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/088489c0-3c4a-4b1d-8724-d9ca828ea309-metrics-certs\") pod \"network-metrics-daemon-slw87\" (UID: \"088489c0-3c4a-4b1d-8724-d9ca828ea309\") " pod="openshift-multus/network-metrics-daemon-slw87"
Jul 24 19:26:59.968772 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:59.968682    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 19:26:59.968772 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:59.968738    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:26:59.968772 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:59.968764    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73db2676-b431-4046-8290-c4813da2ee8a-original-pull-secret podName:73db2676-b431-4046-8290-c4813da2ee8a nodeName:}" failed. No retries permitted until 2026-07-24 19:27:15.968746199 +0000 UTC m=+34.157820492 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/73db2676-b431-4046-8290-c4813da2ee8a-original-pull-secret") pod "global-pull-secret-syncer-gkd6m" (UID: "73db2676-b431-4046-8290-c4813da2ee8a") : object "kube-system"/"original-pull-secret" not registered
Jul 24 19:26:59.968949 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:26:59.968783    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/088489c0-3c4a-4b1d-8724-d9ca828ea309-metrics-certs podName:088489c0-3c4a-4b1d-8724-d9ca828ea309 nodeName:}" failed. No retries permitted until 2026-07-24 19:27:15.96877364 +0000 UTC m=+34.157847935 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/088489c0-3c4a-4b1d-8724-d9ca828ea309-metrics-certs") pod "network-metrics-daemon-slw87" (UID: "088489c0-3c4a-4b1d-8724-d9ca828ea309") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:27:00.171156 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:00.171122    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsvb4\" (UniqueName: \"kubernetes.io/projected/8417d154-2680-412f-b5dc-c9980030f61b-kube-api-access-lsvb4\") pod \"network-check-target-v4htc\" (UID: \"8417d154-2680-412f-b5dc-c9980030f61b\") " pod="openshift-network-diagnostics/network-check-target-v4htc"
Jul 24 19:27:00.171375 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:00.171354    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 19:27:00.171451 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:00.171383    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 19:27:00.171451 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:00.171399    2579 projected.go:196] Error preparing data for projected volume kube-api-access-lsvb4 for pod openshift-network-diagnostics/network-check-target-v4htc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:27:00.171540 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:00.171467    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8417d154-2680-412f-b5dc-c9980030f61b-kube-api-access-lsvb4 podName:8417d154-2680-412f-b5dc-c9980030f61b nodeName:}" failed. No retries permitted until 2026-07-24 19:27:16.171447518 +0000 UTC m=+34.360521812 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lsvb4" (UniqueName: "kubernetes.io/projected/8417d154-2680-412f-b5dc-c9980030f61b-kube-api-access-lsvb4") pod "network-check-target-v4htc" (UID: "8417d154-2680-412f-b5dc-c9980030f61b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:27:00.362739 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:00.362696    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slw87"
Jul 24 19:27:00.362739 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:00.362733    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gkd6m"
Jul 24 19:27:00.363103 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:00.362868    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slw87" podUID="088489c0-3c4a-4b1d-8724-d9ca828ea309"
Jul 24 19:27:00.363103 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:00.362976    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gkd6m" podUID="73db2676-b431-4046-8290-c4813da2ee8a"
Jul 24 19:27:01.362285 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:01.362246    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4htc"
Jul 24 19:27:01.362464 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:01.362382    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4htc" podUID="8417d154-2680-412f-b5dc-c9980030f61b"
Jul 24 19:27:02.363157 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:02.363122    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gkd6m"
Jul 24 19:27:02.363583 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:02.363221    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gkd6m" podUID="73db2676-b431-4046-8290-c4813da2ee8a"
Jul 24 19:27:02.363583 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:02.363284    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slw87"
Jul 24 19:27:02.363583 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:02.363417    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slw87" podUID="088489c0-3c4a-4b1d-8724-d9ca828ea309"
Jul 24 19:27:03.362024 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:03.361985    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4htc"
Jul 24 19:27:03.362206 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:03.362120    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4htc" podUID="8417d154-2680-412f-b5dc-c9980030f61b"
Jul 24 19:27:04.361917 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:04.361745    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slw87"
Jul 24 19:27:04.362306 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:04.361788    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gkd6m"
Jul 24 19:27:04.362306 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:04.362008    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slw87" podUID="088489c0-3c4a-4b1d-8724-d9ca828ea309"
Jul 24 19:27:04.362306 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:04.362112    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gkd6m" podUID="73db2676-b431-4046-8290-c4813da2ee8a"
Jul 24 19:27:04.541039 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:04.541003    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ctz4q" event={"ID":"dd30d02e-4ca3-4014-85f3-b809471d2ad8","Type":"ContainerStarted","Data":"097fdf42366462696b18923612cf3068a54609d394af5ed4f1b739d1b591902c"}
Jul 24 19:27:04.542322 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:04.542293    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v4nt7" event={"ID":"c9faba17-c794-48f7-8416-b44094cd8946","Type":"ContainerStarted","Data":"2d500e2c9799dcbd05e9ac3d14d13e5c806f6dc2a0b21fcc717f277ecfcdaeae"}
Jul 24 19:27:04.543662 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:04.543640    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d8zx6" event={"ID":"d2eb9885-1490-41e3-8e05-2a21ed230573","Type":"ContainerStarted","Data":"7f3458abb98c3b9b4585e14f6c2e64c6009c83ed22173b5e5f7525a6da69cb6d"}
Jul 24 19:27:04.545099 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:04.545077    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vclnd" event={"ID":"fa8789c9-6c39-46cd-a540-657dea710eb8","Type":"ContainerStarted","Data":"7aac25c8031e04a71c94e5bb881f967a3fc1b81d2d2a2718ea1f975227bb91a7"}
Jul 24 19:27:04.546342 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:04.546323    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4zz8w" event={"ID":"aac7b50f-a1bd-40ba-9b16-f98984e5ed50","Type":"ContainerStarted","Data":"197729d150e3b6b674fb1c7424bbbb4b97a95ff01f6308c536607b16e085ac4c"}
Jul 24 19:27:04.547622 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:04.547603    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmm2w" event={"ID":"f803e90d-0eb9-4061-873e-e0a5a6a3b19f","Type":"ContainerStarted","Data":"5edc70eac71ff105403b6cf366dd9ffea578e2e72cf89c811b4b89fd3163000e"}
Jul 24 19:27:04.548759 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:04.548740    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zmlbg" event={"ID":"b352627c-bfb7-4f1b-8422-590916dc322b","Type":"ContainerStarted","Data":"c5aab467f6fc7fd9dfe03a44add28af5ccaf3d32494cfc9d330458855bd4941d"}
Jul 24 19:27:04.554982 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:04.554949    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ctz4q" podStartSLOduration=2.922769434 podStartE2EDuration="21.554938644s" totalImagesPullingTime="18.63216921s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:26:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:27:04.554887282 +0000 UTC m=+22.743961594" watchObservedRunningTime="2026-07-24 19:27:04.554938644 +0000 UTC m=+22.744012957"
Jul 24 19:27:04.555385 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:04.555366    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal" podStartSLOduration=21.555358062 podStartE2EDuration="21.555358062s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:26:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:26:47.519666251 +0000 UTC m=+5.708740566" watchObservedRunningTime="2026-07-24 19:27:04.555358062 +0000 UTC m=+22.744432374"
Jul 24 19:27:04.591543 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:04.591499    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zmlbg" podStartSLOduration=2.947805025 podStartE2EDuration="21.591481641s" totalImagesPullingTime="18.643676616s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:26:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:27:04.591470459 +0000 UTC m=+22.780544772" watchObservedRunningTime="2026-07-24 19:27:04.591481641 +0000 UTC m=+22.780555954"
Jul 24 19:27:04.606711 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:04.606124    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-v4nt7" podStartSLOduration=3.032267671 podStartE2EDuration="21.606106686s" totalImagesPullingTime="18.573839015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:26:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:27:04.605715737 +0000 UTC m=+22.794790051" watchObservedRunningTime="2026-07-24 19:27:04.606106686 +0000 UTC m=+22.795181001"
Jul 24 19:27:04.619135 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:04.619093    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-d8zx6" podStartSLOduration=2.992797209 podStartE2EDuration="21.619078826s" totalImagesPullingTime="18.626281617s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:26:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:27:04.61899239 +0000 UTC m=+22.808066705" watchObservedRunningTime="2026-07-24 19:27:04.619078826 +0000 UTC m=+22.808153138"
Jul 24 19:27:05.362364 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:05.362180    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4htc"
Jul 24 19:27:05.363164 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:05.362444    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4htc" podUID="8417d154-2680-412f-b5dc-c9980030f61b"
Jul 24 19:27:05.552025 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:05.551995    2579 generic.go:356] "Generic (PLEG): container finished" podID="aac7b50f-a1bd-40ba-9b16-f98984e5ed50" containerID="197729d150e3b6b674fb1c7424bbbb4b97a95ff01f6308c536607b16e085ac4c" exitCode=0
Jul 24 19:27:05.552197 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:05.552081    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4zz8w" event={"ID":"aac7b50f-a1bd-40ba-9b16-f98984e5ed50","Type":"ContainerDied","Data":"197729d150e3b6b674fb1c7424bbbb4b97a95ff01f6308c536607b16e085ac4c"}
Jul 24 19:27:05.553504 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:05.553483    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4xmjp" event={"ID":"77089fa0-e8af-4044-8ca5-acbbdd5bc2f7","Type":"ContainerStarted","Data":"ead333928b24c54e12af3adb74c635b82ca0e63f9937e1d549c2cdb745f126a7"}
Jul 24 19:27:05.557879 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:05.555295    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7s5nj" event={"ID":"1a57aec4-d102-4483-a562-53ae8ed51e6e","Type":"ContainerStarted","Data":"018b567440e46eae65ab17a063d49704b23d178fcb66cd61da7688984ba25b86"}
Jul 24 19:27:05.560764 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:05.560747    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vclnd_fa8789c9-6c39-46cd-a540-657dea710eb8/ovn-acl-logging/0.log"
Jul 24 19:27:05.561077 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:05.561060    2579 generic.go:356] "Generic (PLEG): container finished" podID="fa8789c9-6c39-46cd-a540-657dea710eb8" containerID="dff0e7d1769831cfe2e505de154d28e967a9a3980d7e76e4d52bbf5f14b1124c" exitCode=1
Jul 24 19:27:05.561175 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:05.561153    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vclnd" event={"ID":"fa8789c9-6c39-46cd-a540-657dea710eb8","Type":"ContainerStarted","Data":"b4926fec9622ba30e03ebc7330029140b8dcfb9f641b57ea57115bfd0040db04"}
Jul 24 19:27:05.561248 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:05.561232    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vclnd" event={"ID":"fa8789c9-6c39-46cd-a540-657dea710eb8","Type":"ContainerStarted","Data":"7d87e9a72a298d951c92b9e8a31d0ae41a437d6ceb7aa14541cfb32db448be36"}
Jul 24 19:27:05.561305 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:05.561289    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vclnd" event={"ID":"fa8789c9-6c39-46cd-a540-657dea710eb8","Type":"ContainerStarted","Data":"b598d7e017ab7696055c3e7f20bc222d71d5d5652e15752807f6cb39f70ef259"}
Jul 24 19:27:05.561362 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:05.561338    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vclnd" event={"ID":"fa8789c9-6c39-46cd-a540-657dea710eb8","Type":"ContainerStarted","Data":"daf2c24fe87c121cc5a3f989e0721724ab7ebb83cc19d515aea9da716153d4e4"}
Jul 24 19:27:05.561411 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:05.561390    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vclnd" event={"ID":"fa8789c9-6c39-46cd-a540-657dea710eb8","Type":"ContainerDied","Data":"dff0e7d1769831cfe2e505de154d28e967a9a3980d7e76e4d52bbf5f14b1124c"}
Jul 24 19:27:05.593558 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:05.593511    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7s5nj" podStartSLOduration=3.68785432 podStartE2EDuration="22.593497999s" totalImagesPullingTime="18.905643679s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:26:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:27:05.593399875 +0000 UTC m=+23.782474187" watchObservedRunningTime="2026-07-24 19:27:05.593497999 +0000 UTC m=+23.782572311"
Jul 24 19:27:05.612846 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:05.612803    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4xmjp" podStartSLOduration=4.031720878 podStartE2EDuration="22.612791794s" totalImagesPullingTime="18.581070916s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:26:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:27:05.612593765 +0000 UTC m=+23.801668079" watchObservedRunningTime="2026-07-24 19:27:05.612791794 +0000 UTC m=+23.801866364"
Jul 24 19:27:05.786168 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:05.786139    2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 24 19:27:06.288342 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:06.288242    2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T19:27:05.786162513Z","UUID":"b3e9f26e-200d-461d-8de6-04b9f8ed1b99","Handler":null,"Name":"","Endpoint":""}
Jul 24 19:27:06.289796 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:06.289777    2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 24 19:27:06.289899 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:06.289814    2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 24 19:27:06.348896 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:06.348844    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-v4nt7"
Jul 24 19:27:06.349657 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:06.349632    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-v4nt7"
Jul 24 19:27:06.362362 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:06.362334    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gkd6m"
Jul 24 19:27:06.362497 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:06.362461    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gkd6m" podUID="73db2676-b431-4046-8290-c4813da2ee8a"
Jul 24 19:27:06.362815 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:06.362783    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slw87"
Jul 24 19:27:06.362911 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:06.362886    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slw87" podUID="088489c0-3c4a-4b1d-8724-d9ca828ea309"
Jul 24 19:27:06.566023 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:06.565942    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmm2w" event={"ID":"f803e90d-0eb9-4061-873e-e0a5a6a3b19f","Type":"ContainerStarted","Data":"270dcb72f5b1b078a26683e988251b049c83e3647946f9802af960412bf4cb53"}
Jul 24 19:27:07.362526 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:07.362324    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4htc"
Jul 24 19:27:07.363065 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:07.362612    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4htc" podUID="8417d154-2680-412f-b5dc-c9980030f61b"
Jul 24 19:27:07.570789 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:07.570752    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmm2w" event={"ID":"f803e90d-0eb9-4061-873e-e0a5a6a3b19f","Type":"ContainerStarted","Data":"018c025064b7b398c850a1e80432357b9055b2b90e41bba9bfc033a3027d7f22"}
Jul 24 19:27:07.574410 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:07.574385    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vclnd_fa8789c9-6c39-46cd-a540-657dea710eb8/ovn-acl-logging/0.log"
Jul 24 19:27:07.574826 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:07.574800    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vclnd" event={"ID":"fa8789c9-6c39-46cd-a540-657dea710eb8","Type":"ContainerStarted","Data":"d2b015c7e61770390d6f0f19525faa399b63541b3f6a5edac86b4f6b01677f86"}
Jul 24 19:27:07.574892 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:07.574825    2579 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 24 19:27:07.928873 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:07.928734    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-v4nt7"
Jul 24 19:27:07.929371 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:07.929349    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-v4nt7"
Jul 24 19:27:07.943799 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:07.943743    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmm2w" podStartSLOduration=4.955092146 podStartE2EDuration="25.943695281s" totalImagesPullingTime="20.988603135s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:26:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:27:07.591144058 +0000 UTC m=+25.780218372" watchObservedRunningTime="2026-07-24 19:27:07.943695281 +0000 UTC m=+26.132769596"
Jul 24 19:27:08.361844 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:08.361811    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gkd6m"
Jul 24 19:27:08.362050 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:08.361812    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slw87"
Jul 24 19:27:08.362050 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:08.361931    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gkd6m" podUID="73db2676-b431-4046-8290-c4813da2ee8a"
Jul 24 19:27:08.362050 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:08.362025    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slw87" podUID="088489c0-3c4a-4b1d-8724-d9ca828ea309"
Jul 24 19:27:09.361928 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:09.361888    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4htc"
Jul 24 19:27:09.362590 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:09.362032    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4htc" podUID="8417d154-2680-412f-b5dc-c9980030f61b"
Jul 24 19:27:10.362927 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:10.362703    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gkd6m"
Jul 24 19:27:10.363588 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:10.362759    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slw87"
Jul 24 19:27:10.363588 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:10.363038    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gkd6m" podUID="73db2676-b431-4046-8290-c4813da2ee8a"
Jul 24 19:27:10.363588 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:10.363098    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slw87" podUID="088489c0-3c4a-4b1d-8724-d9ca828ea309"
Jul 24 19:27:10.587296 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:10.587267    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vclnd_fa8789c9-6c39-46cd-a540-657dea710eb8/ovn-acl-logging/0.log"
Jul 24 19:27:10.587669 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:10.587633    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vclnd" event={"ID":"fa8789c9-6c39-46cd-a540-657dea710eb8","Type":"ContainerStarted","Data":"ce54f4ded1ce0f043793d0f99cd6fbfe4a07ac0d881cab125765a62369e82dbd"}
Jul 24 19:27:10.587883 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:10.587850    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:27:10.588089 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:10.588060    2579 scope.go:117] "RemoveContainer" containerID="dff0e7d1769831cfe2e505de154d28e967a9a3980d7e76e4d52bbf5f14b1124c"
Jul 24 19:27:10.589496 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:10.589470    2579 generic.go:356] "Generic (PLEG): container finished" podID="aac7b50f-a1bd-40ba-9b16-f98984e5ed50" containerID="dc74511d294ef16b900ea6b083b1addcc951951704a5f02125e58d30642a626c" exitCode=0
Jul 24 19:27:10.589605 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:10.589519    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4zz8w" event={"ID":"aac7b50f-a1bd-40ba-9b16-f98984e5ed50","Type":"ContainerDied","Data":"dc74511d294ef16b900ea6b083b1addcc951951704a5f02125e58d30642a626c"}
Jul 24 19:27:10.604791 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:10.604755    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:27:11.362050 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:11.362020    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4htc"
Jul 24 19:27:11.362214 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:11.362147    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4htc" podUID="8417d154-2680-412f-b5dc-c9980030f61b"
Jul 24 19:27:11.596019 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:11.595942    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vclnd_fa8789c9-6c39-46cd-a540-657dea710eb8/ovn-acl-logging/0.log"
Jul 24 19:27:11.596390 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:11.596345    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vclnd" event={"ID":"fa8789c9-6c39-46cd-a540-657dea710eb8","Type":"ContainerStarted","Data":"bf975d1ec793193d4a584cca8f32b71fe4957a2b79c840d117687bb8c68f829c"}
Jul 24 19:27:11.596533 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:11.596515    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:27:11.596588 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:11.596578    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:27:11.598465 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:11.598438    2579 generic.go:356] "Generic (PLEG): container finished" podID="aac7b50f-a1bd-40ba-9b16-f98984e5ed50" containerID="d65963461cc8e9bc36fb84531d019178e3c8cbe66600deba39d86fe6862abd77" exitCode=0
Jul 24 19:27:11.598578 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:11.598505    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4zz8w" event={"ID":"aac7b50f-a1bd-40ba-9b16-f98984e5ed50","Type":"ContainerDied","Data":"d65963461cc8e9bc36fb84531d019178e3c8cbe66600deba39d86fe6862abd77"}
Jul 24 19:27:11.612978 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:11.612958    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:27:11.627078 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:11.626700    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vclnd" podStartSLOduration=10.956972522000001 podStartE2EDuration="29.626680287s" totalImagesPullingTime="18.669707765s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:26:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:27:11.62512897 +0000 UTC m=+29.814203289" watchObservedRunningTime="2026-07-24 19:27:11.626680287 +0000 UTC m=+29.815754602"
Jul 24 19:27:12.363716 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:12.363688    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gkd6m"
Jul 24 19:27:12.363857 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:12.363796    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gkd6m" podUID="73db2676-b431-4046-8290-c4813da2ee8a"
Jul 24 19:27:12.363857 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:12.363843    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slw87"
Jul 24 19:27:12.363978 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:12.363933    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slw87" podUID="088489c0-3c4a-4b1d-8724-d9ca828ea309"
Jul 24 19:27:12.603005 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:12.602916    2579 generic.go:356] "Generic (PLEG): container finished" podID="aac7b50f-a1bd-40ba-9b16-f98984e5ed50" containerID="f226f4c45c14fae6be1a9d6e40a35d20d791cb14870865024437d020f8299dda" exitCode=0
Jul 24 19:27:12.603005 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:12.602998    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4zz8w" event={"ID":"aac7b50f-a1bd-40ba-9b16-f98984e5ed50","Type":"ContainerDied","Data":"f226f4c45c14fae6be1a9d6e40a35d20d791cb14870865024437d020f8299dda"}
Jul 24 19:27:13.361813 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:13.361783    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4htc"
Jul 24 19:27:13.361972 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:13.361912    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4htc" podUID="8417d154-2680-412f-b5dc-c9980030f61b"
Jul 24 19:27:14.361931 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:14.361898    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slw87"
Jul 24 19:27:14.362274 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:14.361898    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gkd6m"
Jul 24 19:27:14.362274 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:14.362016    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slw87" podUID="088489c0-3c4a-4b1d-8724-d9ca828ea309"
Jul 24 19:27:14.362274 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:14.362071    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gkd6m" podUID="73db2676-b431-4046-8290-c4813da2ee8a"
Jul 24 19:27:15.362441 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:15.362403    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4htc"
Jul 24 19:27:15.363023 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:15.362536    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4htc" podUID="8417d154-2680-412f-b5dc-c9980030f61b"
Jul 24 19:27:15.993278 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:15.993226    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/088489c0-3c4a-4b1d-8724-d9ca828ea309-metrics-certs\") pod \"network-metrics-daemon-slw87\" (UID: \"088489c0-3c4a-4b1d-8724-d9ca828ea309\") " pod="openshift-multus/network-metrics-daemon-slw87"
Jul 24 19:27:15.993615 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:15.993316    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/73db2676-b431-4046-8290-c4813da2ee8a-original-pull-secret\") pod \"global-pull-secret-syncer-gkd6m\" (UID: \"73db2676-b431-4046-8290-c4813da2ee8a\") " pod="kube-system/global-pull-secret-syncer-gkd6m"
Jul 24 19:27:15.993615 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:15.993390    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:27:15.993615 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:15.993417    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 19:27:15.993615 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:15.993458    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/088489c0-3c4a-4b1d-8724-d9ca828ea309-metrics-certs podName:088489c0-3c4a-4b1d-8724-d9ca828ea309 nodeName:}" failed. No retries permitted until 2026-07-24 19:27:47.993438938 +0000 UTC m=+66.182513249 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/088489c0-3c4a-4b1d-8724-d9ca828ea309-metrics-certs") pod "network-metrics-daemon-slw87" (UID: "088489c0-3c4a-4b1d-8724-d9ca828ea309") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:27:15.993615 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:15.993479    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73db2676-b431-4046-8290-c4813da2ee8a-original-pull-secret podName:73db2676-b431-4046-8290-c4813da2ee8a nodeName:}" failed. No retries permitted until 2026-07-24 19:27:47.99346839 +0000 UTC m=+66.182542686 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/73db2676-b431-4046-8290-c4813da2ee8a-original-pull-secret") pod "global-pull-secret-syncer-gkd6m" (UID: "73db2676-b431-4046-8290-c4813da2ee8a") : object "kube-system"/"original-pull-secret" not registered
Jul 24 19:27:16.195049 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:16.195013    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsvb4\" (UniqueName: \"kubernetes.io/projected/8417d154-2680-412f-b5dc-c9980030f61b-kube-api-access-lsvb4\") pod \"network-check-target-v4htc\" (UID: \"8417d154-2680-412f-b5dc-c9980030f61b\") " pod="openshift-network-diagnostics/network-check-target-v4htc"
Jul 24 19:27:16.195229 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:16.195196    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 19:27:16.195354 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:16.195237    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 19:27:16.195354 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:16.195256    2579 projected.go:196] Error preparing data for projected volume kube-api-access-lsvb4 for pod openshift-network-diagnostics/network-check-target-v4htc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:27:16.195354 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:16.195342    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8417d154-2680-412f-b5dc-c9980030f61b-kube-api-access-lsvb4 podName:8417d154-2680-412f-b5dc-c9980030f61b nodeName:}" failed. No retries permitted until 2026-07-24 19:27:48.195315775 +0000 UTC m=+66.384390163 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-lsvb4" (UniqueName: "kubernetes.io/projected/8417d154-2680-412f-b5dc-c9980030f61b-kube-api-access-lsvb4") pod "network-check-target-v4htc" (UID: "8417d154-2680-412f-b5dc-c9980030f61b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:27:16.362376 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:16.362336    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slw87"
Jul 24 19:27:16.362376 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:16.362364    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gkd6m"
Jul 24 19:27:16.362980 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:16.362495    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slw87" podUID="088489c0-3c4a-4b1d-8724-d9ca828ea309"
Jul 24 19:27:16.362980 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:16.362588    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gkd6m" podUID="73db2676-b431-4046-8290-c4813da2ee8a"
Jul 24 19:27:17.362644 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:17.362488    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4htc"
Jul 24 19:27:17.363069 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:17.362756    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4htc" podUID="8417d154-2680-412f-b5dc-c9980030f61b"
Jul 24 19:27:17.515170 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:17.515137    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-slw87"]
Jul 24 19:27:17.515341 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:17.515273    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slw87"
Jul 24 19:27:17.515415 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:17.515393    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slw87" podUID="088489c0-3c4a-4b1d-8724-d9ca828ea309"
Jul 24 19:27:17.517693 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:17.517667    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gkd6m"]
Jul 24 19:27:17.518450 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:17.517771    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gkd6m"
Jul 24 19:27:17.518450 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:17.517856    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gkd6m" podUID="73db2676-b431-4046-8290-c4813da2ee8a"
Jul 24 19:27:17.520315 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:17.520289    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-v4htc"]
Jul 24 19:27:17.617029 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:17.616950    2579 generic.go:356] "Generic (PLEG): container finished" podID="aac7b50f-a1bd-40ba-9b16-f98984e5ed50" containerID="4373f305cc0ec992aeed2b19b2eb1224d62be9c3f237c3ca70fe0568050e0ee8" exitCode=0
Jul 24 19:27:17.617029 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:17.616982    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4zz8w" event={"ID":"aac7b50f-a1bd-40ba-9b16-f98984e5ed50","Type":"ContainerDied","Data":"4373f305cc0ec992aeed2b19b2eb1224d62be9c3f237c3ca70fe0568050e0ee8"}
Jul 24 19:27:17.617206 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:17.617125    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4htc"
Jul 24 19:27:17.617268 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:17.617235    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4htc" podUID="8417d154-2680-412f-b5dc-c9980030f61b"
Jul 24 19:27:18.625256 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:18.625224    2579 generic.go:356] "Generic (PLEG): container finished" podID="aac7b50f-a1bd-40ba-9b16-f98984e5ed50" containerID="b55afa490bdd59ef7196d6cbec7c941fe2ae501fa67ef27f5ea51998adc45384" exitCode=0
Jul 24 19:27:18.625824 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:18.625275    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4zz8w" event={"ID":"aac7b50f-a1bd-40ba-9b16-f98984e5ed50","Type":"ContainerDied","Data":"b55afa490bdd59ef7196d6cbec7c941fe2ae501fa67ef27f5ea51998adc45384"}
Jul 24 19:27:19.362636 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:19.362608    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slw87"
Jul 24 19:27:19.362830 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:19.362608    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gkd6m"
Jul 24 19:27:19.362830 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:19.362739    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slw87" podUID="088489c0-3c4a-4b1d-8724-d9ca828ea309"
Jul 24 19:27:19.362830 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:19.362608    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4htc"
Jul 24 19:27:19.362830 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:19.362797    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gkd6m" podUID="73db2676-b431-4046-8290-c4813da2ee8a"
Jul 24 19:27:19.362994 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:19.362844    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4htc" podUID="8417d154-2680-412f-b5dc-c9980030f61b"
Jul 24 19:27:19.630945 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:19.630856    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4zz8w" event={"ID":"aac7b50f-a1bd-40ba-9b16-f98984e5ed50","Type":"ContainerStarted","Data":"97ab04db6c1cac5888e47b23b3511ba045197336ec562a06cdf6187366ecff97"}
Jul 24 19:27:19.653148 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:19.653093    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4zz8w" podStartSLOduration=7.873163668 podStartE2EDuration="36.653076566s" totalImagesPullingTime="28.779912898s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:26:43 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:27:19.651540024 +0000 UTC m=+37.840614337" watchObservedRunningTime="2026-07-24 19:27:19.653076566 +0000 UTC m=+37.842150880"
Jul 24 19:27:21.104287 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.104105    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeReady"
Jul 24 19:27:21.104640 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.104387    2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 24 19:27:21.137858 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.137829    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6dbd567794-jpt64"]
Jul 24 19:27:21.157338 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.157314    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pl97h"]
Jul 24 19:27:21.157466 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.157436    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dbd567794-jpt64"
Jul 24 19:27:21.159892 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.159866    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jcdcc\""
Jul 24 19:27:21.160202 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.160114    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 24 19:27:21.160202 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.160117    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 24 19:27:21.160337 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.160227    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 24 19:27:21.164904 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.164877    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 24 19:27:21.174570 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.174550    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lrf4t"]
Jul 24 19:27:21.174698 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.174683    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pl97h"
Jul 24 19:27:21.177339 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.177321    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qvrwm\""
Jul 24 19:27:21.177463 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.177345    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 24 19:27:21.177463 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.177378    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 24 19:27:21.177933 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.177918    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 24 19:27:21.178038 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.178023    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 24 19:27:21.191234 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.191159    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6dbd567794-jpt64"]
Jul 24 19:27:21.191234 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.191198    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pl97h"]
Jul 24 19:27:21.191234 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.191234    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lrf4t"]
Jul 24 19:27:21.191454 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.191329    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lrf4t"
Jul 24 19:27:21.193932 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.193907    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 24 19:27:21.194085 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.194071    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 24 19:27:21.194165 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.194151    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8tvpg\""
Jul 24 19:27:21.194398 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.194378    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 24 19:27:21.255209 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.255182    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gcmpj"]
Jul 24 19:27:21.262392 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.262376    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gcmpj"
Jul 24 19:27:21.265114 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.265078    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 24 19:27:21.265379 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.265362    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 24 19:27:21.265471 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.265456    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-75276\""
Jul 24 19:27:21.269890 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.269869    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gcmpj"]
Jul 24 19:27:21.337116 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.337088    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90-trusted-ca\") pod \"image-registry-6dbd567794-jpt64\" (UID: \"cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90\") " pod="openshift-image-registry/image-registry-6dbd567794-jpt64"
Jul 24 19:27:21.337275 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.337120    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/954670cf-545b-4939-b6c6-63c2a32be646-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pl97h\" (UID: \"954670cf-545b-4939-b6c6-63c2a32be646\") " pod="openshift-insights/insights-runtime-extractor-pl97h"
Jul 24 19:27:21.337275 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.337140    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gw4z\" (UniqueName: \"kubernetes.io/projected/954670cf-545b-4939-b6c6-63c2a32be646-kube-api-access-8gw4z\") pod \"insights-runtime-extractor-pl97h\" (UID: \"954670cf-545b-4939-b6c6-63c2a32be646\") " pod="openshift-insights/insights-runtime-extractor-pl97h"
Jul 24 19:27:21.337275 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.337198    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90-image-registry-private-configuration\") pod \"image-registry-6dbd567794-jpt64\" (UID: \"cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90\") " pod="openshift-image-registry/image-registry-6dbd567794-jpt64"
Jul 24 19:27:21.337275 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.337228    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjsvp\" (UniqueName: \"kubernetes.io/projected/dbf25fcb-e1f7-4b38-aa66-c87a829df526-kube-api-access-xjsvp\") pod \"ingress-canary-lrf4t\" (UID: \"dbf25fcb-e1f7-4b38-aa66-c87a829df526\") " pod="openshift-ingress-canary/ingress-canary-lrf4t"
Jul 24 19:27:21.337404 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.337340    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90-registry-tls\") pod \"image-registry-6dbd567794-jpt64\" (UID: \"cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90\") " pod="openshift-image-registry/image-registry-6dbd567794-jpt64"
Jul 24 19:27:21.337404 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.337389    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvkp6\" (UniqueName: \"kubernetes.io/projected/cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90-kube-api-access-zvkp6\") pod \"image-registry-6dbd567794-jpt64\" (UID: \"cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90\") " pod="openshift-image-registry/image-registry-6dbd567794-jpt64"
Jul 24 19:27:21.337463 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.337417    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/954670cf-545b-4939-b6c6-63c2a32be646-crio-socket\") pod \"insights-runtime-extractor-pl97h\" (UID: \"954670cf-545b-4939-b6c6-63c2a32be646\") " pod="openshift-insights/insights-runtime-extractor-pl97h"
Jul 24 19:27:21.337463 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.337449    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90-installation-pull-secrets\") pod \"image-registry-6dbd567794-jpt64\" (UID: \"cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90\") " pod="openshift-image-registry/image-registry-6dbd567794-jpt64"
Jul 24 19:27:21.337522 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.337475    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dbf25fcb-e1f7-4b38-aa66-c87a829df526-cert\") pod \"ingress-canary-lrf4t\" (UID: \"dbf25fcb-e1f7-4b38-aa66-c87a829df526\") " pod="openshift-ingress-canary/ingress-canary-lrf4t"
Jul 24 19:27:21.337522 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.337501    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/954670cf-545b-4939-b6c6-63c2a32be646-data-volume\") pod \"insights-runtime-extractor-pl97h\" (UID: \"954670cf-545b-4939-b6c6-63c2a32be646\") " pod="openshift-insights/insights-runtime-extractor-pl97h"
Jul 24 19:27:21.337576 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.337523    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/954670cf-545b-4939-b6c6-63c2a32be646-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pl97h\" (UID: \"954670cf-545b-4939-b6c6-63c2a32be646\") " pod="openshift-insights/insights-runtime-extractor-pl97h"
Jul 24 19:27:21.337576 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.337551    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90-bound-sa-token\") pod \"image-registry-6dbd567794-jpt64\" (UID: \"cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90\") " pod="openshift-image-registry/image-registry-6dbd567794-jpt64"
Jul 24 19:27:21.337634 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.337600    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90-ca-trust-extracted\") pod \"image-registry-6dbd567794-jpt64\" (UID: \"cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90\") " pod="openshift-image-registry/image-registry-6dbd567794-jpt64"
Jul 24 19:27:21.337679 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.337662    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90-registry-certificates\") pod \"image-registry-6dbd567794-jpt64\" (UID: \"cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90\") " pod="openshift-image-registry/image-registry-6dbd567794-jpt64"
Jul 24 19:27:21.362532 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.362501    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slw87"
Jul 24 19:27:21.362680 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.362541    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4htc"
Jul 24 19:27:21.362680 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.362635    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gkd6m"
Jul 24 19:27:21.365219 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.365192    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 19:27:21.365773 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.365749    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nz88f\""
Jul 24 19:27:21.365921 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.365747    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 19:27:21.368564 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.365755    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 19:27:21.368687 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.365948    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 19:27:21.368687 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.366011    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ln4l7\""
Jul 24 19:27:21.438010 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.437973    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90-installation-pull-secrets\") pod \"image-registry-6dbd567794-jpt64\" (UID: \"cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90\") " pod="openshift-image-registry/image-registry-6dbd567794-jpt64"
Jul 24 19:27:21.438010 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.438011    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dbf25fcb-e1f7-4b38-aa66-c87a829df526-cert\") pod \"ingress-canary-lrf4t\" (UID: \"dbf25fcb-e1f7-4b38-aa66-c87a829df526\") " pod="openshift-ingress-canary/ingress-canary-lrf4t"
Jul 24 19:27:21.438285 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.438035    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/954670cf-545b-4939-b6c6-63c2a32be646-data-volume\") pod \"insights-runtime-extractor-pl97h\" (UID: \"954670cf-545b-4939-b6c6-63c2a32be646\") " pod="openshift-insights/insights-runtime-extractor-pl97h"
Jul 24 19:27:21.438285 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.438052    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/954670cf-545b-4939-b6c6-63c2a32be646-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pl97h\" (UID: \"954670cf-545b-4939-b6c6-63c2a32be646\") " pod="openshift-insights/insights-runtime-extractor-pl97h"
Jul 24 19:27:21.438285 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.438185    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e143a2cc-07ac-4ca4-917a-493cd1053866-tmp-dir\") pod \"dns-default-gcmpj\" (UID: \"e143a2cc-07ac-4ca4-917a-493cd1053866\") " pod="openshift-dns/dns-default-gcmpj"
Jul 24 19:27:21.438285 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.438249    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90-bound-sa-token\") pod \"image-registry-6dbd567794-jpt64\" (UID: \"cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90\") " pod="openshift-image-registry/image-registry-6dbd567794-jpt64"
Jul 24 19:27:21.438456 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.438283    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jj6r\" (UniqueName: \"kubernetes.io/projected/e143a2cc-07ac-4ca4-917a-493cd1053866-kube-api-access-5jj6r\") pod \"dns-default-gcmpj\" (UID: \"e143a2cc-07ac-4ca4-917a-493cd1053866\") " pod="openshift-dns/dns-default-gcmpj"
Jul 24 19:27:21.438456 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.438342    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90-ca-trust-extracted\") pod \"image-registry-6dbd567794-jpt64\" (UID: \"cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90\") " pod="openshift-image-registry/image-registry-6dbd567794-jpt64"
Jul 24 19:27:21.438456 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.438422    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/954670cf-545b-4939-b6c6-63c2a32be646-data-volume\") pod \"insights-runtime-extractor-pl97h\" (UID: \"954670cf-545b-4939-b6c6-63c2a32be646\") " pod="openshift-insights/insights-runtime-extractor-pl97h"
Jul 24 19:27:21.438456 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.438426    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90-registry-certificates\") pod \"image-registry-6dbd567794-jpt64\" (UID: \"cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90\") " pod="openshift-image-registry/image-registry-6dbd567794-jpt64"
Jul 24 19:27:21.438618 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.438482    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90-trusted-ca\") pod \"image-registry-6dbd567794-jpt64\" (UID: \"cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90\") " pod="openshift-image-registry/image-registry-6dbd567794-jpt64"
Jul 24 19:27:21.438618 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.438509    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/954670cf-545b-4939-b6c6-63c2a32be646-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pl97h\" (UID: \"954670cf-545b-4939-b6c6-63c2a32be646\") " pod="openshift-insights/insights-runtime-extractor-pl97h"
Jul 24 19:27:21.438618 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.438531    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gw4z\" (UniqueName: \"kubernetes.io/projected/954670cf-545b-4939-b6c6-63c2a32be646-kube-api-access-8gw4z\") pod \"insights-runtime-extractor-pl97h\" (UID: \"954670cf-545b-4939-b6c6-63c2a32be646\") " pod="openshift-insights/insights-runtime-extractor-pl97h"
Jul 24 19:27:21.438618 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.438553    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e143a2cc-07ac-4ca4-917a-493cd1053866-metrics-tls\") pod \"dns-default-gcmpj\" (UID: \"e143a2cc-07ac-4ca4-917a-493cd1053866\") " pod="openshift-dns/dns-default-gcmpj"
Jul 24 19:27:21.438618 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.438580    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90-image-registry-private-configuration\") pod \"image-registry-6dbd567794-jpt64\" (UID: \"cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90\") " pod="openshift-image-registry/image-registry-6dbd567794-jpt64"
Jul 24 19:27:21.438618 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.438610    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjsvp\" (UniqueName: \"kubernetes.io/projected/dbf25fcb-e1f7-4b38-aa66-c87a829df526-kube-api-access-xjsvp\") pod \"ingress-canary-lrf4t\" (UID: \"dbf25fcb-e1f7-4b38-aa66-c87a829df526\") " pod="openshift-ingress-canary/ingress-canary-lrf4t"
Jul 24 19:27:21.438928 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.438633    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e143a2cc-07ac-4ca4-917a-493cd1053866-config-volume\") pod \"dns-default-gcmpj\" (UID: \"e143a2cc-07ac-4ca4-917a-493cd1053866\") " pod="openshift-dns/dns-default-gcmpj"
Jul 24 19:27:21.438928 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.438688    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/954670cf-545b-4939-b6c6-63c2a32be646-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pl97h\" (UID: \"954670cf-545b-4939-b6c6-63c2a32be646\") " pod="openshift-insights/insights-runtime-extractor-pl97h"
Jul 24 19:27:21.438928 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.438741    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90-registry-tls\") pod \"image-registry-6dbd567794-jpt64\" (UID: \"cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90\") " pod="openshift-image-registry/image-registry-6dbd567794-jpt64"
Jul 24 19:27:21.438928 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.438787    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvkp6\" (UniqueName: \"kubernetes.io/projected/cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90-kube-api-access-zvkp6\") pod \"image-registry-6dbd567794-jpt64\" (UID: \"cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90\") " pod="openshift-image-registry/image-registry-6dbd567794-jpt64"
Jul 24 19:27:21.438928 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.438793    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90-ca-trust-extracted\") pod \"image-registry-6dbd567794-jpt64\" (UID: \"cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90\") " pod="openshift-image-registry/image-registry-6dbd567794-jpt64"
Jul 24 19:27:21.438928 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.438816    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/954670cf-545b-4939-b6c6-63c2a32be646-crio-socket\") pod \"insights-runtime-extractor-pl97h\" (UID: \"954670cf-545b-4939-b6c6-63c2a32be646\") " pod="openshift-insights/insights-runtime-extractor-pl97h"
Jul 24 19:27:21.439453 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.439208    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/954670cf-545b-4939-b6c6-63c2a32be646-crio-socket\") pod \"insights-runtime-extractor-pl97h\" (UID: \"954670cf-545b-4939-b6c6-63c2a32be646\") " pod="openshift-insights/insights-runtime-extractor-pl97h"
Jul 24 19:27:21.439813 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.439702    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90-trusted-ca\") pod \"image-registry-6dbd567794-jpt64\" (UID: \"cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90\") " pod="openshift-image-registry/image-registry-6dbd567794-jpt64"
Jul 24 19:27:21.440006 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.439985    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90-registry-certificates\") pod \"image-registry-6dbd567794-jpt64\" (UID: \"cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90\") " pod="openshift-image-registry/image-registry-6dbd567794-jpt64"
Jul 24 19:27:21.443433 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.443360    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/954670cf-545b-4939-b6c6-63c2a32be646-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pl97h\" (UID: \"954670cf-545b-4939-b6c6-63c2a32be646\") " pod="openshift-insights/insights-runtime-extractor-pl97h"
Jul 24 19:27:21.443433 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.443381    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90-registry-tls\") pod \"image-registry-6dbd567794-jpt64\" (UID: \"cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90\") " pod="openshift-image-registry/image-registry-6dbd567794-jpt64"
Jul 24 19:27:21.443433 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.443361    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90-image-registry-private-configuration\") pod \"image-registry-6dbd567794-jpt64\" (UID: \"cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90\") " pod="openshift-image-registry/image-registry-6dbd567794-jpt64"
Jul 24 19:27:21.443433 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.443413    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90-installation-pull-secrets\") pod \"image-registry-6dbd567794-jpt64\" (UID: \"cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90\") " pod="openshift-image-registry/image-registry-6dbd567794-jpt64"
Jul 24 19:27:21.443433 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.443417    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dbf25fcb-e1f7-4b38-aa66-c87a829df526-cert\") pod \"ingress-canary-lrf4t\" (UID: \"dbf25fcb-e1f7-4b38-aa66-c87a829df526\") " pod="openshift-ingress-canary/ingress-canary-lrf4t"
Jul 24 19:27:21.447262 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.447212    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjsvp\" (UniqueName: \"kubernetes.io/projected/dbf25fcb-e1f7-4b38-aa66-c87a829df526-kube-api-access-xjsvp\") pod \"ingress-canary-lrf4t\" (UID: \"dbf25fcb-e1f7-4b38-aa66-c87a829df526\") " pod="openshift-ingress-canary/ingress-canary-lrf4t"
Jul 24 19:27:21.447544 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.447524    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90-bound-sa-token\") pod \"image-registry-6dbd567794-jpt64\" (UID: \"cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90\") " pod="openshift-image-registry/image-registry-6dbd567794-jpt64"
Jul 24 19:27:21.447666 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.447644    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gw4z\" (UniqueName: \"kubernetes.io/projected/954670cf-545b-4939-b6c6-63c2a32be646-kube-api-access-8gw4z\") pod \"insights-runtime-extractor-pl97h\" (UID: \"954670cf-545b-4939-b6c6-63c2a32be646\") " pod="openshift-insights/insights-runtime-extractor-pl97h"
Jul 24 19:27:21.448040 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.448023    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvkp6\" (UniqueName: \"kubernetes.io/projected/cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90-kube-api-access-zvkp6\") pod \"image-registry-6dbd567794-jpt64\" (UID: \"cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90\") " pod="openshift-image-registry/image-registry-6dbd567794-jpt64"
Jul 24 19:27:21.469164 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.469131    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dbd567794-jpt64"
Jul 24 19:27:21.482827 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.482801    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pl97h"
Jul 24 19:27:21.500859 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.500716    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lrf4t"
Jul 24 19:27:21.540031 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.539996    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e143a2cc-07ac-4ca4-917a-493cd1053866-tmp-dir\") pod \"dns-default-gcmpj\" (UID: \"e143a2cc-07ac-4ca4-917a-493cd1053866\") " pod="openshift-dns/dns-default-gcmpj"
Jul 24 19:27:21.540198 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.540049    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jj6r\" (UniqueName: \"kubernetes.io/projected/e143a2cc-07ac-4ca4-917a-493cd1053866-kube-api-access-5jj6r\") pod \"dns-default-gcmpj\" (UID: \"e143a2cc-07ac-4ca4-917a-493cd1053866\") " pod="openshift-dns/dns-default-gcmpj"
Jul 24 19:27:21.540198 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.540109    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e143a2cc-07ac-4ca4-917a-493cd1053866-metrics-tls\") pod \"dns-default-gcmpj\" (UID: \"e143a2cc-07ac-4ca4-917a-493cd1053866\") " pod="openshift-dns/dns-default-gcmpj"
Jul 24 19:27:21.540198 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.540139    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e143a2cc-07ac-4ca4-917a-493cd1053866-config-volume\") pod \"dns-default-gcmpj\" (UID: \"e143a2cc-07ac-4ca4-917a-493cd1053866\") " pod="openshift-dns/dns-default-gcmpj"
Jul 24 19:27:21.540363 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.540344    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e143a2cc-07ac-4ca4-917a-493cd1053866-tmp-dir\") pod \"dns-default-gcmpj\" (UID: \"e143a2cc-07ac-4ca4-917a-493cd1053866\") " pod="openshift-dns/dns-default-gcmpj"
Jul 24 19:27:21.541011 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.540971    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e143a2cc-07ac-4ca4-917a-493cd1053866-config-volume\") pod \"dns-default-gcmpj\" (UID: \"e143a2cc-07ac-4ca4-917a-493cd1053866\") " pod="openshift-dns/dns-default-gcmpj"
Jul 24 19:27:21.542998 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.542971    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e143a2cc-07ac-4ca4-917a-493cd1053866-metrics-tls\") pod \"dns-default-gcmpj\" (UID: \"e143a2cc-07ac-4ca4-917a-493cd1053866\") " pod="openshift-dns/dns-default-gcmpj"
Jul 24 19:27:21.548269 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.548248    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jj6r\" (UniqueName: \"kubernetes.io/projected/e143a2cc-07ac-4ca4-917a-493cd1053866-kube-api-access-5jj6r\") pod \"dns-default-gcmpj\" (UID: \"e143a2cc-07ac-4ca4-917a-493cd1053866\") " pod="openshift-dns/dns-default-gcmpj"
Jul 24 19:27:21.571564 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.571502    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gcmpj"
Jul 24 19:27:21.671221 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.671049    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pl97h"]
Jul 24 19:27:21.675834 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:27:21.675801    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod954670cf_545b_4939_b6c6_63c2a32be646.slice/crio-5138b2ada69d218348b1872ab89b71d72cc1cea2f3dc81e43525f9ecb4b5cdcb WatchSource:0}: Error finding container 5138b2ada69d218348b1872ab89b71d72cc1cea2f3dc81e43525f9ecb4b5cdcb: Status 404 returned error can't find the container with id 5138b2ada69d218348b1872ab89b71d72cc1cea2f3dc81e43525f9ecb4b5cdcb
Jul 24 19:27:21.678221 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.678190    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6dbd567794-jpt64"]
Jul 24 19:27:21.681547 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.681464    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lrf4t"]
Jul 24 19:27:21.685143 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:27:21.685111    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbf25fcb_e1f7_4b38_aa66_c87a829df526.slice/crio-32b6611424fd4199a9ddfb602956b9b9b748c26aaedc1ab295c68c0bd5ef0cce WatchSource:0}: Error finding container 32b6611424fd4199a9ddfb602956b9b9b748c26aaedc1ab295c68c0bd5ef0cce: Status 404 returned error can't find the container with id 32b6611424fd4199a9ddfb602956b9b9b748c26aaedc1ab295c68c0bd5ef0cce
Jul 24 19:27:21.685881 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:27:21.685847    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcffc2cc7_f0ca_4b98_a0b2_58fdfbdd2e90.slice/crio-98664d61addab67b85ab44ef8ffa998ae0c1221b18be989944631efa02921707 WatchSource:0}: Error finding container 98664d61addab67b85ab44ef8ffa998ae0c1221b18be989944631efa02921707: Status 404 returned error can't find the container with id 98664d61addab67b85ab44ef8ffa998ae0c1221b18be989944631efa02921707
Jul 24 19:27:21.747662 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:21.747636    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gcmpj"]
Jul 24 19:27:21.750966 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:27:21.750942    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode143a2cc_07ac_4ca4_917a_493cd1053866.slice/crio-4d225b4bd94c7a4c1806ca2ee99f2bcfea7721cb3120683e335d0b060a09a87a WatchSource:0}: Error finding container 4d225b4bd94c7a4c1806ca2ee99f2bcfea7721cb3120683e335d0b060a09a87a: Status 404 returned error can't find the container with id 4d225b4bd94c7a4c1806ca2ee99f2bcfea7721cb3120683e335d0b060a09a87a
Jul 24 19:27:22.643182 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:22.643071    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pl97h" event={"ID":"954670cf-545b-4939-b6c6-63c2a32be646","Type":"ContainerStarted","Data":"5138b2ada69d218348b1872ab89b71d72cc1cea2f3dc81e43525f9ecb4b5cdcb"}
Jul 24 19:27:22.646200 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:22.646167    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gcmpj" event={"ID":"e143a2cc-07ac-4ca4-917a-493cd1053866","Type":"ContainerStarted","Data":"4d225b4bd94c7a4c1806ca2ee99f2bcfea7721cb3120683e335d0b060a09a87a"}
Jul 24 19:27:22.647702 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:22.647671    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lrf4t" event={"ID":"dbf25fcb-e1f7-4b38-aa66-c87a829df526","Type":"ContainerStarted","Data":"32b6611424fd4199a9ddfb602956b9b9b748c26aaedc1ab295c68c0bd5ef0cce"}
Jul 24 19:27:22.650841 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:22.650813    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dbd567794-jpt64" event={"ID":"cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90","Type":"ContainerStarted","Data":"c4c67b80989b5f801dd648affb13c700f70d82636033b3c2b57395f82f11a906"}
Jul 24 19:27:22.650954 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:22.650862    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dbd567794-jpt64" event={"ID":"cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90","Type":"ContainerStarted","Data":"98664d61addab67b85ab44ef8ffa998ae0c1221b18be989944631efa02921707"}
Jul 24 19:27:22.651636 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:22.651596    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6dbd567794-jpt64"
Jul 24 19:27:22.672156 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:22.672108    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6dbd567794-jpt64" podStartSLOduration=6.672092465 podStartE2EDuration="6.672092465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:27:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:27:22.67108266 +0000 UTC m=+40.860156975" watchObservedRunningTime="2026-07-24 19:27:22.672092465 +0000 UTC m=+40.861166777"
Jul 24 19:27:28.670062 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:28.670025    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gcmpj" event={"ID":"e143a2cc-07ac-4ca4-917a-493cd1053866","Type":"ContainerStarted","Data":"78fceb9d9db341d761446c98c270c5502a5d2816733c4a1cf1923728e14ef333"}
Jul 24 19:27:28.671940 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:28.671914    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lrf4t" event={"ID":"dbf25fcb-e1f7-4b38-aa66-c87a829df526","Type":"ContainerStarted","Data":"7673f586b4109f4cd204054795ae547421fa623683f3314fcc54754bcd5f20f1"}
Jul 24 19:27:28.689533 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:28.689456    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lrf4t" podStartSLOduration=0.907065518 podStartE2EDuration="7.689435969s" totalImagesPullingTime="6.782370451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:27:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:27:28.689008172 +0000 UTC m=+46.878082486" watchObservedRunningTime="2026-07-24 19:27:28.689435969 +0000 UTC m=+46.878510275"
Jul 24 19:27:29.677947 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:29.677904    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pl97h" event={"ID":"954670cf-545b-4939-b6c6-63c2a32be646","Type":"ContainerStarted","Data":"05b7a5f78801495a515efd9f7483b1f07be8ddd0e94fbbbd2f49da073c348d08"}
Jul 24 19:27:29.680108 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:29.680080    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gcmpj" event={"ID":"e143a2cc-07ac-4ca4-917a-493cd1053866","Type":"ContainerStarted","Data":"518a1fecc3d7e98f88c234c214f60656f611fb90bea54b29c8abe1aedb59ff42"}
Jul 24 19:27:29.698584 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:29.698535    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gcmpj" podStartSLOduration=1.98170716 podStartE2EDuration="8.698519903s" totalImagesPullingTime="6.716812743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:27:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:27:29.697175701 +0000 UTC m=+47.886250026" watchObservedRunningTime="2026-07-24 19:27:29.698519903 +0000 UTC m=+47.887594216"
Jul 24 19:27:30.683818 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:30.683787    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gcmpj"
Jul 24 19:27:33.704815 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:33.704755    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pl97h" event={"ID":"954670cf-545b-4939-b6c6-63c2a32be646","Type":"ContainerStarted","Data":"bd8dc04151bf9fbfff115ffa07bb44bf9e2c83b189aa553fc2224e7b494a15df"}
Jul 24 19:27:36.716180 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:36.716138    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pl97h" event={"ID":"954670cf-545b-4939-b6c6-63c2a32be646","Type":"ContainerStarted","Data":"99362ce6b512f2ed501b4cee9fe621c3fdbb273e1f3b7c3eaa465b84d4100a85"}
Jul 24 19:27:36.735981 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:36.735933    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pl97h" podStartSLOduration=1.021926407 podStartE2EDuration="15.735918917s" totalImagesPullingTime="14.71399251s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:27:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:27:36.734634202 +0000 UTC m=+54.923708515" watchObservedRunningTime="2026-07-24 19:27:36.735918917 +0000 UTC m=+54.924993229"
Jul 24 19:27:40.698104 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:40.698067    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gcmpj"
Jul 24 19:27:41.473404 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:41.473370    2579 patch_prober.go:28] interesting pod/image-registry-6dbd567794-jpt64 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 24 19:27:41.473607 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:41.473421    2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6dbd567794-jpt64" podUID="cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 19:27:43.616281 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:43.616245    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vclnd"
Jul 24 19:27:44.662123 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:44.662092    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6dbd567794-jpt64"
Jul 24 19:27:48.060198 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:48.060158    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/088489c0-3c4a-4b1d-8724-d9ca828ea309-metrics-certs\") pod \"network-metrics-daemon-slw87\" (UID: \"088489c0-3c4a-4b1d-8724-d9ca828ea309\") " pod="openshift-multus/network-metrics-daemon-slw87"
Jul 24 19:27:48.060652 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:48.060223    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/73db2676-b431-4046-8290-c4813da2ee8a-original-pull-secret\") pod \"global-pull-secret-syncer-gkd6m\" (UID: \"73db2676-b431-4046-8290-c4813da2ee8a\") " pod="kube-system/global-pull-secret-syncer-gkd6m"
Jul 24 19:27:48.062710 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:48.062692    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 19:27:48.062774 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:48.062747    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 19:27:48.074003 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:48.073980    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/088489c0-3c4a-4b1d-8724-d9ca828ea309-metrics-certs\") pod \"network-metrics-daemon-slw87\" (UID: \"088489c0-3c4a-4b1d-8724-d9ca828ea309\") " pod="openshift-multus/network-metrics-daemon-slw87"
Jul 24 19:27:48.074090 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:48.074063    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/73db2676-b431-4046-8290-c4813da2ee8a-original-pull-secret\") pod \"global-pull-secret-syncer-gkd6m\" (UID: \"73db2676-b431-4046-8290-c4813da2ee8a\") " pod="kube-system/global-pull-secret-syncer-gkd6m"
Jul 24 19:27:48.077089 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:48.077069    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ln4l7\""
Jul 24 19:27:48.081147 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:48.081127    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gkd6m"
Jul 24 19:27:48.085259 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:48.085238    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slw87"
Jul 24 19:27:48.224387 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:48.224356    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-slw87"]
Jul 24 19:27:48.227287 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:27:48.227260    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod088489c0_3c4a_4b1d_8724_d9ca828ea309.slice/crio-7e06fe110ff586395976de96afb15cd2f5ba08930e9400212102f0ee675d151b WatchSource:0}: Error finding container 7e06fe110ff586395976de96afb15cd2f5ba08930e9400212102f0ee675d151b: Status 404 returned error can't find the container with id 7e06fe110ff586395976de96afb15cd2f5ba08930e9400212102f0ee675d151b
Jul 24 19:27:48.240715 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:48.240687    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gkd6m"]
Jul 24 19:27:48.243245 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:27:48.243221    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73db2676_b431_4046_8290_c4813da2ee8a.slice/crio-7d6ed62c8518337777a0dbe202d58c8c153c7b48242e05bc81c6334c37703249 WatchSource:0}: Error finding container 7d6ed62c8518337777a0dbe202d58c8c153c7b48242e05bc81c6334c37703249: Status 404 returned error can't find the container with id 7d6ed62c8518337777a0dbe202d58c8c153c7b48242e05bc81c6334c37703249
Jul 24 19:27:48.262144 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:48.262117    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsvb4\" (UniqueName: \"kubernetes.io/projected/8417d154-2680-412f-b5dc-c9980030f61b-kube-api-access-lsvb4\") pod \"network-check-target-v4htc\" (UID: \"8417d154-2680-412f-b5dc-c9980030f61b\") " pod="openshift-network-diagnostics/network-check-target-v4htc"
Jul 24 19:27:48.264552 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:48.264536    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 19:27:48.274728 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:48.274706    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 19:27:48.285291 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:48.285271    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsvb4\" (UniqueName: \"kubernetes.io/projected/8417d154-2680-412f-b5dc-c9980030f61b-kube-api-access-lsvb4\") pod \"network-check-target-v4htc\" (UID: \"8417d154-2680-412f-b5dc-c9980030f61b\") " pod="openshift-network-diagnostics/network-check-target-v4htc"
Jul 24 19:27:48.388000 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:48.387932    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nz88f\""
Jul 24 19:27:48.396076 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:48.396059    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4htc"
Jul 24 19:27:48.549699 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:48.549673    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-v4htc"]
Jul 24 19:27:48.552768 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:27:48.552742    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8417d154_2680_412f_b5dc_c9980030f61b.slice/crio-32fc4901efe61b0dd6b9b9043e3bd67f1c761ce998a2c3a290ebbf0e980af3d0 WatchSource:0}: Error finding container 32fc4901efe61b0dd6b9b9043e3bd67f1c761ce998a2c3a290ebbf0e980af3d0: Status 404 returned error can't find the container with id 32fc4901efe61b0dd6b9b9043e3bd67f1c761ce998a2c3a290ebbf0e980af3d0
Jul 24 19:27:48.754022 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:48.753984    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-v4htc" event={"ID":"8417d154-2680-412f-b5dc-c9980030f61b","Type":"ContainerStarted","Data":"32fc4901efe61b0dd6b9b9043e3bd67f1c761ce998a2c3a290ebbf0e980af3d0"}
Jul 24 19:27:48.756431 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:48.756401    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-slw87" event={"ID":"088489c0-3c4a-4b1d-8724-d9ca828ea309","Type":"ContainerStarted","Data":"7e06fe110ff586395976de96afb15cd2f5ba08930e9400212102f0ee675d151b"}
Jul 24 19:27:48.757919 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:48.757889    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gkd6m" event={"ID":"73db2676-b431-4046-8290-c4813da2ee8a","Type":"ContainerStarted","Data":"7d6ed62c8518337777a0dbe202d58c8c153c7b48242e05bc81c6334c37703249"}
Jul 24 19:27:50.770760 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:50.769960    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-slw87" event={"ID":"088489c0-3c4a-4b1d-8724-d9ca828ea309","Type":"ContainerStarted","Data":"dfa6c1c6f451505a9003f745e34cff712d0d92a6d9cd1ecade03f37d976c9c3b"}
Jul 24 19:27:50.770760 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:50.770038    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-slw87" event={"ID":"088489c0-3c4a-4b1d-8724-d9ca828ea309","Type":"ContainerStarted","Data":"da3ca49ef7b47cc8a235e2e9b63cfdc755e305a255c67219a61f5661f619d98e"}
Jul 24 19:27:51.746306 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.746242    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-slw87" podStartSLOduration=67.298999306 podStartE2EDuration="1m8.74621996s" totalImagesPullingTime="1.447220654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:26:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:27:50.790263102 +0000 UTC m=+68.979337418" watchObservedRunningTime="2026-07-24 19:27:51.74621996 +0000 UTC m=+69.935294274"
Jul 24 19:27:51.746494 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.746444    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-p9r7q"]
Jul 24 19:27:51.748739 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.748708    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-p9r7q"
Jul 24 19:27:51.752093 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.751656    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 24 19:27:51.752093 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.751958    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 24 19:27:51.753520 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.753496    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 24 19:27:51.754254 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.753713    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 24 19:27:51.754254 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.753916    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-882g4\""
Jul 24 19:27:51.754254 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.754094    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 24 19:27:51.782595 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.782567    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-p9r7q"]
Jul 24 19:27:51.788590 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.788566    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cb1831e3-c869-460e-9a83-f1e89cdcd60e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-p9r7q\" (UID: \"cb1831e3-c869-460e-9a83-f1e89cdcd60e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-p9r7q"
Jul 24 19:27:51.788772 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.788608    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb1831e3-c869-460e-9a83-f1e89cdcd60e-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-p9r7q\" (UID: \"cb1831e3-c869-460e-9a83-f1e89cdcd60e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-p9r7q"
Jul 24 19:27:51.788772 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.788649    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb1831e3-c869-460e-9a83-f1e89cdcd60e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-p9r7q\" (UID: \"cb1831e3-c869-460e-9a83-f1e89cdcd60e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-p9r7q"
Jul 24 19:27:51.788772 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.788717    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h26mp\" (UniqueName: \"kubernetes.io/projected/cb1831e3-c869-460e-9a83-f1e89cdcd60e-kube-api-access-h26mp\") pod \"openshift-state-metrics-b8f49f5c6-p9r7q\" (UID: \"cb1831e3-c869-460e-9a83-f1e89cdcd60e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-p9r7q"
Jul 24 19:27:51.813916 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.813878    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tccp4"]
Jul 24 19:27:51.816194 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.816168    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tccp4"
Jul 24 19:27:51.820629 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.820597    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 24 19:27:51.820784 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.820634    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 24 19:27:51.820784 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.820593    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 24 19:27:51.820784 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.820745    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tdkbv\""
Jul 24 19:27:51.889743 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.889692    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f8f9659f-393d-44e8-9868-2fadd68ed84e-node-exporter-wtmp\") pod \"node-exporter-tccp4\" (UID: \"f8f9659f-393d-44e8-9868-2fadd68ed84e\") " pod="openshift-monitoring/node-exporter-tccp4"
Jul 24 19:27:51.889918 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.889748    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kz7n\" (UniqueName: \"kubernetes.io/projected/f8f9659f-393d-44e8-9868-2fadd68ed84e-kube-api-access-5kz7n\") pod \"node-exporter-tccp4\" (UID: \"f8f9659f-393d-44e8-9868-2fadd68ed84e\") " pod="openshift-monitoring/node-exporter-tccp4"
Jul 24 19:27:51.889918 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.889804    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb1831e3-c869-460e-9a83-f1e89cdcd60e-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-p9r7q\" (UID: \"cb1831e3-c869-460e-9a83-f1e89cdcd60e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-p9r7q"
Jul 24 19:27:51.889918 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.889830    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f8f9659f-393d-44e8-9868-2fadd68ed84e-root\") pod \"node-exporter-tccp4\" (UID: \"f8f9659f-393d-44e8-9868-2fadd68ed84e\") " pod="openshift-monitoring/node-exporter-tccp4"
Jul 24 19:27:51.890077 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.889956    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb1831e3-c869-460e-9a83-f1e89cdcd60e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-p9r7q\" (UID: \"cb1831e3-c869-460e-9a83-f1e89cdcd60e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-p9r7q"
Jul 24 19:27:51.890077 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.889978    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8f9659f-393d-44e8-9868-2fadd68ed84e-metrics-client-ca\") pod \"node-exporter-tccp4\" (UID: \"f8f9659f-393d-44e8-9868-2fadd68ed84e\") " pod="openshift-monitoring/node-exporter-tccp4"
Jul 24 19:27:51.890077 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.890039    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h26mp\" (UniqueName: \"kubernetes.io/projected/cb1831e3-c869-460e-9a83-f1e89cdcd60e-kube-api-access-h26mp\") pod \"openshift-state-metrics-b8f49f5c6-p9r7q\" (UID: \"cb1831e3-c869-460e-9a83-f1e89cdcd60e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-p9r7q"
Jul 24 19:27:51.890220 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.890164    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f8f9659f-393d-44e8-9868-2fadd68ed84e-node-exporter-textfile\") pod \"node-exporter-tccp4\" (UID: \"f8f9659f-393d-44e8-9868-2fadd68ed84e\") " pod="openshift-monitoring/node-exporter-tccp4"
Jul 24 19:27:51.890220 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.890208    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f8f9659f-393d-44e8-9868-2fadd68ed84e-node-exporter-accelerators-collector-config\") pod \"node-exporter-tccp4\" (UID: \"f8f9659f-393d-44e8-9868-2fadd68ed84e\") " pod="openshift-monitoring/node-exporter-tccp4"
Jul 24 19:27:51.890300 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:51.890221    2579 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 24 19:27:51.890300 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.890265    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8f9659f-393d-44e8-9868-2fadd68ed84e-sys\") pod \"node-exporter-tccp4\" (UID: \"f8f9659f-393d-44e8-9868-2fadd68ed84e\") " pod="openshift-monitoring/node-exporter-tccp4"
Jul 24 19:27:51.890300 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:51.890293    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb1831e3-c869-460e-9a83-f1e89cdcd60e-openshift-state-metrics-tls podName:cb1831e3-c869-460e-9a83-f1e89cdcd60e nodeName:}" failed. No retries permitted until 2026-07-24 19:27:52.390269736 +0000 UTC m=+70.579344051 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/cb1831e3-c869-460e-9a83-f1e89cdcd60e-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-p9r7q" (UID: "cb1831e3-c869-460e-9a83-f1e89cdcd60e") : secret "openshift-state-metrics-tls" not found
Jul 24 19:27:51.890503 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.890482    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cb1831e3-c869-460e-9a83-f1e89cdcd60e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-p9r7q\" (UID: \"cb1831e3-c869-460e-9a83-f1e89cdcd60e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-p9r7q"
Jul 24 19:27:51.890560 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.890520    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8f9659f-393d-44e8-9868-2fadd68ed84e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tccp4\" (UID: \"f8f9659f-393d-44e8-9868-2fadd68ed84e\") " pod="openshift-monitoring/node-exporter-tccp4"
Jul 24 19:27:51.890619 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.890557    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f8f9659f-393d-44e8-9868-2fadd68ed84e-node-exporter-tls\") pod \"node-exporter-tccp4\" (UID: \"f8f9659f-393d-44e8-9868-2fadd68ed84e\") " pod="openshift-monitoring/node-exporter-tccp4"
Jul 24 19:27:51.890701 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.890669    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb1831e3-c869-460e-9a83-f1e89cdcd60e-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-p9r7q\" (UID: \"cb1831e3-c869-460e-9a83-f1e89cdcd60e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-p9r7q"
Jul 24 19:27:51.893200 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.893174    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cb1831e3-c869-460e-9a83-f1e89cdcd60e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-p9r7q\" (UID: \"cb1831e3-c869-460e-9a83-f1e89cdcd60e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-p9r7q"
Jul 24 19:27:51.905315 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.905288    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h26mp\" (UniqueName: \"kubernetes.io/projected/cb1831e3-c869-460e-9a83-f1e89cdcd60e-kube-api-access-h26mp\") pod \"openshift-state-metrics-b8f49f5c6-p9r7q\" (UID: \"cb1831e3-c869-460e-9a83-f1e89cdcd60e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-p9r7q"
Jul 24 19:27:51.991943 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.991906    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f8f9659f-393d-44e8-9868-2fadd68ed84e-root\") pod \"node-exporter-tccp4\" (UID: \"f8f9659f-393d-44e8-9868-2fadd68ed84e\") " pod="openshift-monitoring/node-exporter-tccp4"
Jul 24 19:27:51.992142 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.991959    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8f9659f-393d-44e8-9868-2fadd68ed84e-metrics-client-ca\") pod \"node-exporter-tccp4\" (UID: \"f8f9659f-393d-44e8-9868-2fadd68ed84e\") " pod="openshift-monitoring/node-exporter-tccp4"
Jul 24 19:27:51.992142 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.991982    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f8f9659f-393d-44e8-9868-2fadd68ed84e-node-exporter-textfile\") pod \"node-exporter-tccp4\" (UID: \"f8f9659f-393d-44e8-9868-2fadd68ed84e\") " pod="openshift-monitoring/node-exporter-tccp4"
Jul 24 19:27:51.992142 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.992011    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f8f9659f-393d-44e8-9868-2fadd68ed84e-node-exporter-accelerators-collector-config\") pod \"node-exporter-tccp4\" (UID: \"f8f9659f-393d-44e8-9868-2fadd68ed84e\") " pod="openshift-monitoring/node-exporter-tccp4"
Jul 24 19:27:51.992142 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.992044    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8f9659f-393d-44e8-9868-2fadd68ed84e-sys\") pod \"node-exporter-tccp4\" (UID: \"f8f9659f-393d-44e8-9868-2fadd68ed84e\") " pod="openshift-monitoring/node-exporter-tccp4"
Jul 24 19:27:51.992142 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.992068    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8f9659f-393d-44e8-9868-2fadd68ed84e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tccp4\" (UID: \"f8f9659f-393d-44e8-9868-2fadd68ed84e\") " pod="openshift-monitoring/node-exporter-tccp4"
Jul 24 19:27:51.992142 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.992102    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f8f9659f-393d-44e8-9868-2fadd68ed84e-node-exporter-tls\") pod \"node-exporter-tccp4\" (UID: \"f8f9659f-393d-44e8-9868-2fadd68ed84e\") " pod="openshift-monitoring/node-exporter-tccp4"
Jul 24 19:27:51.992142 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.992043    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f8f9659f-393d-44e8-9868-2fadd68ed84e-root\") pod \"node-exporter-tccp4\" (UID: \"f8f9659f-393d-44e8-9868-2fadd68ed84e\") " pod="openshift-monitoring/node-exporter-tccp4"
Jul 24 19:27:51.992496 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.992150    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f8f9659f-393d-44e8-9868-2fadd68ed84e-node-exporter-wtmp\") pod \"node-exporter-tccp4\" (UID: \"f8f9659f-393d-44e8-9868-2fadd68ed84e\") " pod="openshift-monitoring/node-exporter-tccp4"
Jul 24 19:27:51.992496 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.992176    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kz7n\" (UniqueName: \"kubernetes.io/projected/f8f9659f-393d-44e8-9868-2fadd68ed84e-kube-api-access-5kz7n\") pod \"node-exporter-tccp4\" (UID: \"f8f9659f-393d-44e8-9868-2fadd68ed84e\") " pod="openshift-monitoring/node-exporter-tccp4"
Jul 24 19:27:51.992496 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.992355    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f8f9659f-393d-44e8-9868-2fadd68ed84e-node-exporter-textfile\") pod \"node-exporter-tccp4\" (UID: \"f8f9659f-393d-44e8-9868-2fadd68ed84e\") " pod="openshift-monitoring/node-exporter-tccp4"
Jul 24 19:27:51.992496 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.992406    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8f9659f-393d-44e8-9868-2fadd68ed84e-sys\") pod \"node-exporter-tccp4\" (UID: \"f8f9659f-393d-44e8-9868-2fadd68ed84e\") " pod="openshift-monitoring/node-exporter-tccp4"
Jul 24 19:27:51.992496 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.992415    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f8f9659f-393d-44e8-9868-2fadd68ed84e-node-exporter-wtmp\") pod \"node-exporter-tccp4\" (UID: \"f8f9659f-393d-44e8-9868-2fadd68ed84e\") " pod="openshift-monitoring/node-exporter-tccp4"
Jul 24 19:27:51.992779 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.992636    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f8f9659f-393d-44e8-9868-2fadd68ed84e-node-exporter-accelerators-collector-config\") pod \"node-exporter-tccp4\" (UID: \"f8f9659f-393d-44e8-9868-2fadd68ed84e\") " pod="openshift-monitoring/node-exporter-tccp4"
Jul 24 19:27:51.993025 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.993002    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8f9659f-393d-44e8-9868-2fadd68ed84e-metrics-client-ca\") pod \"node-exporter-tccp4\" (UID: \"f8f9659f-393d-44e8-9868-2fadd68ed84e\") " pod="openshift-monitoring/node-exporter-tccp4"
Jul 24 19:27:51.994874 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.994851    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8f9659f-393d-44e8-9868-2fadd68ed84e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tccp4\" (UID: \"f8f9659f-393d-44e8-9868-2fadd68ed84e\") " pod="openshift-monitoring/node-exporter-tccp4"
Jul 24 19:27:51.995043 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:51.995023    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f8f9659f-393d-44e8-9868-2fadd68ed84e-node-exporter-tls\") pod \"node-exporter-tccp4\" (UID: \"f8f9659f-393d-44e8-9868-2fadd68ed84e\") " pod="openshift-monitoring/node-exporter-tccp4"
Jul 24 19:27:52.004508 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:52.004483    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kz7n\" (UniqueName: \"kubernetes.io/projected/f8f9659f-393d-44e8-9868-2fadd68ed84e-kube-api-access-5kz7n\") pod \"node-exporter-tccp4\" (UID: \"f8f9659f-393d-44e8-9868-2fadd68ed84e\") " pod="openshift-monitoring/node-exporter-tccp4"
Jul 24 19:27:52.126930 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:52.126897    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tccp4"
Jul 24 19:27:52.395263 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:52.395181    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb1831e3-c869-460e-9a83-f1e89cdcd60e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-p9r7q\" (UID: \"cb1831e3-c869-460e-9a83-f1e89cdcd60e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-p9r7q"
Jul 24 19:27:52.398217 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:52.398180    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb1831e3-c869-460e-9a83-f1e89cdcd60e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-p9r7q\" (UID: \"cb1831e3-c869-460e-9a83-f1e89cdcd60e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-p9r7q"
Jul 24 19:27:52.661390 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:52.661312    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-p9r7q"
Jul 24 19:27:53.073384 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:27:53.073349    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8f9659f_393d_44e8_9868_2fadd68ed84e.slice/crio-cad93e63c75b77ec112db932b2e335fcac79e526684ce5e8aacffc9d44ed29b0 WatchSource:0}: Error finding container cad93e63c75b77ec112db932b2e335fcac79e526684ce5e8aacffc9d44ed29b0: Status 404 returned error can't find the container with id cad93e63c75b77ec112db932b2e335fcac79e526684ce5e8aacffc9d44ed29b0
Jul 24 19:27:53.212794 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:53.212549    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-p9r7q"]
Jul 24 19:27:53.216219 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:27:53.216184    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb1831e3_c869_460e_9a83_f1e89cdcd60e.slice/crio-1c74ae0ca77905c43b0d415aec645cda2392fe7f0ba6d8f82db5759c0facfaf9 WatchSource:0}: Error finding container 1c74ae0ca77905c43b0d415aec645cda2392fe7f0ba6d8f82db5759c0facfaf9: Status 404 returned error can't find the container with id 1c74ae0ca77905c43b0d415aec645cda2392fe7f0ba6d8f82db5759c0facfaf9
Jul 24 19:27:53.784128 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:53.784092    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-p9r7q" event={"ID":"cb1831e3-c869-460e-9a83-f1e89cdcd60e","Type":"ContainerStarted","Data":"4dca84e1f1b5c56521b8e9d833ecae1e255556566888c1f532ed95248d01b0d4"}
Jul 24 19:27:53.784325 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:53.784163    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-p9r7q" event={"ID":"cb1831e3-c869-460e-9a83-f1e89cdcd60e","Type":"ContainerStarted","Data":"8074c25e420ccab8999e7fd5522ae84a5d25fe360d2cf3a76afa6ec568e3996b"}
Jul 24 19:27:53.784325 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:53.784199    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-p9r7q" event={"ID":"cb1831e3-c869-460e-9a83-f1e89cdcd60e","Type":"ContainerStarted","Data":"1c74ae0ca77905c43b0d415aec645cda2392fe7f0ba6d8f82db5759c0facfaf9"}
Jul 24 19:27:53.785896 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:53.785864    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-v4htc" event={"ID":"8417d154-2680-412f-b5dc-c9980030f61b","Type":"ContainerStarted","Data":"8df0022202ccdfc26db28f078ba25a1ca97aeff2cf49762187f8f2da0acc60b7"}
Jul 24 19:27:53.786015 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:53.785994    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-v4htc"
Jul 24 19:27:53.787434 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:53.787411    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tccp4" event={"ID":"f8f9659f-393d-44e8-9868-2fadd68ed84e","Type":"ContainerStarted","Data":"cad93e63c75b77ec112db932b2e335fcac79e526684ce5e8aacffc9d44ed29b0"}
Jul 24 19:27:53.788972 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:53.788947    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gkd6m" event={"ID":"73db2676-b431-4046-8290-c4813da2ee8a","Type":"ContainerStarted","Data":"766cc5f00d1d97840988c25f3a905204d21b98cc0b70c6974b0cee8a1d96741e"}
Jul 24 19:27:53.808095 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:53.808045    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-v4htc" podStartSLOduration=66.288903966 podStartE2EDuration="1m10.808031715s" totalImagesPullingTime="4.519127749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:26:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:27:53.806459781 +0000 UTC m=+71.995534094" watchObservedRunningTime="2026-07-24 19:27:53.808031715 +0000 UTC m=+71.997106027"
Jul 24 19:27:54.793889 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:54.793799    2579 generic.go:356] "Generic (PLEG): container finished" podID="f8f9659f-393d-44e8-9868-2fadd68ed84e" containerID="212442d61e913ee477d0eef29d2c18a2da33d03c30881088e6a09090a68060ff" exitCode=0
Jul 24 19:27:54.794306 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:54.793879    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tccp4" event={"ID":"f8f9659f-393d-44e8-9868-2fadd68ed84e","Type":"ContainerDied","Data":"212442d61e913ee477d0eef29d2c18a2da33d03c30881088e6a09090a68060ff"}
Jul 24 19:27:54.799092 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:54.799062    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-p9r7q" event={"ID":"cb1831e3-c869-460e-9a83-f1e89cdcd60e","Type":"ContainerStarted","Data":"9c3dd9c3e93d66c3a164070f0cd860edc32f30ab712fb9c6818bddff583ce601"}
Jul 24 19:27:54.817371 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:54.817316    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gkd6m" podStartSLOduration=66.975863374 podStartE2EDuration="1m11.817295833s" totalImagesPullingTime="4.841432459s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:26:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:27:53.827098243 +0000 UTC m=+72.016172556" watchObservedRunningTime="2026-07-24 19:27:54.817295833 +0000 UTC m=+73.006370144"
Jul 24 19:27:54.837630 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:54.837584    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-p9r7q" podStartSLOduration=2.650085031 podStartE2EDuration="3.837567785s" totalImagesPullingTime="1.187482754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:27:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:27:54.836668207 +0000 UTC m=+73.025742520" watchObservedRunningTime="2026-07-24 19:27:54.837567785 +0000 UTC m=+73.026642098"
Jul 24 19:27:54.842029 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:54.842005    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-55567cf595-p7tz9"]
Jul 24 19:27:54.846614 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:54.846596    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-55567cf595-p7tz9"
Jul 24 19:27:54.849104 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:54.849081    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 24 19:27:54.849186 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:54.849108    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 24 19:27:54.849186 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:54.849109    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 24 19:27:54.849647 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:54.849628    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-46q7t\""
Jul 24 19:27:54.849771 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:54.849669    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 24 19:27:54.849771 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:54.849690    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-a0ir8ecog4imj\""
Jul 24 19:27:54.849771 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:54.849633    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 24 19:27:54.862821 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:54.862787    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-55567cf595-p7tz9"]
Jul 24 19:27:54.911433 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:54.911408    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7a8c5fa6-637c-433c-9821-fd8e094a587f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-55567cf595-p7tz9\" (UID: \"7a8c5fa6-637c-433c-9821-fd8e094a587f\") " pod="openshift-monitoring/thanos-querier-55567cf595-p7tz9"
Jul 24 19:27:54.911536 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:54.911488    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7a8c5fa6-637c-433c-9821-fd8e094a587f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-55567cf595-p7tz9\" (UID: \"7a8c5fa6-637c-433c-9821-fd8e094a587f\") " pod="openshift-monitoring/thanos-querier-55567cf595-p7tz9"
Jul 24 19:27:54.911960 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:54.911621    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7a8c5fa6-637c-433c-9821-fd8e094a587f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-55567cf595-p7tz9\" (UID: \"7a8c5fa6-637c-433c-9821-fd8e094a587f\") " pod="openshift-monitoring/thanos-querier-55567cf595-p7tz9"
Jul 24 19:27:54.911960 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:54.911667    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7a8c5fa6-637c-433c-9821-fd8e094a587f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-55567cf595-p7tz9\" (UID: \"7a8c5fa6-637c-433c-9821-fd8e094a587f\") " pod="openshift-monitoring/thanos-querier-55567cf595-p7tz9"
Jul 24 19:27:54.911960 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:54.911744    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7a8c5fa6-637c-433c-9821-fd8e094a587f-secret-grpc-tls\") pod \"thanos-querier-55567cf595-p7tz9\" (UID: \"7a8c5fa6-637c-433c-9821-fd8e094a587f\") " pod="openshift-monitoring/thanos-querier-55567cf595-p7tz9"
Jul 24 19:27:54.911960 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:54.911801    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvm4p\" (UniqueName: \"kubernetes.io/projected/7a8c5fa6-637c-433c-9821-fd8e094a587f-kube-api-access-wvm4p\") pod \"thanos-querier-55567cf595-p7tz9\" (UID: \"7a8c5fa6-637c-433c-9821-fd8e094a587f\") " pod="openshift-monitoring/thanos-querier-55567cf595-p7tz9"
Jul 24 19:27:54.911960 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:54.911830    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7a8c5fa6-637c-433c-9821-fd8e094a587f-secret-thanos-querier-tls\") pod \"thanos-querier-55567cf595-p7tz9\" (UID: \"7a8c5fa6-637c-433c-9821-fd8e094a587f\") " pod="openshift-monitoring/thanos-querier-55567cf595-p7tz9"
Jul 24 19:27:54.911960 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:54.911894    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a8c5fa6-637c-433c-9821-fd8e094a587f-metrics-client-ca\") pod \"thanos-querier-55567cf595-p7tz9\" (UID: \"7a8c5fa6-637c-433c-9821-fd8e094a587f\") " pod="openshift-monitoring/thanos-querier-55567cf595-p7tz9"
Jul 24 19:27:55.012450 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:55.012421    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7a8c5fa6-637c-433c-9821-fd8e094a587f-secret-grpc-tls\") pod \"thanos-querier-55567cf595-p7tz9\" (UID: \"7a8c5fa6-637c-433c-9821-fd8e094a587f\") " pod="openshift-monitoring/thanos-querier-55567cf595-p7tz9"
Jul 24 19:27:55.012450 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:55.012461    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvm4p\" (UniqueName: \"kubernetes.io/projected/7a8c5fa6-637c-433c-9821-fd8e094a587f-kube-api-access-wvm4p\") pod \"thanos-querier-55567cf595-p7tz9\" (UID: \"7a8c5fa6-637c-433c-9821-fd8e094a587f\") " pod="openshift-monitoring/thanos-querier-55567cf595-p7tz9"
Jul 24 19:27:55.012653 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:55.012482    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7a8c5fa6-637c-433c-9821-fd8e094a587f-secret-thanos-querier-tls\") pod \"thanos-querier-55567cf595-p7tz9\" (UID: \"7a8c5fa6-637c-433c-9821-fd8e094a587f\") " pod="openshift-monitoring/thanos-querier-55567cf595-p7tz9"
Jul 24 19:27:55.012653 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:55.012608    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a8c5fa6-637c-433c-9821-fd8e094a587f-metrics-client-ca\") pod \"thanos-querier-55567cf595-p7tz9\" (UID: \"7a8c5fa6-637c-433c-9821-fd8e094a587f\") " pod="openshift-monitoring/thanos-querier-55567cf595-p7tz9"
Jul 24 19:27:55.012653 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:55.012649    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7a8c5fa6-637c-433c-9821-fd8e094a587f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-55567cf595-p7tz9\" (UID: \"7a8c5fa6-637c-433c-9821-fd8e094a587f\") " pod="openshift-monitoring/thanos-querier-55567cf595-p7tz9"
Jul 24 19:27:55.012848 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:55.012709    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7a8c5fa6-637c-433c-9821-fd8e094a587f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-55567cf595-p7tz9\" (UID: \"7a8c5fa6-637c-433c-9821-fd8e094a587f\") " pod="openshift-monitoring/thanos-querier-55567cf595-p7tz9"
Jul 24 19:27:55.012848 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:55.012772    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7a8c5fa6-637c-433c-9821-fd8e094a587f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-55567cf595-p7tz9\" (UID: \"7a8c5fa6-637c-433c-9821-fd8e094a587f\") " pod="openshift-monitoring/thanos-querier-55567cf595-p7tz9"
Jul 24 19:27:55.012848 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:55.012834    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7a8c5fa6-637c-433c-9821-fd8e094a587f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-55567cf595-p7tz9\" (UID: \"7a8c5fa6-637c-433c-9821-fd8e094a587f\") " pod="openshift-monitoring/thanos-querier-55567cf595-p7tz9"
Jul 24 19:27:55.013806 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:55.013780    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a8c5fa6-637c-433c-9821-fd8e094a587f-metrics-client-ca\") pod \"thanos-querier-55567cf595-p7tz9\" (UID: \"7a8c5fa6-637c-433c-9821-fd8e094a587f\") " pod="openshift-monitoring/thanos-querier-55567cf595-p7tz9"
Jul 24 19:27:55.015390 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:55.015341    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7a8c5fa6-637c-433c-9821-fd8e094a587f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-55567cf595-p7tz9\" (UID: \"7a8c5fa6-637c-433c-9821-fd8e094a587f\") " pod="openshift-monitoring/thanos-querier-55567cf595-p7tz9"
Jul 24 19:27:55.015390 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:55.015373    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7a8c5fa6-637c-433c-9821-fd8e094a587f-secret-grpc-tls\") pod \"thanos-querier-55567cf595-p7tz9\" (UID: \"7a8c5fa6-637c-433c-9821-fd8e094a587f\") " pod="openshift-monitoring/thanos-querier-55567cf595-p7tz9"
Jul 24 19:27:55.015695 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:55.015678    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7a8c5fa6-637c-433c-9821-fd8e094a587f-secret-thanos-querier-tls\") pod \"thanos-querier-55567cf595-p7tz9\" (UID: \"7a8c5fa6-637c-433c-9821-fd8e094a587f\") " pod="openshift-monitoring/thanos-querier-55567cf595-p7tz9"
Jul 24 19:27:55.015818 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:55.015795    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7a8c5fa6-637c-433c-9821-fd8e094a587f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-55567cf595-p7tz9\" (UID: \"7a8c5fa6-637c-433c-9821-fd8e094a587f\") " pod="openshift-monitoring/thanos-querier-55567cf595-p7tz9"
Jul 24 19:27:55.015856 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:55.015821    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7a8c5fa6-637c-433c-9821-fd8e094a587f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-55567cf595-p7tz9\" (UID: \"7a8c5fa6-637c-433c-9821-fd8e094a587f\") " pod="openshift-monitoring/thanos-querier-55567cf595-p7tz9"
Jul 24 19:27:55.015906 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:55.015888    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7a8c5fa6-637c-433c-9821-fd8e094a587f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-55567cf595-p7tz9\" (UID: \"7a8c5fa6-637c-433c-9821-fd8e094a587f\") " pod="openshift-monitoring/thanos-querier-55567cf595-p7tz9"
Jul 24 19:27:55.022127 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:55.022108    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvm4p\" (UniqueName: \"kubernetes.io/projected/7a8c5fa6-637c-433c-9821-fd8e094a587f-kube-api-access-wvm4p\") pod \"thanos-querier-55567cf595-p7tz9\" (UID: \"7a8c5fa6-637c-433c-9821-fd8e094a587f\") " pod="openshift-monitoring/thanos-querier-55567cf595-p7tz9"
Jul 24 19:27:55.156530 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:55.156443    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-55567cf595-p7tz9"
Jul 24 19:27:55.291416 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:55.291345    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-55567cf595-p7tz9"]
Jul 24 19:27:55.294790 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:27:55.294768    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a8c5fa6_637c_433c_9821_fd8e094a587f.slice/crio-9536f04955f5bdcee3446362789d1ffd942a3b7061257140ce4e993ab40293ff WatchSource:0}: Error finding container 9536f04955f5bdcee3446362789d1ffd942a3b7061257140ce4e993ab40293ff: Status 404 returned error can't find the container with id 9536f04955f5bdcee3446362789d1ffd942a3b7061257140ce4e993ab40293ff
Jul 24 19:27:55.804131 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:55.804092    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tccp4" event={"ID":"f8f9659f-393d-44e8-9868-2fadd68ed84e","Type":"ContainerStarted","Data":"278b2497bc3cf7bfa3c8584ba1bf433e4710e61e491298acdddfb5b66e96f3b8"}
Jul 24 19:27:55.804567 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:55.804160    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tccp4" event={"ID":"f8f9659f-393d-44e8-9868-2fadd68ed84e","Type":"ContainerStarted","Data":"004f737ba7a6e31e51428a0071122bae310cb6c1ce97c09f0b8d3d647bed8e6f"}
Jul 24 19:27:55.805352 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:55.805328    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55567cf595-p7tz9" event={"ID":"7a8c5fa6-637c-433c-9821-fd8e094a587f","Type":"ContainerStarted","Data":"9536f04955f5bdcee3446362789d1ffd942a3b7061257140ce4e993ab40293ff"}
Jul 24 19:27:55.824940 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:55.824894    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tccp4" podStartSLOduration=3.884560301 podStartE2EDuration="4.824878592s" totalImagesPullingTime="866.876075ms" totalInitContainerRuntime="73.442216ms" isStatefulPod=true podCreationTimestamp="2026-07-24 19:27:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:27:55.823321046 +0000 UTC m=+74.012395359" watchObservedRunningTime="2026-07-24 19:27:55.824878592 +0000 UTC m=+74.013952906"
Jul 24 19:27:56.218440 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:56.218363    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6c6f46f7d7-7vlj7"]
Jul 24 19:27:56.245343 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:56.245315    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6c6f46f7d7-7vlj7"]
Jul 24 19:27:56.245507 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:56.245446    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6c6f46f7d7-7vlj7"
Jul 24 19:27:56.248183 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:56.248152    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 24 19:27:56.248183 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:56.248167    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 24 19:27:56.248183 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:56.248156    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 24 19:27:56.248400 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:56.248155    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-6v8tr\""
Jul 24 19:27:56.248977 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:56.248957    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-6qrqs65hvk48n\""
Jul 24 19:27:56.249076 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:56.248960    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 24 19:27:56.322477 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:56.322446    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96ef1151-e47f-43cd-aa8a-f694946ebdd2-client-ca-bundle\") pod \"metrics-server-6c6f46f7d7-7vlj7\" (UID: \"96ef1151-e47f-43cd-aa8a-f694946ebdd2\") " pod="openshift-monitoring/metrics-server-6c6f46f7d7-7vlj7"
Jul 24 19:27:56.322477 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:56.322481    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdk2f\" (UniqueName: \"kubernetes.io/projected/96ef1151-e47f-43cd-aa8a-f694946ebdd2-kube-api-access-gdk2f\") pod \"metrics-server-6c6f46f7d7-7vlj7\" (UID: \"96ef1151-e47f-43cd-aa8a-f694946ebdd2\") " pod="openshift-monitoring/metrics-server-6c6f46f7d7-7vlj7"
Jul 24 19:27:56.322686 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:56.322501    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/96ef1151-e47f-43cd-aa8a-f694946ebdd2-metrics-server-audit-profiles\") pod \"metrics-server-6c6f46f7d7-7vlj7\" (UID: \"96ef1151-e47f-43cd-aa8a-f694946ebdd2\") " pod="openshift-monitoring/metrics-server-6c6f46f7d7-7vlj7"
Jul 24 19:27:56.322686 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:56.322523    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/96ef1151-e47f-43cd-aa8a-f694946ebdd2-secret-metrics-server-tls\") pod \"metrics-server-6c6f46f7d7-7vlj7\" (UID: \"96ef1151-e47f-43cd-aa8a-f694946ebdd2\") " pod="openshift-monitoring/metrics-server-6c6f46f7d7-7vlj7"
Jul 24 19:27:56.322686 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:56.322567    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/96ef1151-e47f-43cd-aa8a-f694946ebdd2-secret-metrics-server-client-certs\") pod \"metrics-server-6c6f46f7d7-7vlj7\" (UID: \"96ef1151-e47f-43cd-aa8a-f694946ebdd2\") " pod="openshift-monitoring/metrics-server-6c6f46f7d7-7vlj7"
Jul 24 19:27:56.322686 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:56.322585    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/96ef1151-e47f-43cd-aa8a-f694946ebdd2-audit-log\") pod \"metrics-server-6c6f46f7d7-7vlj7\" (UID: \"96ef1151-e47f-43cd-aa8a-f694946ebdd2\") " pod="openshift-monitoring/metrics-server-6c6f46f7d7-7vlj7"
Jul 24 19:27:56.322686 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:56.322653    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96ef1151-e47f-43cd-aa8a-f694946ebdd2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c6f46f7d7-7vlj7\" (UID: \"96ef1151-e47f-43cd-aa8a-f694946ebdd2\") " pod="openshift-monitoring/metrics-server-6c6f46f7d7-7vlj7"
Jul 24 19:27:56.423608 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:56.423570    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96ef1151-e47f-43cd-aa8a-f694946ebdd2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c6f46f7d7-7vlj7\" (UID: \"96ef1151-e47f-43cd-aa8a-f694946ebdd2\") " pod="openshift-monitoring/metrics-server-6c6f46f7d7-7vlj7"
Jul 24 19:27:56.423813 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:56.423640    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96ef1151-e47f-43cd-aa8a-f694946ebdd2-client-ca-bundle\") pod \"metrics-server-6c6f46f7d7-7vlj7\" (UID: \"96ef1151-e47f-43cd-aa8a-f694946ebdd2\") " pod="openshift-monitoring/metrics-server-6c6f46f7d7-7vlj7"
Jul 24 19:27:56.423813 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:56.423665    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdk2f\" (UniqueName: \"kubernetes.io/projected/96ef1151-e47f-43cd-aa8a-f694946ebdd2-kube-api-access-gdk2f\") pod \"metrics-server-6c6f46f7d7-7vlj7\" (UID: \"96ef1151-e47f-43cd-aa8a-f694946ebdd2\") " pod="openshift-monitoring/metrics-server-6c6f46f7d7-7vlj7"
Jul 24 19:27:56.423813 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:56.423691    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/96ef1151-e47f-43cd-aa8a-f694946ebdd2-metrics-server-audit-profiles\") pod \"metrics-server-6c6f46f7d7-7vlj7\" (UID: \"96ef1151-e47f-43cd-aa8a-f694946ebdd2\") " pod="openshift-monitoring/metrics-server-6c6f46f7d7-7vlj7"
Jul 24 19:27:56.423813 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:56.423752    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/96ef1151-e47f-43cd-aa8a-f694946ebdd2-secret-metrics-server-tls\") pod \"metrics-server-6c6f46f7d7-7vlj7\" (UID: \"96ef1151-e47f-43cd-aa8a-f694946ebdd2\") " pod="openshift-monitoring/metrics-server-6c6f46f7d7-7vlj7"
Jul 24 19:27:56.423813 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:56.423789    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/96ef1151-e47f-43cd-aa8a-f694946ebdd2-secret-metrics-server-client-certs\") pod \"metrics-server-6c6f46f7d7-7vlj7\" (UID: \"96ef1151-e47f-43cd-aa8a-f694946ebdd2\") " pod="openshift-monitoring/metrics-server-6c6f46f7d7-7vlj7"
Jul 24 19:27:56.423813 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:56.423813    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/96ef1151-e47f-43cd-aa8a-f694946ebdd2-audit-log\") pod \"metrics-server-6c6f46f7d7-7vlj7\" (UID: \"96ef1151-e47f-43cd-aa8a-f694946ebdd2\") " pod="openshift-monitoring/metrics-server-6c6f46f7d7-7vlj7"
Jul 24 19:27:56.424352 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:56.424254    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/96ef1151-e47f-43cd-aa8a-f694946ebdd2-audit-log\") pod \"metrics-server-6c6f46f7d7-7vlj7\" (UID: \"96ef1151-e47f-43cd-aa8a-f694946ebdd2\") " pod="openshift-monitoring/metrics-server-6c6f46f7d7-7vlj7"
Jul 24 19:27:56.424463 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:56.424427    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96ef1151-e47f-43cd-aa8a-f694946ebdd2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c6f46f7d7-7vlj7\" (UID: \"96ef1151-e47f-43cd-aa8a-f694946ebdd2\") " pod="openshift-monitoring/metrics-server-6c6f46f7d7-7vlj7"
Jul 24 19:27:56.425046 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:56.425018    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/96ef1151-e47f-43cd-aa8a-f694946ebdd2-metrics-server-audit-profiles\") pod \"metrics-server-6c6f46f7d7-7vlj7\" (UID: \"96ef1151-e47f-43cd-aa8a-f694946ebdd2\") " pod="openshift-monitoring/metrics-server-6c6f46f7d7-7vlj7"
Jul 24 19:27:56.427092 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:56.427067    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96ef1151-e47f-43cd-aa8a-f694946ebdd2-client-ca-bundle\") pod \"metrics-server-6c6f46f7d7-7vlj7\" (UID: \"96ef1151-e47f-43cd-aa8a-f694946ebdd2\") " pod="openshift-monitoring/metrics-server-6c6f46f7d7-7vlj7"
Jul 24 19:27:56.427206 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:56.427177    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/96ef1151-e47f-43cd-aa8a-f694946ebdd2-secret-metrics-server-tls\") pod \"metrics-server-6c6f46f7d7-7vlj7\" (UID: \"96ef1151-e47f-43cd-aa8a-f694946ebdd2\") " pod="openshift-monitoring/metrics-server-6c6f46f7d7-7vlj7"
Jul 24 19:27:56.427289 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:56.427269    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/96ef1151-e47f-43cd-aa8a-f694946ebdd2-secret-metrics-server-client-certs\") pod \"metrics-server-6c6f46f7d7-7vlj7\" (UID: \"96ef1151-e47f-43cd-aa8a-f694946ebdd2\") " pod="openshift-monitoring/metrics-server-6c6f46f7d7-7vlj7"
Jul 24 19:27:56.434184 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:56.434141    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdk2f\" (UniqueName: \"kubernetes.io/projected/96ef1151-e47f-43cd-aa8a-f694946ebdd2-kube-api-access-gdk2f\") pod \"metrics-server-6c6f46f7d7-7vlj7\" (UID: \"96ef1151-e47f-43cd-aa8a-f694946ebdd2\") " pod="openshift-monitoring/metrics-server-6c6f46f7d7-7vlj7"
Jul 24 19:27:56.497570 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:56.497487    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-j8jrm"]
Jul 24 19:27:56.523151 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:56.523122    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-j8jrm"]
Jul 24 19:27:56.523326 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:56.523237    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-j8jrm"
Jul 24 19:27:56.525804 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:56.525781    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 24 19:27:56.525933 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:56.525783    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-h2wn5\""
Jul 24 19:27:56.556694 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:56.556663    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6c6f46f7d7-7vlj7"
Jul 24 19:27:56.625382 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:56.625339    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e699ccc-1856-474a-8883-86c069c35908-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-j8jrm\" (UID: \"8e699ccc-1856-474a-8883-86c069c35908\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-j8jrm"
Jul 24 19:27:56.625530 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:56.625405    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv8hm\" (UniqueName: \"kubernetes.io/projected/8e699ccc-1856-474a-8883-86c069c35908-kube-api-access-xv8hm\") pod \"monitoring-plugin-68b7fc9574-j8jrm\" (UID: \"8e699ccc-1856-474a-8883-86c069c35908\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-j8jrm"
Jul 24 19:27:56.719089 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:56.719029    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6c6f46f7d7-7vlj7"]
Jul 24 19:27:56.723280 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:27:56.723245    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96ef1151_e47f_43cd_aa8a_f694946ebdd2.slice/crio-12549420125f989cf7112f78c0c79fa8a0159ebb566a4f5c75b802da194d94a3 WatchSource:0}: Error finding container 12549420125f989cf7112f78c0c79fa8a0159ebb566a4f5c75b802da194d94a3: Status 404 returned error can't find the container with id 12549420125f989cf7112f78c0c79fa8a0159ebb566a4f5c75b802da194d94a3
Jul 24 19:27:56.725949 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:56.725811    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e699ccc-1856-474a-8883-86c069c35908-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-j8jrm\" (UID: \"8e699ccc-1856-474a-8883-86c069c35908\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-j8jrm"
Jul 24 19:27:56.725949 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:56.725881    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv8hm\" (UniqueName: \"kubernetes.io/projected/8e699ccc-1856-474a-8883-86c069c35908-kube-api-access-xv8hm\") pod \"monitoring-plugin-68b7fc9574-j8jrm\" (UID: \"8e699ccc-1856-474a-8883-86c069c35908\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-j8jrm"
Jul 24 19:27:56.726211 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:56.726190    2579 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 24 19:27:56.726290 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:27:56.726269    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e699ccc-1856-474a-8883-86c069c35908-monitoring-plugin-cert podName:8e699ccc-1856-474a-8883-86c069c35908 nodeName:}" failed. No retries permitted until 2026-07-24 19:27:57.226246021 +0000 UTC m=+75.415320317 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/8e699ccc-1856-474a-8883-86c069c35908-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-j8jrm" (UID: "8e699ccc-1856-474a-8883-86c069c35908") : secret "monitoring-plugin-cert" not found
Jul 24 19:27:56.735884 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:56.735864    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv8hm\" (UniqueName: \"kubernetes.io/projected/8e699ccc-1856-474a-8883-86c069c35908-kube-api-access-xv8hm\") pod \"monitoring-plugin-68b7fc9574-j8jrm\" (UID: \"8e699ccc-1856-474a-8883-86c069c35908\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-j8jrm"
Jul 24 19:27:56.809888 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:56.809852    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6c6f46f7d7-7vlj7" event={"ID":"96ef1151-e47f-43cd-aa8a-f694946ebdd2","Type":"ContainerStarted","Data":"12549420125f989cf7112f78c0c79fa8a0159ebb566a4f5c75b802da194d94a3"}
Jul 24 19:27:57.230436 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:57.230349    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e699ccc-1856-474a-8883-86c069c35908-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-j8jrm\" (UID: \"8e699ccc-1856-474a-8883-86c069c35908\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-j8jrm"
Jul 24 19:27:57.233222 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:57.233192    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e699ccc-1856-474a-8883-86c069c35908-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-j8jrm\" (UID: \"8e699ccc-1856-474a-8883-86c069c35908\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-j8jrm"
Jul 24 19:27:57.434234 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:57.434203    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-j8jrm"
Jul 24 19:27:57.773227 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:57.773199    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-j8jrm"]
Jul 24 19:27:57.872435 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:27:57.872397    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e699ccc_1856_474a_8883_86c069c35908.slice/crio-dbc40734f289dfa41a30fd5e7edd0f2b2b130761cc57aeec17936de5ae432293 WatchSource:0}: Error finding container dbc40734f289dfa41a30fd5e7edd0f2b2b130761cc57aeec17936de5ae432293: Status 404 returned error can't find the container with id dbc40734f289dfa41a30fd5e7edd0f2b2b130761cc57aeec17936de5ae432293
Jul 24 19:27:58.820707 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:58.820603    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55567cf595-p7tz9" event={"ID":"7a8c5fa6-637c-433c-9821-fd8e094a587f","Type":"ContainerStarted","Data":"e0032334d005952e4756df8b18844f1eb0fa3715d2a5413cebae187a3a250451"}
Jul 24 19:27:58.820949 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:58.820921    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55567cf595-p7tz9" event={"ID":"7a8c5fa6-637c-433c-9821-fd8e094a587f","Type":"ContainerStarted","Data":"69a571262f90c4f3ad3d152c684eca0d10324ba25ab7a03e42eaebafbcba9b44"}
Jul 24 19:27:58.821080 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:58.820973    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55567cf595-p7tz9" event={"ID":"7a8c5fa6-637c-433c-9821-fd8e094a587f","Type":"ContainerStarted","Data":"35385ec8437650c5e18ffa71ed3187c94dd54b5b704e584b8445860da2c5ca07"}
Jul 24 19:27:58.822114 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:27:58.822088    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-j8jrm" event={"ID":"8e699ccc-1856-474a-8883-86c069c35908","Type":"ContainerStarted","Data":"dbc40734f289dfa41a30fd5e7edd0f2b2b130761cc57aeec17936de5ae432293"}
Jul 24 19:28:00.834856 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:28:00.834819    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55567cf595-p7tz9" event={"ID":"7a8c5fa6-637c-433c-9821-fd8e094a587f","Type":"ContainerStarted","Data":"a603c5d1b9e74648aed11fb145b6da3d01732448ac078b1364f2695528ee375f"}
Jul 24 19:28:00.835412 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:28:00.834902    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55567cf595-p7tz9" event={"ID":"7a8c5fa6-637c-433c-9821-fd8e094a587f","Type":"ContainerStarted","Data":"9e16bc960af00b499946837ed5f282c30fc1cbb50870bd997b50da3ef73b6c56"}
Jul 24 19:28:00.835412 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:28:00.834944    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55567cf595-p7tz9" event={"ID":"7a8c5fa6-637c-433c-9821-fd8e094a587f","Type":"ContainerStarted","Data":"c5dcb51a5aa5951d44490cfc2a64fc22d6968fc175efe31a1f830d3970dd9231"}
Jul 24 19:28:00.835412 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:28:00.835080    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-55567cf595-p7tz9"
Jul 24 19:28:00.836543 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:28:00.836516    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6c6f46f7d7-7vlj7" event={"ID":"96ef1151-e47f-43cd-aa8a-f694946ebdd2","Type":"ContainerStarted","Data":"6e27d8549c40e963ea0a24ebde809b1c3122602abb802cd15b0021fc540cc6a0"}
Jul 24 19:28:00.840577 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:28:00.840554    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-j8jrm" event={"ID":"8e699ccc-1856-474a-8883-86c069c35908","Type":"ContainerStarted","Data":"0a42a165c9b2470ff4687cf39e99c3ac76d171f8486bd9e5c55180c022b2d1de"}
Jul 24 19:28:00.840812 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:28:00.840793    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-j8jrm"
Jul 24 19:28:00.846205 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:28:00.846185    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-j8jrm"
Jul 24 19:28:00.866128 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:28:00.866079    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-55567cf595-p7tz9" podStartSLOduration=2.635471603 podStartE2EDuration="6.866063083s" totalImagesPullingTime="4.23059148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:27:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:28:00.864059847 +0000 UTC m=+79.053134160" watchObservedRunningTime="2026-07-24 19:28:00.866063083 +0000 UTC m=+79.055137396"
Jul 24 19:28:00.885383 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:28:00.885336    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6c6f46f7d7-7vlj7" podStartSLOduration=1.9101645779999998 podStartE2EDuration="4.885321496s" totalImagesPullingTime="2.975156918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:27:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:28:00.884425862 +0000 UTC m=+79.073500179" watchObservedRunningTime="2026-07-24 19:28:00.885321496 +0000 UTC m=+79.074395808"
Jul 24 19:28:00.899796 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:28:00.899718    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-j8jrm" podStartSLOduration=2.963670271 podStartE2EDuration="4.899700441s" totalImagesPullingTime="1.93603017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:27:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:28:00.899418523 +0000 UTC m=+79.088492839" watchObservedRunningTime="2026-07-24 19:28:00.899700441 +0000 UTC m=+79.088774757"
Jul 24 19:28:06.850323 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:28:06.850189    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-55567cf595-p7tz9"
Jul 24 19:28:16.557040 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:28:16.557006    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6c6f46f7d7-7vlj7"
Jul 24 19:28:16.557481 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:28:16.557062    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6c6f46f7d7-7vlj7"
Jul 24 19:28:24.802005 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:28:24.801970    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-v4htc"
Jul 24 19:28:36.562402 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:28:36.562370    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6c6f46f7d7-7vlj7"
Jul 24 19:28:36.566420 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:28:36.566399    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6c6f46f7d7-7vlj7"
Jul 24 19:29:52.548433 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:29:52.548353    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxdp"]
Jul 24 19:29:52.550506 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:29:52.550491    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxdp"
Jul 24 19:29:52.553535 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:29:52.553508    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 24 19:29:52.553643 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:29:52.553511    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zrxsn\""
Jul 24 19:29:52.553643 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:29:52.553522    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 24 19:29:52.561492 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:29:52.561470    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxdp"]
Jul 24 19:29:52.620932 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:29:52.620895    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxdp\" (UID: \"8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxdp"
Jul 24 19:29:52.620932 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:29:52.620937    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxdp\" (UID: \"8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxdp"
Jul 24 19:29:52.621138 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:29:52.621043    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfnrb\" (UniqueName: \"kubernetes.io/projected/8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2-kube-api-access-xfnrb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxdp\" (UID: \"8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxdp"
Jul 24 19:29:52.721896 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:29:52.721847    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfnrb\" (UniqueName: \"kubernetes.io/projected/8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2-kube-api-access-xfnrb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxdp\" (UID: \"8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxdp"
Jul 24 19:29:52.721896 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:29:52.721906    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxdp\" (UID: \"8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxdp"
Jul 24 19:29:52.722122 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:29:52.721937    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxdp\" (UID: \"8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxdp"
Jul 24 19:29:52.722286 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:29:52.722270    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxdp\" (UID: \"8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxdp"
Jul 24 19:29:52.722324 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:29:52.722301    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxdp\" (UID: \"8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxdp"
Jul 24 19:29:52.730101 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:29:52.730067    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfnrb\" (UniqueName: \"kubernetes.io/projected/8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2-kube-api-access-xfnrb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxdp\" (UID: \"8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxdp"
Jul 24 19:29:52.859920 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:29:52.859828    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxdp"
Jul 24 19:29:52.987683 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:29:52.987661    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxdp"]
Jul 24 19:29:52.989925 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:29:52.989897    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a6ef1ae_30f0_4e55_991e_c1dd7a77e3d2.slice/crio-6c63746508ba5a1f4b278b12a21c2097446c1ba3fce7017dc3b6986ba5c81808 WatchSource:0}: Error finding container 6c63746508ba5a1f4b278b12a21c2097446c1ba3fce7017dc3b6986ba5c81808: Status 404 returned error can't find the container with id 6c63746508ba5a1f4b278b12a21c2097446c1ba3fce7017dc3b6986ba5c81808
Jul 24 19:29:53.228669 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:29:53.228586    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxdp" event={"ID":"8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2","Type":"ContainerStarted","Data":"6c63746508ba5a1f4b278b12a21c2097446c1ba3fce7017dc3b6986ba5c81808"}
Jul 24 19:29:59.253517 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:29:59.253480    2579 generic.go:356] "Generic (PLEG): container finished" podID="8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2" containerID="3ecf90ef4a5f2aa998cd8088e398273234ab5e7e27a2c1586cfb2d00d221ef90" exitCode=0
Jul 24 19:29:59.253945 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:29:59.253532    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxdp" event={"ID":"8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2","Type":"ContainerDied","Data":"3ecf90ef4a5f2aa998cd8088e398273234ab5e7e27a2c1586cfb2d00d221ef90"}
Jul 24 19:30:02.267682 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:02.267644    2579 generic.go:356] "Generic (PLEG): container finished" podID="8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2" containerID="517246c2a9248a2232b3b89be6d2f606b8ee72c23d86532eb3937e47a85a81ea" exitCode=0
Jul 24 19:30:02.268081 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:02.267754    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxdp" event={"ID":"8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2","Type":"ContainerDied","Data":"517246c2a9248a2232b3b89be6d2f606b8ee72c23d86532eb3937e47a85a81ea"}
Jul 24 19:30:09.296975 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:09.296936    2579 generic.go:356] "Generic (PLEG): container finished" podID="8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2" containerID="a4cd238549e4c1e01f24a106ce54fa13d64b9863fe55e08e4b3e05b2ede2b3fe" exitCode=0
Jul 24 19:30:09.297345 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:09.296989    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxdp" event={"ID":"8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2","Type":"ContainerDied","Data":"a4cd238549e4c1e01f24a106ce54fa13d64b9863fe55e08e4b3e05b2ede2b3fe"}
Jul 24 19:30:10.424772 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:10.424744    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxdp"
Jul 24 19:30:10.466805 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:10.466771    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfnrb\" (UniqueName: \"kubernetes.io/projected/8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2-kube-api-access-xfnrb\") pod \"8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2\" (UID: \"8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2\") "
Jul 24 19:30:10.466970 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:10.466823    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2-util\") pod \"8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2\" (UID: \"8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2\") "
Jul 24 19:30:10.466970 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:10.466865    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2-bundle\") pod \"8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2\" (UID: \"8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2\") "
Jul 24 19:30:10.467544 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:10.467513    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2-bundle" (OuterVolumeSpecName: "bundle") pod "8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2" (UID: "8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:30:10.469025 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:10.468994    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2-kube-api-access-xfnrb" (OuterVolumeSpecName: "kube-api-access-xfnrb") pod "8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2" (UID: "8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2"). InnerVolumeSpecName "kube-api-access-xfnrb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:30:10.471030 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:10.471008    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2-util" (OuterVolumeSpecName: "util") pod "8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2" (UID: "8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:30:10.567483 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:10.567406    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2-bundle\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 19:30:10.567483 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:10.567431    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfnrb\" (UniqueName: \"kubernetes.io/projected/8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2-kube-api-access-xfnrb\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 19:30:10.567483 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:10.567441    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2-util\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 19:30:11.305458 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:11.305426    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxdp" event={"ID":"8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2","Type":"ContainerDied","Data":"6c63746508ba5a1f4b278b12a21c2097446c1ba3fce7017dc3b6986ba5c81808"}
Jul 24 19:30:11.305616 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:11.305474    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6c63746508ba5a1f4b278b12a21c2097446c1ba3fce7017dc3b6986ba5c81808"
Jul 24 19:30:11.305616 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:11.305439    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxdp"
Jul 24 19:30:15.785401 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:15.785366    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-92lwd"]
Jul 24 19:30:15.785794 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:15.785625    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2" containerName="util"
Jul 24 19:30:15.785794 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:15.785636    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2" containerName="util"
Jul 24 19:30:15.785794 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:15.785646    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2" containerName="extract"
Jul 24 19:30:15.785794 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:15.785652    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2" containerName="extract"
Jul 24 19:30:15.785794 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:15.785663    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2" containerName="pull"
Jul 24 19:30:15.785794 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:15.785669    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2" containerName="pull"
Jul 24 19:30:15.785794 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:15.785711    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a6ef1ae-30f0-4e55-991e-c1dd7a77e3d2" containerName="extract"
Jul 24 19:30:15.824696 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:15.824659    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-92lwd"]
Jul 24 19:30:15.824861 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:15.824772    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-92lwd"
Jul 24 19:30:15.828751 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:15.828717    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-m98q2\""
Jul 24 19:30:15.828856 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:15.828751    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 24 19:30:15.828856 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:15.828784    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 24 19:30:15.914733 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:15.914698    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lm6b\" (UniqueName: \"kubernetes.io/projected/2d1adc83-e54f-4a3f-97ab-d34f2a3e9e27-kube-api-access-7lm6b\") pod \"cert-manager-operator-controller-manager-55c444bf86-92lwd\" (UID: \"2d1adc83-e54f-4a3f-97ab-d34f2a3e9e27\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-92lwd"
Jul 24 19:30:15.914900 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:15.914806    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d1adc83-e54f-4a3f-97ab-d34f2a3e9e27-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-92lwd\" (UID: \"2d1adc83-e54f-4a3f-97ab-d34f2a3e9e27\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-92lwd"
Jul 24 19:30:16.015989 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:16.015958    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lm6b\" (UniqueName: \"kubernetes.io/projected/2d1adc83-e54f-4a3f-97ab-d34f2a3e9e27-kube-api-access-7lm6b\") pod \"cert-manager-operator-controller-manager-55c444bf86-92lwd\" (UID: \"2d1adc83-e54f-4a3f-97ab-d34f2a3e9e27\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-92lwd"
Jul 24 19:30:16.016080 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:16.016008    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d1adc83-e54f-4a3f-97ab-d34f2a3e9e27-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-92lwd\" (UID: \"2d1adc83-e54f-4a3f-97ab-d34f2a3e9e27\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-92lwd"
Jul 24 19:30:16.016363 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:16.016348    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d1adc83-e54f-4a3f-97ab-d34f2a3e9e27-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-92lwd\" (UID: \"2d1adc83-e54f-4a3f-97ab-d34f2a3e9e27\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-92lwd"
Jul 24 19:30:16.029553 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:16.029523    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lm6b\" (UniqueName: \"kubernetes.io/projected/2d1adc83-e54f-4a3f-97ab-d34f2a3e9e27-kube-api-access-7lm6b\") pod \"cert-manager-operator-controller-manager-55c444bf86-92lwd\" (UID: \"2d1adc83-e54f-4a3f-97ab-d34f2a3e9e27\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-92lwd"
Jul 24 19:30:16.133787 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:16.133675    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-92lwd"
Jul 24 19:30:16.283357 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:16.283327    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-92lwd"]
Jul 24 19:30:16.287968 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:30:16.287942    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d1adc83_e54f_4a3f_97ab_d34f2a3e9e27.slice/crio-8f7652f80bd413d3c40e99eadc2481d1c6ba710dc7b13a2660a10729fb5b877f WatchSource:0}: Error finding container 8f7652f80bd413d3c40e99eadc2481d1c6ba710dc7b13a2660a10729fb5b877f: Status 404 returned error can't find the container with id 8f7652f80bd413d3c40e99eadc2481d1c6ba710dc7b13a2660a10729fb5b877f
Jul 24 19:30:16.323245 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:16.323211    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-92lwd" event={"ID":"2d1adc83-e54f-4a3f-97ab-d34f2a3e9e27","Type":"ContainerStarted","Data":"8f7652f80bd413d3c40e99eadc2481d1c6ba710dc7b13a2660a10729fb5b877f"}
Jul 24 19:30:19.337781 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:19.337739    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-92lwd" event={"ID":"2d1adc83-e54f-4a3f-97ab-d34f2a3e9e27","Type":"ContainerStarted","Data":"d1063d87013750de34218e70686acd95805efc506b58ba014de5a982d9da4d31"}
Jul 24 19:30:19.366613 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:19.366553    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-92lwd" podStartSLOduration=2.166872848 podStartE2EDuration="4.366531894s" totalImagesPullingTime="2.199659046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:30:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:30:19.365331854 +0000 UTC m=+217.554406170" watchObservedRunningTime="2026-07-24 19:30:19.366531894 +0000 UTC m=+217.555606209"
Jul 24 19:30:19.731773 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:19.731676    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-wwlq2"]
Jul 24 19:30:19.745315 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:19.745284    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-wwlq2"
Jul 24 19:30:19.749569 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:19.749551    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 24 19:30:19.749687 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:19.749593    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-dxwqk\""
Jul 24 19:30:19.753129 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:19.752610    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 24 19:30:19.771992 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:19.771968    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-wwlq2"]
Jul 24 19:30:19.849672 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:19.849640    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e4c227fa-be51-43bd-944b-dd03438d024c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-wwlq2\" (UID: \"e4c227fa-be51-43bd-944b-dd03438d024c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wwlq2"
Jul 24 19:30:19.849889 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:19.849704    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvwzd\" (UniqueName: \"kubernetes.io/projected/e4c227fa-be51-43bd-944b-dd03438d024c-kube-api-access-xvwzd\") pod \"cert-manager-webhook-6486ffd997-wwlq2\" (UID: \"e4c227fa-be51-43bd-944b-dd03438d024c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wwlq2"
Jul 24 19:30:19.951016 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:19.950986    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvwzd\" (UniqueName: \"kubernetes.io/projected/e4c227fa-be51-43bd-944b-dd03438d024c-kube-api-access-xvwzd\") pod \"cert-manager-webhook-6486ffd997-wwlq2\" (UID: \"e4c227fa-be51-43bd-944b-dd03438d024c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wwlq2"
Jul 24 19:30:19.951212 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:19.951036    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e4c227fa-be51-43bd-944b-dd03438d024c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-wwlq2\" (UID: \"e4c227fa-be51-43bd-944b-dd03438d024c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wwlq2"
Jul 24 19:30:19.972229 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:19.972201    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e4c227fa-be51-43bd-944b-dd03438d024c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-wwlq2\" (UID: \"e4c227fa-be51-43bd-944b-dd03438d024c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wwlq2"
Jul 24 19:30:19.973867 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:19.973842    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvwzd\" (UniqueName: \"kubernetes.io/projected/e4c227fa-be51-43bd-944b-dd03438d024c-kube-api-access-xvwzd\") pod \"cert-manager-webhook-6486ffd997-wwlq2\" (UID: \"e4c227fa-be51-43bd-944b-dd03438d024c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wwlq2"
Jul 24 19:30:20.065599 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:20.065571    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-wwlq2"
Jul 24 19:30:20.227684 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:20.227614    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-wwlq2"]
Jul 24 19:30:20.229742 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:30:20.229690    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode4c227fa_be51_43bd_944b_dd03438d024c.slice/crio-a4887d890f882b3dfc5dd49ab5c0145ef74e31f3e3da45cd656ae22fd72a3283 WatchSource:0}: Error finding container a4887d890f882b3dfc5dd49ab5c0145ef74e31f3e3da45cd656ae22fd72a3283: Status 404 returned error can't find the container with id a4887d890f882b3dfc5dd49ab5c0145ef74e31f3e3da45cd656ae22fd72a3283
Jul 24 19:30:20.342782 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:20.342684    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-wwlq2" event={"ID":"e4c227fa-be51-43bd-944b-dd03438d024c","Type":"ContainerStarted","Data":"a4887d890f882b3dfc5dd49ab5c0145ef74e31f3e3da45cd656ae22fd72a3283"}
Jul 24 19:30:20.535678 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:20.535639    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm42p"]
Jul 24 19:30:20.564944 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:20.564918    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm42p"]
Jul 24 19:30:20.565091 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:20.565015    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm42p"
Jul 24 19:30:20.567825 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:20.567803    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 24 19:30:20.567825 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:20.567803    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 24 19:30:20.569939 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:20.569918    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zrxsn\""
Jul 24 19:30:20.657134 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:20.657042    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cndr\" (UniqueName: \"kubernetes.io/projected/4646b5ac-eadc-4c49-aaa9-626dda25fd9c-kube-api-access-7cndr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm42p\" (UID: \"4646b5ac-eadc-4c49-aaa9-626dda25fd9c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm42p"
Jul 24 19:30:20.657134 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:20.657089    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4646b5ac-eadc-4c49-aaa9-626dda25fd9c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm42p\" (UID: \"4646b5ac-eadc-4c49-aaa9-626dda25fd9c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm42p"
Jul 24 19:30:20.657134 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:20.657110    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4646b5ac-eadc-4c49-aaa9-626dda25fd9c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm42p\" (UID: \"4646b5ac-eadc-4c49-aaa9-626dda25fd9c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm42p"
Jul 24 19:30:20.758088 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:20.758050    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cndr\" (UniqueName: \"kubernetes.io/projected/4646b5ac-eadc-4c49-aaa9-626dda25fd9c-kube-api-access-7cndr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm42p\" (UID: \"4646b5ac-eadc-4c49-aaa9-626dda25fd9c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm42p"
Jul 24 19:30:20.758299 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:20.758098    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4646b5ac-eadc-4c49-aaa9-626dda25fd9c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm42p\" (UID: \"4646b5ac-eadc-4c49-aaa9-626dda25fd9c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm42p"
Jul 24 19:30:20.758299 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:20.758125    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4646b5ac-eadc-4c49-aaa9-626dda25fd9c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm42p\" (UID: \"4646b5ac-eadc-4c49-aaa9-626dda25fd9c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm42p"
Jul 24 19:30:20.758449 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:20.758431    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4646b5ac-eadc-4c49-aaa9-626dda25fd9c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm42p\" (UID: \"4646b5ac-eadc-4c49-aaa9-626dda25fd9c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm42p"
Jul 24 19:30:20.758484 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:20.758461    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4646b5ac-eadc-4c49-aaa9-626dda25fd9c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm42p\" (UID: \"4646b5ac-eadc-4c49-aaa9-626dda25fd9c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm42p"
Jul 24 19:30:20.768511 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:20.768488    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cndr\" (UniqueName: \"kubernetes.io/projected/4646b5ac-eadc-4c49-aaa9-626dda25fd9c-kube-api-access-7cndr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm42p\" (UID: \"4646b5ac-eadc-4c49-aaa9-626dda25fd9c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm42p"
Jul 24 19:30:20.874337 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:20.874306    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm42p"
Jul 24 19:30:21.060231 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:21.060181    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm42p"]
Jul 24 19:30:21.063355 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:30:21.063327    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4646b5ac_eadc_4c49_aaa9_626dda25fd9c.slice/crio-482e559a52718da070cb68bc03efa5a35b3e633eb5da766d85f12ffb6d992487 WatchSource:0}: Error finding container 482e559a52718da070cb68bc03efa5a35b3e633eb5da766d85f12ffb6d992487: Status 404 returned error can't find the container with id 482e559a52718da070cb68bc03efa5a35b3e633eb5da766d85f12ffb6d992487
Jul 24 19:30:21.349173 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:21.349139    2579 generic.go:356] "Generic (PLEG): container finished" podID="4646b5ac-eadc-4c49-aaa9-626dda25fd9c" containerID="3fd7c5c8878d95d26c0d91f2d3357a53aeec51295589f10209580291852bc54b" exitCode=0
Jul 24 19:30:21.349624 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:21.349233    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm42p" event={"ID":"4646b5ac-eadc-4c49-aaa9-626dda25fd9c","Type":"ContainerDied","Data":"3fd7c5c8878d95d26c0d91f2d3357a53aeec51295589f10209580291852bc54b"}
Jul 24 19:30:21.349624 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:21.349291    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm42p" event={"ID":"4646b5ac-eadc-4c49-aaa9-626dda25fd9c","Type":"ContainerStarted","Data":"482e559a52718da070cb68bc03efa5a35b3e633eb5da766d85f12ffb6d992487"}
Jul 24 19:30:24.366222 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:24.366193    2579 generic.go:356] "Generic (PLEG): container finished" podID="4646b5ac-eadc-4c49-aaa9-626dda25fd9c" containerID="98a77159a27b3d14b5840f3ffcccef8d19536c1f049a37cfacfc0fc9c58a10ca" exitCode=0
Jul 24 19:30:24.367423 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:24.367397    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-wwlq2" event={"ID":"e4c227fa-be51-43bd-944b-dd03438d024c","Type":"ContainerStarted","Data":"eab6c247617c692a50a4f02cddf0727ddaf89e6b9539721b2893643de29c410b"}
Jul 24 19:30:24.367537 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:24.367445    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-wwlq2"
Jul 24 19:30:24.367537 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:24.367461    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm42p" event={"ID":"4646b5ac-eadc-4c49-aaa9-626dda25fd9c","Type":"ContainerDied","Data":"98a77159a27b3d14b5840f3ffcccef8d19536c1f049a37cfacfc0fc9c58a10ca"}
Jul 24 19:30:24.381167 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:24.381113    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-wwlq2" podStartSLOduration=1.9967795019999999 podStartE2EDuration="5.381094144s" totalImagesPullingTime="3.384314642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:30:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:30:24.380749735 +0000 UTC m=+222.569824043" watchObservedRunningTime="2026-07-24 19:30:24.381094144 +0000 UTC m=+222.570168469"
Jul 24 19:30:25.373339 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:25.373309    2579 generic.go:356] "Generic (PLEG): container finished" podID="4646b5ac-eadc-4c49-aaa9-626dda25fd9c" containerID="fd46f3875c2e749ed12cf1f9caa5f18a86e23d7c695f16b8b1791b778ab2e872" exitCode=0
Jul 24 19:30:25.373680 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:25.373378    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm42p" event={"ID":"4646b5ac-eadc-4c49-aaa9-626dda25fd9c","Type":"ContainerDied","Data":"fd46f3875c2e749ed12cf1f9caa5f18a86e23d7c695f16b8b1791b778ab2e872"}
Jul 24 19:30:26.035187 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:26.035156    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-rrr76"]
Jul 24 19:30:26.036984 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:26.036971    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rrr76"
Jul 24 19:30:26.039348 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:26.039332    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-xkr2k\""
Jul 24 19:30:26.047112 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:26.047091    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-rrr76"]
Jul 24 19:30:26.205695 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:26.205653    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt5hl\" (UniqueName: \"kubernetes.io/projected/d1d6fd7f-d786-4553-99ed-5a618c057568-kube-api-access-nt5hl\") pod \"cert-manager-cainjector-559cdd8c87-rrr76\" (UID: \"d1d6fd7f-d786-4553-99ed-5a618c057568\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rrr76"
Jul 24 19:30:26.205695 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:26.205694    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d1d6fd7f-d786-4553-99ed-5a618c057568-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-rrr76\" (UID: \"d1d6fd7f-d786-4553-99ed-5a618c057568\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rrr76"
Jul 24 19:30:26.307093 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:26.306999    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nt5hl\" (UniqueName: \"kubernetes.io/projected/d1d6fd7f-d786-4553-99ed-5a618c057568-kube-api-access-nt5hl\") pod \"cert-manager-cainjector-559cdd8c87-rrr76\" (UID: \"d1d6fd7f-d786-4553-99ed-5a618c057568\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rrr76"
Jul 24 19:30:26.307093 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:26.307047    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d1d6fd7f-d786-4553-99ed-5a618c057568-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-rrr76\" (UID: \"d1d6fd7f-d786-4553-99ed-5a618c057568\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rrr76"
Jul 24 19:30:26.321935 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:26.321908    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d1d6fd7f-d786-4553-99ed-5a618c057568-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-rrr76\" (UID: \"d1d6fd7f-d786-4553-99ed-5a618c057568\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rrr76"
Jul 24 19:30:26.322055 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:26.322031    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt5hl\" (UniqueName: \"kubernetes.io/projected/d1d6fd7f-d786-4553-99ed-5a618c057568-kube-api-access-nt5hl\") pod \"cert-manager-cainjector-559cdd8c87-rrr76\" (UID: \"d1d6fd7f-d786-4553-99ed-5a618c057568\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rrr76"
Jul 24 19:30:26.345926 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:26.345891    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rrr76"
Jul 24 19:30:26.525199 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:26.525176    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm42p"
Jul 24 19:30:26.609335 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:26.609263    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4646b5ac-eadc-4c49-aaa9-626dda25fd9c-util\") pod \"4646b5ac-eadc-4c49-aaa9-626dda25fd9c\" (UID: \"4646b5ac-eadc-4c49-aaa9-626dda25fd9c\") "
Jul 24 19:30:26.609471 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:26.609357    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7cndr\" (UniqueName: \"kubernetes.io/projected/4646b5ac-eadc-4c49-aaa9-626dda25fd9c-kube-api-access-7cndr\") pod \"4646b5ac-eadc-4c49-aaa9-626dda25fd9c\" (UID: \"4646b5ac-eadc-4c49-aaa9-626dda25fd9c\") "
Jul 24 19:30:26.609471 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:26.609384    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4646b5ac-eadc-4c49-aaa9-626dda25fd9c-bundle\") pod \"4646b5ac-eadc-4c49-aaa9-626dda25fd9c\" (UID: \"4646b5ac-eadc-4c49-aaa9-626dda25fd9c\") "
Jul 24 19:30:26.609871 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:26.609844    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4646b5ac-eadc-4c49-aaa9-626dda25fd9c-bundle" (OuterVolumeSpecName: "bundle") pod "4646b5ac-eadc-4c49-aaa9-626dda25fd9c" (UID: "4646b5ac-eadc-4c49-aaa9-626dda25fd9c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:30:26.611600 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:26.611579    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4646b5ac-eadc-4c49-aaa9-626dda25fd9c-kube-api-access-7cndr" (OuterVolumeSpecName: "kube-api-access-7cndr") pod "4646b5ac-eadc-4c49-aaa9-626dda25fd9c" (UID: "4646b5ac-eadc-4c49-aaa9-626dda25fd9c"). InnerVolumeSpecName "kube-api-access-7cndr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:30:26.617859 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:26.617836    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4646b5ac-eadc-4c49-aaa9-626dda25fd9c-util" (OuterVolumeSpecName: "util") pod "4646b5ac-eadc-4c49-aaa9-626dda25fd9c" (UID: "4646b5ac-eadc-4c49-aaa9-626dda25fd9c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:30:26.684791 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:26.684759    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-rrr76"]
Jul 24 19:30:26.687500 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:30:26.687474    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd1d6fd7f_d786_4553_99ed_5a618c057568.slice/crio-c08a823bec8d7039ed82ceda8d9d8f52c6aaf17f32c946c68c4fed5c4592bdea WatchSource:0}: Error finding container c08a823bec8d7039ed82ceda8d9d8f52c6aaf17f32c946c68c4fed5c4592bdea: Status 404 returned error can't find the container with id c08a823bec8d7039ed82ceda8d9d8f52c6aaf17f32c946c68c4fed5c4592bdea
Jul 24 19:30:26.710652 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:26.710616    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7cndr\" (UniqueName: \"kubernetes.io/projected/4646b5ac-eadc-4c49-aaa9-626dda25fd9c-kube-api-access-7cndr\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 19:30:26.710652 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:26.710648    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4646b5ac-eadc-4c49-aaa9-626dda25fd9c-bundle\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 19:30:26.710652 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:26.710657    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4646b5ac-eadc-4c49-aaa9-626dda25fd9c-util\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 19:30:27.384041 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:27.384010    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rrr76" event={"ID":"d1d6fd7f-d786-4553-99ed-5a618c057568","Type":"ContainerStarted","Data":"8f664aef5795c5af003039161e87b51e1a26c626bf40ed597c38aa8165f82910"}
Jul 24 19:30:27.384232 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:27.384051    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rrr76" event={"ID":"d1d6fd7f-d786-4553-99ed-5a618c057568","Type":"ContainerStarted","Data":"c08a823bec8d7039ed82ceda8d9d8f52c6aaf17f32c946c68c4fed5c4592bdea"}
Jul 24 19:30:27.385815 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:27.385789    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm42p" event={"ID":"4646b5ac-eadc-4c49-aaa9-626dda25fd9c","Type":"ContainerDied","Data":"482e559a52718da070cb68bc03efa5a35b3e633eb5da766d85f12ffb6d992487"}
Jul 24 19:30:27.385916 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:27.385837    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="482e559a52718da070cb68bc03efa5a35b3e633eb5da766d85f12ffb6d992487"
Jul 24 19:30:27.385916 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:27.385800    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm42p"
Jul 24 19:30:27.400417 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:27.400375    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rrr76" podStartSLOduration=1.400361215 podStartE2EDuration="1.400361215s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:30:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:30:27.399341866 +0000 UTC m=+225.588416182" watchObservedRunningTime="2026-07-24 19:30:27.400361215 +0000 UTC m=+225.589435527"
Jul 24 19:30:30.375564 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:30.375530    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-wwlq2"
Jul 24 19:30:36.385716 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:36.385679    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lq5p9"]
Jul 24 19:30:36.386135 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:36.385977    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4646b5ac-eadc-4c49-aaa9-626dda25fd9c" containerName="util"
Jul 24 19:30:36.386135 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:36.385989    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4646b5ac-eadc-4c49-aaa9-626dda25fd9c" containerName="util"
Jul 24 19:30:36.386135 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:36.386004    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4646b5ac-eadc-4c49-aaa9-626dda25fd9c" containerName="pull"
Jul 24 19:30:36.386135 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:36.386009    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4646b5ac-eadc-4c49-aaa9-626dda25fd9c" containerName="pull"
Jul 24 19:30:36.386135 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:36.386019    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4646b5ac-eadc-4c49-aaa9-626dda25fd9c" containerName="extract"
Jul 24 19:30:36.386135 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:36.386024    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4646b5ac-eadc-4c49-aaa9-626dda25fd9c" containerName="extract"
Jul 24 19:30:36.386135 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:36.386063    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4646b5ac-eadc-4c49-aaa9-626dda25fd9c" containerName="extract"
Jul 24 19:30:36.387965 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:36.387947    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lq5p9"
Jul 24 19:30:36.390775 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:36.390757    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 24 19:30:36.390870 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:36.390757    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 24 19:30:36.391795 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:36.391768    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-zn9f8\""
Jul 24 19:30:36.399184 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:36.399165    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lq5p9"]
Jul 24 19:30:36.584756 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:36.584709    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqljk\" (UniqueName: \"kubernetes.io/projected/b463703d-4132-47ca-9d35-16f2f4cd1f14-kube-api-access-dqljk\") pod \"openshift-lws-operator-fd8ccff4c-lq5p9\" (UID: \"b463703d-4132-47ca-9d35-16f2f4cd1f14\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lq5p9"
Jul 24 19:30:36.584920 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:36.584780    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b463703d-4132-47ca-9d35-16f2f4cd1f14-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lq5p9\" (UID: \"b463703d-4132-47ca-9d35-16f2f4cd1f14\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lq5p9"
Jul 24 19:30:36.685573 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:36.685478    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b463703d-4132-47ca-9d35-16f2f4cd1f14-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lq5p9\" (UID: \"b463703d-4132-47ca-9d35-16f2f4cd1f14\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lq5p9"
Jul 24 19:30:36.685573 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:36.685556    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqljk\" (UniqueName: \"kubernetes.io/projected/b463703d-4132-47ca-9d35-16f2f4cd1f14-kube-api-access-dqljk\") pod \"openshift-lws-operator-fd8ccff4c-lq5p9\" (UID: \"b463703d-4132-47ca-9d35-16f2f4cd1f14\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lq5p9"
Jul 24 19:30:36.685967 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:36.685942    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b463703d-4132-47ca-9d35-16f2f4cd1f14-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lq5p9\" (UID: \"b463703d-4132-47ca-9d35-16f2f4cd1f14\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lq5p9"
Jul 24 19:30:36.694638 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:36.694619    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqljk\" (UniqueName: \"kubernetes.io/projected/b463703d-4132-47ca-9d35-16f2f4cd1f14-kube-api-access-dqljk\") pod \"openshift-lws-operator-fd8ccff4c-lq5p9\" (UID: \"b463703d-4132-47ca-9d35-16f2f4cd1f14\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lq5p9"
Jul 24 19:30:36.696448 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:36.696433    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lq5p9"
Jul 24 19:30:36.832461 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:36.831538    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lq5p9"]
Jul 24 19:30:37.426102 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:37.426069    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lq5p9" event={"ID":"b463703d-4132-47ca-9d35-16f2f4cd1f14","Type":"ContainerStarted","Data":"77004d572f2700b5ce97db34e5fe0c49fbc9cffb06f7baeec219b3a262afb5d3"}
Jul 24 19:30:40.441049 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:40.441008    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lq5p9" event={"ID":"b463703d-4132-47ca-9d35-16f2f4cd1f14","Type":"ContainerStarted","Data":"939f75ec84ce5be20c64afa851f360166b057baf21ef64979fa238d54e186b4f"}
Jul 24 19:30:40.456800 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:40.456634    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lq5p9" podStartSLOduration=1.570128368 podStartE2EDuration="4.456619622s" totalImagesPullingTime="2.886491254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:30:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:30:40.456434632 +0000 UTC m=+238.645508958" watchObservedRunningTime="2026-07-24 19:30:40.456619622 +0000 UTC m=+238.645693935"
Jul 24 19:30:42.863256 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:42.863222    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxw2bs"]
Jul 24 19:30:42.866537 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:42.866520    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxw2bs"
Jul 24 19:30:42.868803 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:42.868781    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 24 19:30:42.868912 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:42.868881    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 24 19:30:42.869775 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:42.869761    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zrxsn\""
Jul 24 19:30:42.875276 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:42.875255    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxw2bs"]
Jul 24 19:30:42.933998 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:42.933953    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f89bb970-ef8b-4039-a964-64a1a69f9fb5-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxw2bs\" (UID: \"f89bb970-ef8b-4039-a964-64a1a69f9fb5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxw2bs"
Jul 24 19:30:42.933998 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:42.934003    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f89bb970-ef8b-4039-a964-64a1a69f9fb5-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxw2bs\" (UID: \"f89bb970-ef8b-4039-a964-64a1a69f9fb5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxw2bs"
Jul 24 19:30:42.934198 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:42.934037    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jngsr\" (UniqueName: \"kubernetes.io/projected/f89bb970-ef8b-4039-a964-64a1a69f9fb5-kube-api-access-jngsr\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxw2bs\" (UID: \"f89bb970-ef8b-4039-a964-64a1a69f9fb5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxw2bs"
Jul 24 19:30:43.034764 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:43.034715    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f89bb970-ef8b-4039-a964-64a1a69f9fb5-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxw2bs\" (UID: \"f89bb970-ef8b-4039-a964-64a1a69f9fb5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxw2bs"
Jul 24 19:30:43.034939 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:43.034783    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jngsr\" (UniqueName: \"kubernetes.io/projected/f89bb970-ef8b-4039-a964-64a1a69f9fb5-kube-api-access-jngsr\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxw2bs\" (UID: \"f89bb970-ef8b-4039-a964-64a1a69f9fb5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxw2bs"
Jul 24 19:30:43.034998 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:43.034928    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f89bb970-ef8b-4039-a964-64a1a69f9fb5-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxw2bs\" (UID: \"f89bb970-ef8b-4039-a964-64a1a69f9fb5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxw2bs"
Jul 24 19:30:43.035194 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:43.035175    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f89bb970-ef8b-4039-a964-64a1a69f9fb5-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxw2bs\" (UID: \"f89bb970-ef8b-4039-a964-64a1a69f9fb5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxw2bs"
Jul 24 19:30:43.035234 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:43.035223    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f89bb970-ef8b-4039-a964-64a1a69f9fb5-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxw2bs\" (UID: \"f89bb970-ef8b-4039-a964-64a1a69f9fb5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxw2bs"
Jul 24 19:30:43.042764 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:43.042741    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jngsr\" (UniqueName: \"kubernetes.io/projected/f89bb970-ef8b-4039-a964-64a1a69f9fb5-kube-api-access-jngsr\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxw2bs\" (UID: \"f89bb970-ef8b-4039-a964-64a1a69f9fb5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxw2bs"
Jul 24 19:30:43.176775 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:43.176668    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxw2bs"
Jul 24 19:30:43.306687 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:43.306664    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxw2bs"]
Jul 24 19:30:43.309085 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:30:43.309061    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf89bb970_ef8b_4039_a964_64a1a69f9fb5.slice/crio-15d145fb75d675e232a562a677eb4ee2ab06160c27ef8ee8ed783372b59b6557 WatchSource:0}: Error finding container 15d145fb75d675e232a562a677eb4ee2ab06160c27ef8ee8ed783372b59b6557: Status 404 returned error can't find the container with id 15d145fb75d675e232a562a677eb4ee2ab06160c27ef8ee8ed783372b59b6557
Jul 24 19:30:43.454224 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:43.454134    2579 generic.go:356] "Generic (PLEG): container finished" podID="f89bb970-ef8b-4039-a964-64a1a69f9fb5" containerID="64d5391743aa1d365964102b7f523485ed400dd892da97113224a666070e690c" exitCode=0
Jul 24 19:30:43.454402 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:43.454223    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxw2bs" event={"ID":"f89bb970-ef8b-4039-a964-64a1a69f9fb5","Type":"ContainerDied","Data":"64d5391743aa1d365964102b7f523485ed400dd892da97113224a666070e690c"}
Jul 24 19:30:43.454402 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:43.454278    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxw2bs" event={"ID":"f89bb970-ef8b-4039-a964-64a1a69f9fb5","Type":"ContainerStarted","Data":"15d145fb75d675e232a562a677eb4ee2ab06160c27ef8ee8ed783372b59b6557"}
Jul 24 19:30:44.460535 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:44.460449    2579 generic.go:356] "Generic (PLEG): container finished" podID="f89bb970-ef8b-4039-a964-64a1a69f9fb5" containerID="acf54ecb59390d03d48772a842fa912dd5f6bcbb386d2b70b0794ce93fc082cc" exitCode=0
Jul 24 19:30:44.460920 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:44.460541    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxw2bs" event={"ID":"f89bb970-ef8b-4039-a964-64a1a69f9fb5","Type":"ContainerDied","Data":"acf54ecb59390d03d48772a842fa912dd5f6bcbb386d2b70b0794ce93fc082cc"}
Jul 24 19:30:45.467362 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:45.467327    2579 generic.go:356] "Generic (PLEG): container finished" podID="f89bb970-ef8b-4039-a964-64a1a69f9fb5" containerID="8e258477c88c5bba35340bff8c49aece64b147dd4fb5734030854e447697172d" exitCode=0
Jul 24 19:30:45.467757 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:45.467403    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxw2bs" event={"ID":"f89bb970-ef8b-4039-a964-64a1a69f9fb5","Type":"ContainerDied","Data":"8e258477c88c5bba35340bff8c49aece64b147dd4fb5734030854e447697172d"}
Jul 24 19:30:46.595913 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:46.595887    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxw2bs"
Jul 24 19:30:46.664703 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:46.664670    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jngsr\" (UniqueName: \"kubernetes.io/projected/f89bb970-ef8b-4039-a964-64a1a69f9fb5-kube-api-access-jngsr\") pod \"f89bb970-ef8b-4039-a964-64a1a69f9fb5\" (UID: \"f89bb970-ef8b-4039-a964-64a1a69f9fb5\") "
Jul 24 19:30:46.664914 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:46.664715    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f89bb970-ef8b-4039-a964-64a1a69f9fb5-util\") pod \"f89bb970-ef8b-4039-a964-64a1a69f9fb5\" (UID: \"f89bb970-ef8b-4039-a964-64a1a69f9fb5\") "
Jul 24 19:30:46.664914 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:46.664795    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f89bb970-ef8b-4039-a964-64a1a69f9fb5-bundle\") pod \"f89bb970-ef8b-4039-a964-64a1a69f9fb5\" (UID: \"f89bb970-ef8b-4039-a964-64a1a69f9fb5\") "
Jul 24 19:30:46.665529 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:46.665497    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f89bb970-ef8b-4039-a964-64a1a69f9fb5-bundle" (OuterVolumeSpecName: "bundle") pod "f89bb970-ef8b-4039-a964-64a1a69f9fb5" (UID: "f89bb970-ef8b-4039-a964-64a1a69f9fb5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:30:46.666923 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:46.666901    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f89bb970-ef8b-4039-a964-64a1a69f9fb5-kube-api-access-jngsr" (OuterVolumeSpecName: "kube-api-access-jngsr") pod "f89bb970-ef8b-4039-a964-64a1a69f9fb5" (UID: "f89bb970-ef8b-4039-a964-64a1a69f9fb5"). InnerVolumeSpecName "kube-api-access-jngsr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:30:46.670050 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:46.670026    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f89bb970-ef8b-4039-a964-64a1a69f9fb5-util" (OuterVolumeSpecName: "util") pod "f89bb970-ef8b-4039-a964-64a1a69f9fb5" (UID: "f89bb970-ef8b-4039-a964-64a1a69f9fb5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:30:46.765319 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:46.765287    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f89bb970-ef8b-4039-a964-64a1a69f9fb5-bundle\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 19:30:46.765319 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:46.765314    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jngsr\" (UniqueName: \"kubernetes.io/projected/f89bb970-ef8b-4039-a964-64a1a69f9fb5-kube-api-access-jngsr\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 19:30:46.765319 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:46.765324    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f89bb970-ef8b-4039-a964-64a1a69f9fb5-util\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 19:30:47.477496 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:47.477456    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxw2bs" event={"ID":"f89bb970-ef8b-4039-a964-64a1a69f9fb5","Type":"ContainerDied","Data":"15d145fb75d675e232a562a677eb4ee2ab06160c27ef8ee8ed783372b59b6557"}
Jul 24 19:30:47.477496 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:47.477492    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxw2bs"
Jul 24 19:30:47.477706 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:47.477514    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="15d145fb75d675e232a562a677eb4ee2ab06160c27ef8ee8ed783372b59b6557"
Jul 24 19:30:47.655851 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:47.655820    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-9ccbf6686-bmxtf"]
Jul 24 19:30:47.656214 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:47.656099    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f89bb970-ef8b-4039-a964-64a1a69f9fb5" containerName="pull"
Jul 24 19:30:47.656214 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:47.656110    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f89bb970-ef8b-4039-a964-64a1a69f9fb5" containerName="pull"
Jul 24 19:30:47.656214 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:47.656129    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f89bb970-ef8b-4039-a964-64a1a69f9fb5" containerName="util"
Jul 24 19:30:47.656214 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:47.656135    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f89bb970-ef8b-4039-a964-64a1a69f9fb5" containerName="util"
Jul 24 19:30:47.656214 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:47.656146    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f89bb970-ef8b-4039-a964-64a1a69f9fb5" containerName="extract"
Jul 24 19:30:47.656214 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:47.656151    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f89bb970-ef8b-4039-a964-64a1a69f9fb5" containerName="extract"
Jul 24 19:30:47.656214 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:47.656193    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f89bb970-ef8b-4039-a964-64a1a69f9fb5" containerName="extract"
Jul 24 19:30:47.659198 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:47.659183    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-9ccbf6686-bmxtf"
Jul 24 19:30:47.661566 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:47.661545    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-trhxb\""
Jul 24 19:30:47.661678 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:47.661641    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 24 19:30:47.661876 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:47.661863    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 24 19:30:47.662304 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:47.662286    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 24 19:30:47.670162 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:47.670140    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-9ccbf6686-bmxtf"]
Jul 24 19:30:47.673783 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:47.673763    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdv7x\" (UniqueName: \"kubernetes.io/projected/249d775c-1a34-4e43-9910-369a118bca40-kube-api-access-rdv7x\") pod \"lws-controller-manager-9ccbf6686-bmxtf\" (UID: \"249d775c-1a34-4e43-9910-369a118bca40\") " pod="openshift-lws-operator/lws-controller-manager-9ccbf6686-bmxtf"
Jul 24 19:30:47.673870 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:47.673797    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/249d775c-1a34-4e43-9910-369a118bca40-cert\") pod \"lws-controller-manager-9ccbf6686-bmxtf\" (UID: \"249d775c-1a34-4e43-9910-369a118bca40\") " pod="openshift-lws-operator/lws-controller-manager-9ccbf6686-bmxtf"
Jul 24 19:30:47.673870 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:47.673828    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/249d775c-1a34-4e43-9910-369a118bca40-manager-config\") pod \"lws-controller-manager-9ccbf6686-bmxtf\" (UID: \"249d775c-1a34-4e43-9910-369a118bca40\") " pod="openshift-lws-operator/lws-controller-manager-9ccbf6686-bmxtf"
Jul 24 19:30:47.673956 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:47.673883    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/249d775c-1a34-4e43-9910-369a118bca40-metrics-cert\") pod \"lws-controller-manager-9ccbf6686-bmxtf\" (UID: \"249d775c-1a34-4e43-9910-369a118bca40\") " pod="openshift-lws-operator/lws-controller-manager-9ccbf6686-bmxtf"
Jul 24 19:30:47.775076 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:47.775047    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdv7x\" (UniqueName: \"kubernetes.io/projected/249d775c-1a34-4e43-9910-369a118bca40-kube-api-access-rdv7x\") pod \"lws-controller-manager-9ccbf6686-bmxtf\" (UID: \"249d775c-1a34-4e43-9910-369a118bca40\") " pod="openshift-lws-operator/lws-controller-manager-9ccbf6686-bmxtf"
Jul 24 19:30:47.775252 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:47.775085    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/249d775c-1a34-4e43-9910-369a118bca40-cert\") pod \"lws-controller-manager-9ccbf6686-bmxtf\" (UID: \"249d775c-1a34-4e43-9910-369a118bca40\") " pod="openshift-lws-operator/lws-controller-manager-9ccbf6686-bmxtf"
Jul 24 19:30:47.775252 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:47.775106    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/249d775c-1a34-4e43-9910-369a118bca40-manager-config\") pod \"lws-controller-manager-9ccbf6686-bmxtf\" (UID: \"249d775c-1a34-4e43-9910-369a118bca40\") " pod="openshift-lws-operator/lws-controller-manager-9ccbf6686-bmxtf"
Jul 24 19:30:47.775701 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:47.775309    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/249d775c-1a34-4e43-9910-369a118bca40-metrics-cert\") pod \"lws-controller-manager-9ccbf6686-bmxtf\" (UID: \"249d775c-1a34-4e43-9910-369a118bca40\") " pod="openshift-lws-operator/lws-controller-manager-9ccbf6686-bmxtf"
Jul 24 19:30:47.776369 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:47.776330    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/249d775c-1a34-4e43-9910-369a118bca40-manager-config\") pod \"lws-controller-manager-9ccbf6686-bmxtf\" (UID: \"249d775c-1a34-4e43-9910-369a118bca40\") " pod="openshift-lws-operator/lws-controller-manager-9ccbf6686-bmxtf"
Jul 24 19:30:47.782379 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:47.782351    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/249d775c-1a34-4e43-9910-369a118bca40-cert\") pod \"lws-controller-manager-9ccbf6686-bmxtf\" (UID: \"249d775c-1a34-4e43-9910-369a118bca40\") " pod="openshift-lws-operator/lws-controller-manager-9ccbf6686-bmxtf"
Jul 24 19:30:47.782832 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:47.782803    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/249d775c-1a34-4e43-9910-369a118bca40-metrics-cert\") pod \"lws-controller-manager-9ccbf6686-bmxtf\" (UID: \"249d775c-1a34-4e43-9910-369a118bca40\") " pod="openshift-lws-operator/lws-controller-manager-9ccbf6686-bmxtf"
Jul 24 19:30:47.789525 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:47.789506    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdv7x\" (UniqueName: \"kubernetes.io/projected/249d775c-1a34-4e43-9910-369a118bca40-kube-api-access-rdv7x\") pod \"lws-controller-manager-9ccbf6686-bmxtf\" (UID: \"249d775c-1a34-4e43-9910-369a118bca40\") " pod="openshift-lws-operator/lws-controller-manager-9ccbf6686-bmxtf"
Jul 24 19:30:47.969062 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:47.969017    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-9ccbf6686-bmxtf"
Jul 24 19:30:48.121390 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:48.121360    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-9ccbf6686-bmxtf"]
Jul 24 19:30:48.124162 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:30:48.124138    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod249d775c_1a34_4e43_9910_369a118bca40.slice/crio-04a2b14321b3acd90c1a8d8bf5c7cead33e5c25cd1351b1e57cf7a2927fd86b2 WatchSource:0}: Error finding container 04a2b14321b3acd90c1a8d8bf5c7cead33e5c25cd1351b1e57cf7a2927fd86b2: Status 404 returned error can't find the container with id 04a2b14321b3acd90c1a8d8bf5c7cead33e5c25cd1351b1e57cf7a2927fd86b2
Jul 24 19:30:48.482577 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:48.482489    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-9ccbf6686-bmxtf" event={"ID":"249d775c-1a34-4e43-9910-369a118bca40","Type":"ContainerStarted","Data":"04a2b14321b3acd90c1a8d8bf5c7cead33e5c25cd1351b1e57cf7a2927fd86b2"}
Jul 24 19:30:50.492661 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:50.492577    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-9ccbf6686-bmxtf" event={"ID":"249d775c-1a34-4e43-9910-369a118bca40","Type":"ContainerStarted","Data":"4de0020a0188789d2532de3bec40e58b622f1e2674f4123fc3ba312480f339f1"}
Jul 24 19:30:50.492661 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:50.492634    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-9ccbf6686-bmxtf"
Jul 24 19:30:50.507615 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:50.507557    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-9ccbf6686-bmxtf" podStartSLOduration=1.582317153 podStartE2EDuration="3.507537306s" totalImagesPullingTime="1.925220153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:30:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:30:50.507380616 +0000 UTC m=+248.696454931" watchObservedRunningTime="2026-07-24 19:30:50.507537306 +0000 UTC m=+248.696611620"
Jul 24 19:30:56.067521 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:56.067483    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69f558d7f4-bkbhr"]
Jul 24 19:30:56.072342 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:56.072321    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-bkbhr"
Jul 24 19:30:56.074965 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:56.074945    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 24 19:30:56.075099 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:56.074972    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 24 19:30:56.075702 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:56.075670    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-k4bkj\""
Jul 24 19:30:56.075952 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:56.075937    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 24 19:30:56.076512 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:56.076497    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 24 19:30:56.093512 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:56.093489    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69f558d7f4-bkbhr"]
Jul 24 19:30:56.143405 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:56.143377    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44523b7e-3dd0-49ef-bf8c-7b2175e0f913-tmp\") pod \"opendatahub-operator-controller-manager-69f558d7f4-bkbhr\" (UID: \"44523b7e-3dd0-49ef-bf8c-7b2175e0f913\") " pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-bkbhr"
Jul 24 19:30:56.143577 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:56.143419    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/44523b7e-3dd0-49ef-bf8c-7b2175e0f913-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69f558d7f4-bkbhr\" (UID: \"44523b7e-3dd0-49ef-bf8c-7b2175e0f913\") " pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-bkbhr"
Jul 24 19:30:56.143577 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:56.143458    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/44523b7e-3dd0-49ef-bf8c-7b2175e0f913-webhook-cert\") pod \"opendatahub-operator-controller-manager-69f558d7f4-bkbhr\" (UID: \"44523b7e-3dd0-49ef-bf8c-7b2175e0f913\") " pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-bkbhr"
Jul 24 19:30:56.143577 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:56.143541    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/44523b7e-3dd0-49ef-bf8c-7b2175e0f913-manifests\") pod \"opendatahub-operator-controller-manager-69f558d7f4-bkbhr\" (UID: \"44523b7e-3dd0-49ef-bf8c-7b2175e0f913\") " pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-bkbhr"
Jul 24 19:30:56.143679 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:56.143597    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nbqg\" (UniqueName: \"kubernetes.io/projected/44523b7e-3dd0-49ef-bf8c-7b2175e0f913-kube-api-access-4nbqg\") pod \"opendatahub-operator-controller-manager-69f558d7f4-bkbhr\" (UID: \"44523b7e-3dd0-49ef-bf8c-7b2175e0f913\") " pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-bkbhr"
Jul 24 19:30:56.244472 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:56.244432    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nbqg\" (UniqueName: \"kubernetes.io/projected/44523b7e-3dd0-49ef-bf8c-7b2175e0f913-kube-api-access-4nbqg\") pod \"opendatahub-operator-controller-manager-69f558d7f4-bkbhr\" (UID: \"44523b7e-3dd0-49ef-bf8c-7b2175e0f913\") " pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-bkbhr"
Jul 24 19:30:56.244472 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:56.244474    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44523b7e-3dd0-49ef-bf8c-7b2175e0f913-tmp\") pod \"opendatahub-operator-controller-manager-69f558d7f4-bkbhr\" (UID: \"44523b7e-3dd0-49ef-bf8c-7b2175e0f913\") " pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-bkbhr"
Jul 24 19:30:56.244821 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:56.244513    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/44523b7e-3dd0-49ef-bf8c-7b2175e0f913-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69f558d7f4-bkbhr\" (UID: \"44523b7e-3dd0-49ef-bf8c-7b2175e0f913\") " pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-bkbhr"
Jul 24 19:30:56.244821 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:56.244547    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/44523b7e-3dd0-49ef-bf8c-7b2175e0f913-webhook-cert\") pod \"opendatahub-operator-controller-manager-69f558d7f4-bkbhr\" (UID: \"44523b7e-3dd0-49ef-bf8c-7b2175e0f913\") " pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-bkbhr"
Jul 24 19:30:56.244821 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:56.244697    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/44523b7e-3dd0-49ef-bf8c-7b2175e0f913-manifests\") pod \"opendatahub-operator-controller-manager-69f558d7f4-bkbhr\" (UID: \"44523b7e-3dd0-49ef-bf8c-7b2175e0f913\") " pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-bkbhr"
Jul 24 19:30:56.245127 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:56.245106    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/44523b7e-3dd0-49ef-bf8c-7b2175e0f913-manifests\") pod \"opendatahub-operator-controller-manager-69f558d7f4-bkbhr\" (UID: \"44523b7e-3dd0-49ef-bf8c-7b2175e0f913\") " pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-bkbhr"
Jul 24 19:30:56.247106 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:56.247078    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44523b7e-3dd0-49ef-bf8c-7b2175e0f913-tmp\") pod \"opendatahub-operator-controller-manager-69f558d7f4-bkbhr\" (UID: \"44523b7e-3dd0-49ef-bf8c-7b2175e0f913\") " pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-bkbhr"
Jul 24 19:30:56.247234 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:56.247193    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/44523b7e-3dd0-49ef-bf8c-7b2175e0f913-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69f558d7f4-bkbhr\" (UID: \"44523b7e-3dd0-49ef-bf8c-7b2175e0f913\") " pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-bkbhr"
Jul 24 19:30:56.247302 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:56.247283    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/44523b7e-3dd0-49ef-bf8c-7b2175e0f913-webhook-cert\") pod \"opendatahub-operator-controller-manager-69f558d7f4-bkbhr\" (UID: \"44523b7e-3dd0-49ef-bf8c-7b2175e0f913\") " pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-bkbhr"
Jul 24 19:30:56.254115 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:56.254092    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nbqg\" (UniqueName: \"kubernetes.io/projected/44523b7e-3dd0-49ef-bf8c-7b2175e0f913-kube-api-access-4nbqg\") pod \"opendatahub-operator-controller-manager-69f558d7f4-bkbhr\" (UID: \"44523b7e-3dd0-49ef-bf8c-7b2175e0f913\") " pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-bkbhr"
Jul 24 19:30:56.382674 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:56.382598    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-bkbhr"
Jul 24 19:30:56.519442 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:56.519314    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69f558d7f4-bkbhr"]
Jul 24 19:30:56.522319 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:30:56.522292    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44523b7e_3dd0_49ef_bf8c_7b2175e0f913.slice/crio-dccca849e8b21e9a100a93aa88ddd625a7d5e9728c82b651a17c06546125c8bf WatchSource:0}: Error finding container dccca849e8b21e9a100a93aa88ddd625a7d5e9728c82b651a17c06546125c8bf: Status 404 returned error can't find the container with id dccca849e8b21e9a100a93aa88ddd625a7d5e9728c82b651a17c06546125c8bf
Jul 24 19:30:57.525259 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:30:57.525215    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-bkbhr" event={"ID":"44523b7e-3dd0-49ef-bf8c-7b2175e0f913","Type":"ContainerStarted","Data":"dccca849e8b21e9a100a93aa88ddd625a7d5e9728c82b651a17c06546125c8bf"}
Jul 24 19:31:00.539122 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:00.539085    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-bkbhr" event={"ID":"44523b7e-3dd0-49ef-bf8c-7b2175e0f913","Type":"ContainerStarted","Data":"ca86c3d25ef0e44ab46ea33a5bd401b6816dfb7ccc2e94a8f8ff5f92d467eda8"}
Jul 24 19:31:01.499378 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:01.499345    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-9ccbf6686-bmxtf"
Jul 24 19:31:01.545634 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:01.545595    2579 generic.go:356] "Generic (PLEG): container finished" podID="44523b7e-3dd0-49ef-bf8c-7b2175e0f913" containerID="ca86c3d25ef0e44ab46ea33a5bd401b6816dfb7ccc2e94a8f8ff5f92d467eda8" exitCode=0
Jul 24 19:31:01.546120 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:01.545679    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-bkbhr" event={"ID":"44523b7e-3dd0-49ef-bf8c-7b2175e0f913","Type":"ContainerDied","Data":"ca86c3d25ef0e44ab46ea33a5bd401b6816dfb7ccc2e94a8f8ff5f92d467eda8"}
Jul 24 19:31:02.552539 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:02.552462    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-bkbhr" event={"ID":"44523b7e-3dd0-49ef-bf8c-7b2175e0f913","Type":"ContainerStarted","Data":"30e61c1655c434766fa91a3e5e66f6d05d23fcf9b98c975f8f0811bc08188f2f"}
Jul 24 19:31:02.552539 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:02.552535    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-bkbhr"
Jul 24 19:31:02.575317 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:02.575268    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-bkbhr" podStartSLOduration=2.135854271 podStartE2EDuration="6.575251969s" totalImagesPullingTime="3.344059867s" totalInitContainerRuntime="1.095337831s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:30:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:31:02.573926505 +0000 UTC m=+260.763000819" watchObservedRunningTime="2026-07-24 19:31:02.575251969 +0000 UTC m=+260.764326281"
Jul 24 19:31:13.565800 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:13.565763    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-69f558d7f4-bkbhr"
Jul 24 19:31:28.581909 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:28.581878    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-pjn9h"]
Jul 24 19:31:28.590993 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:28.590972    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pjn9h"
Jul 24 19:31:28.594066 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:28.594045    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 24 19:31:28.594180 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:28.594046    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 24 19:31:28.594391 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:28.594377    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 24 19:31:28.594433 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:28.594401    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 24 19:31:28.594564 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:28.594528    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-rsclw\""
Jul 24 19:31:28.594564 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:28.594559    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 24 19:31:28.595072 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:28.595057    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 24 19:31:28.600471 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:28.600450    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-pjn9h"]
Jul 24 19:31:28.716583 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:28.716541    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2048cb12-40b5-4a3f-99d3-3c99a9654d21-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-pjn9h\" (UID: \"2048cb12-40b5-4a3f-99d3-3c99a9654d21\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pjn9h"
Jul 24 19:31:28.716823 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:28.716602    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2048cb12-40b5-4a3f-99d3-3c99a9654d21-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-pjn9h\" (UID: \"2048cb12-40b5-4a3f-99d3-3c99a9654d21\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pjn9h"
Jul 24 19:31:28.716823 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:28.716699    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2048cb12-40b5-4a3f-99d3-3c99a9654d21-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-pjn9h\" (UID: \"2048cb12-40b5-4a3f-99d3-3c99a9654d21\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pjn9h"
Jul 24 19:31:28.716823 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:28.716744    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2048cb12-40b5-4a3f-99d3-3c99a9654d21-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-pjn9h\" (UID: \"2048cb12-40b5-4a3f-99d3-3c99a9654d21\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pjn9h"
Jul 24 19:31:28.716823 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:28.716786    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2048cb12-40b5-4a3f-99d3-3c99a9654d21-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-pjn9h\" (UID: \"2048cb12-40b5-4a3f-99d3-3c99a9654d21\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pjn9h"
Jul 24 19:31:28.717033 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:28.716902    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2048cb12-40b5-4a3f-99d3-3c99a9654d21-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-pjn9h\" (UID: \"2048cb12-40b5-4a3f-99d3-3c99a9654d21\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pjn9h"
Jul 24 19:31:28.717033 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:28.716923    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7gwf\" (UniqueName: \"kubernetes.io/projected/2048cb12-40b5-4a3f-99d3-3c99a9654d21-kube-api-access-d7gwf\") pod \"istiod-openshift-gateway-5677ccb49b-pjn9h\" (UID: \"2048cb12-40b5-4a3f-99d3-3c99a9654d21\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pjn9h"
Jul 24 19:31:28.817352 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:28.817317    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2048cb12-40b5-4a3f-99d3-3c99a9654d21-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-pjn9h\" (UID: \"2048cb12-40b5-4a3f-99d3-3c99a9654d21\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pjn9h"
Jul 24 19:31:28.817352 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:28.817348    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7gwf\" (UniqueName: \"kubernetes.io/projected/2048cb12-40b5-4a3f-99d3-3c99a9654d21-kube-api-access-d7gwf\") pod \"istiod-openshift-gateway-5677ccb49b-pjn9h\" (UID: \"2048cb12-40b5-4a3f-99d3-3c99a9654d21\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pjn9h"
Jul 24 19:31:28.817574 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:28.817385    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2048cb12-40b5-4a3f-99d3-3c99a9654d21-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-pjn9h\" (UID: \"2048cb12-40b5-4a3f-99d3-3c99a9654d21\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pjn9h"
Jul 24 19:31:28.817574 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:28.817419    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2048cb12-40b5-4a3f-99d3-3c99a9654d21-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-pjn9h\" (UID: \"2048cb12-40b5-4a3f-99d3-3c99a9654d21\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pjn9h"
Jul 24 19:31:28.817574 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:28.817458    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2048cb12-40b5-4a3f-99d3-3c99a9654d21-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-pjn9h\" (UID: \"2048cb12-40b5-4a3f-99d3-3c99a9654d21\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pjn9h"
Jul 24 19:31:28.817574 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:28.817480    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2048cb12-40b5-4a3f-99d3-3c99a9654d21-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-pjn9h\" (UID: \"2048cb12-40b5-4a3f-99d3-3c99a9654d21\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pjn9h"
Jul 24 19:31:28.817574 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:28.817500    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2048cb12-40b5-4a3f-99d3-3c99a9654d21-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-pjn9h\" (UID: \"2048cb12-40b5-4a3f-99d3-3c99a9654d21\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pjn9h"
Jul 24 19:31:28.818095 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:28.818068    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2048cb12-40b5-4a3f-99d3-3c99a9654d21-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-pjn9h\" (UID: \"2048cb12-40b5-4a3f-99d3-3c99a9654d21\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pjn9h"
Jul 24 19:31:28.819954 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:28.819931    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2048cb12-40b5-4a3f-99d3-3c99a9654d21-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-pjn9h\" (UID: \"2048cb12-40b5-4a3f-99d3-3c99a9654d21\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pjn9h"
Jul 24 19:31:28.820065 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:28.819992    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2048cb12-40b5-4a3f-99d3-3c99a9654d21-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-pjn9h\" (UID: \"2048cb12-40b5-4a3f-99d3-3c99a9654d21\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pjn9h"
Jul 24 19:31:28.820372 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:28.820350    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2048cb12-40b5-4a3f-99d3-3c99a9654d21-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-pjn9h\" (UID: \"2048cb12-40b5-4a3f-99d3-3c99a9654d21\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pjn9h"
Jul 24 19:31:28.820466 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:28.820448    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2048cb12-40b5-4a3f-99d3-3c99a9654d21-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-pjn9h\" (UID: \"2048cb12-40b5-4a3f-99d3-3c99a9654d21\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pjn9h"
Jul 24 19:31:28.826128 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:28.826104    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2048cb12-40b5-4a3f-99d3-3c99a9654d21-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-pjn9h\" (UID: \"2048cb12-40b5-4a3f-99d3-3c99a9654d21\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pjn9h"
Jul 24 19:31:28.826362 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:28.826346    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7gwf\" (UniqueName: \"kubernetes.io/projected/2048cb12-40b5-4a3f-99d3-3c99a9654d21-kube-api-access-d7gwf\") pod \"istiod-openshift-gateway-5677ccb49b-pjn9h\" (UID: \"2048cb12-40b5-4a3f-99d3-3c99a9654d21\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pjn9h"
Jul 24 19:31:28.900298 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:28.900217    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pjn9h"
Jul 24 19:31:29.035102 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:29.035071    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-pjn9h"]
Jul 24 19:31:29.038351 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:31:29.038327    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2048cb12_40b5_4a3f_99d3_3c99a9654d21.slice/crio-5917d71a6a33cf1407fe19354e8a93cd2d2e4085a5b71cf9979761da0e542c12 WatchSource:0}: Error finding container 5917d71a6a33cf1407fe19354e8a93cd2d2e4085a5b71cf9979761da0e542c12: Status 404 returned error can't find the container with id 5917d71a6a33cf1407fe19354e8a93cd2d2e4085a5b71cf9979761da0e542c12
Jul 24 19:31:29.683645 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:29.683605    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pjn9h" event={"ID":"2048cb12-40b5-4a3f-99d3-3c99a9654d21","Type":"ContainerStarted","Data":"5917d71a6a33cf1407fe19354e8a93cd2d2e4085a5b71cf9979761da0e542c12"}
Jul 24 19:31:31.789088 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:31.789038    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 19:31:31.789475 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:31.789127    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 19:31:32.698402 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:32.698370    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pjn9h" event={"ID":"2048cb12-40b5-4a3f-99d3-3c99a9654d21","Type":"ContainerStarted","Data":"4df08b1a452ddc9a41908c26581ce97d44dd753ec1e11bfc399beef306bc9de1"}
Jul 24 19:31:32.698660 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:32.698424    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pjn9h"
Jul 24 19:31:32.700475 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:32.700445    2579 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-pjn9h container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 19:31:32.700595 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:32.700508    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pjn9h" podUID="2048cb12-40b5-4a3f-99d3-3c99a9654d21" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 19:31:32.721677 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:32.721630    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pjn9h" podStartSLOduration=1.97324557 podStartE2EDuration="4.721615032s" totalImagesPullingTime="2.748369462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:31:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:31:32.719034738 +0000 UTC m=+290.908109086" watchObservedRunningTime="2026-07-24 19:31:32.721615032 +0000 UTC m=+290.910689344"
Jul 24 19:31:33.703646 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:33.703613    2579 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-pjn9h container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 19:31:33.704024 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:33.703667    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pjn9h" podUID="2048cb12-40b5-4a3f-99d3-3c99a9654d21" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 19:31:36.704475 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:36.704438    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pjn9h"
Jul 24 19:31:42.239663 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:42.239630    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vclnd_fa8789c9-6c39-46cd-a540-657dea710eb8/ovn-acl-logging/0.log"
Jul 24 19:31:42.245097 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:42.245070    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vclnd_fa8789c9-6c39-46cd-a540-657dea710eb8/ovn-acl-logging/0.log"
Jul 24 19:31:42.245230 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:31:42.245101    2579 kubelet.go:1648] "Image garbage collection succeeded"
Jul 24 19:32:32.671527 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:32.671446    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldnfs"]
Jul 24 19:32:32.673861 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:32.673843    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldnfs"
Jul 24 19:32:32.676237 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:32.676215    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 24 19:32:32.677261 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:32.677242    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-h25wg\""
Jul 24 19:32:32.677357 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:32.677248    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 24 19:32:32.683320 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:32.683295    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldnfs"]
Jul 24 19:32:32.751118 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:32.751079    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/648defd1-90ce-4050-b16a-b7d4e987b2ae-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldnfs\" (UID: \"648defd1-90ce-4050-b16a-b7d4e987b2ae\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldnfs"
Jul 24 19:32:32.751290 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:32.751124    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/648defd1-90ce-4050-b16a-b7d4e987b2ae-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldnfs\" (UID: \"648defd1-90ce-4050-b16a-b7d4e987b2ae\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldnfs"
Jul 24 19:32:32.751290 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:32.751170    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6t4w\" (UniqueName: \"kubernetes.io/projected/648defd1-90ce-4050-b16a-b7d4e987b2ae-kube-api-access-g6t4w\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldnfs\" (UID: \"648defd1-90ce-4050-b16a-b7d4e987b2ae\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldnfs"
Jul 24 19:32:32.852688 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:32.852649    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/648defd1-90ce-4050-b16a-b7d4e987b2ae-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldnfs\" (UID: \"648defd1-90ce-4050-b16a-b7d4e987b2ae\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldnfs"
Jul 24 19:32:32.852858 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:32.852710    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/648defd1-90ce-4050-b16a-b7d4e987b2ae-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldnfs\" (UID: \"648defd1-90ce-4050-b16a-b7d4e987b2ae\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldnfs"
Jul 24 19:32:32.852858 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:32.852798    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6t4w\" (UniqueName: \"kubernetes.io/projected/648defd1-90ce-4050-b16a-b7d4e987b2ae-kube-api-access-g6t4w\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldnfs\" (UID: \"648defd1-90ce-4050-b16a-b7d4e987b2ae\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldnfs"
Jul 24 19:32:32.853143 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:32.853120    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/648defd1-90ce-4050-b16a-b7d4e987b2ae-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldnfs\" (UID: \"648defd1-90ce-4050-b16a-b7d4e987b2ae\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldnfs"
Jul 24 19:32:32.853180 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:32.853128    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/648defd1-90ce-4050-b16a-b7d4e987b2ae-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldnfs\" (UID: \"648defd1-90ce-4050-b16a-b7d4e987b2ae\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldnfs"
Jul 24 19:32:32.861407 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:32.861382    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6t4w\" (UniqueName: \"kubernetes.io/projected/648defd1-90ce-4050-b16a-b7d4e987b2ae-kube-api-access-g6t4w\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldnfs\" (UID: \"648defd1-90ce-4050-b16a-b7d4e987b2ae\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldnfs"
Jul 24 19:32:32.984020 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:32.983942    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldnfs"
Jul 24 19:32:33.121000 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:33.116187    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldnfs"]
Jul 24 19:32:33.469119 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:33.469085    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbpsc"]
Jul 24 19:32:33.471467 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:33.471452    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbpsc"
Jul 24 19:32:33.480000 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:33.479979    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbpsc"]
Jul 24 19:32:33.558487 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:33.558442    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbpsc\" (UID: \"9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbpsc"
Jul 24 19:32:33.558672 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:33.558503    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w42v\" (UniqueName: \"kubernetes.io/projected/9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7-kube-api-access-8w42v\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbpsc\" (UID: \"9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbpsc"
Jul 24 19:32:33.558672 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:33.558545    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbpsc\" (UID: \"9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbpsc"
Jul 24 19:32:33.659916 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:33.659876    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w42v\" (UniqueName: \"kubernetes.io/projected/9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7-kube-api-access-8w42v\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbpsc\" (UID: \"9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbpsc"
Jul 24 19:32:33.659916 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:33.659922    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbpsc\" (UID: \"9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbpsc"
Jul 24 19:32:33.660133 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:33.659991    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbpsc\" (UID: \"9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbpsc"
Jul 24 19:32:33.660316 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:33.660297    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbpsc\" (UID: \"9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbpsc"
Jul 24 19:32:33.660352 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:33.660340    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbpsc\" (UID: \"9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbpsc"
Jul 24 19:32:33.668075 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:33.668051    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w42v\" (UniqueName: \"kubernetes.io/projected/9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7-kube-api-access-8w42v\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbpsc\" (UID: \"9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbpsc"
Jul 24 19:32:33.781136 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:33.781094    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbpsc"
Jul 24 19:32:33.865822 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:33.865793    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l265r"]
Jul 24 19:32:33.872883 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:33.870703    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l265r"
Jul 24 19:32:33.885262 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:33.884568    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l265r"]
Jul 24 19:32:33.928329 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:33.928304    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbpsc"]
Jul 24 19:32:33.929948 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:32:33.929914    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9378ca0e_2bbe_4ba0_be59_d3a28e83b1b7.slice/crio-625fbeba408345b8dad2f534a227abc76033c3cc54cfe02331345cfc3eb135f9 WatchSource:0}: Error finding container 625fbeba408345b8dad2f534a227abc76033c3cc54cfe02331345cfc3eb135f9: Status 404 returned error can't find the container with id 625fbeba408345b8dad2f534a227abc76033c3cc54cfe02331345cfc3eb135f9
Jul 24 19:32:33.963547 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:33.963523    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55803b5e-0a8a-4fb8-be43-66ae2384ae83-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l265r\" (UID: \"55803b5e-0a8a-4fb8-be43-66ae2384ae83\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l265r"
Jul 24 19:32:33.963666 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:33.963578    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwhfw\" (UniqueName: \"kubernetes.io/projected/55803b5e-0a8a-4fb8-be43-66ae2384ae83-kube-api-access-xwhfw\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l265r\" (UID: \"55803b5e-0a8a-4fb8-be43-66ae2384ae83\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l265r"
Jul 24 19:32:33.963710 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:33.963664    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55803b5e-0a8a-4fb8-be43-66ae2384ae83-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l265r\" (UID: \"55803b5e-0a8a-4fb8-be43-66ae2384ae83\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l265r"
Jul 24 19:32:33.970602 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:33.970575    2579 generic.go:356] "Generic (PLEG): container finished" podID="648defd1-90ce-4050-b16a-b7d4e987b2ae" containerID="ceeb11622b39eb135c0dd602f2dbc1725c95606df7cad494508be8bd2a6a5892" exitCode=0
Jul 24 19:32:33.970742 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:33.970652    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldnfs" event={"ID":"648defd1-90ce-4050-b16a-b7d4e987b2ae","Type":"ContainerDied","Data":"ceeb11622b39eb135c0dd602f2dbc1725c95606df7cad494508be8bd2a6a5892"}
Jul 24 19:32:33.970742 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:33.970707    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldnfs" event={"ID":"648defd1-90ce-4050-b16a-b7d4e987b2ae","Type":"ContainerStarted","Data":"09f1688b9ee6345a251ebfcf4f9acf949a28a6b0705be379f88585dcd65c143a"}
Jul 24 19:32:33.971213 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:33.971194    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 19:32:33.972041 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:33.972019    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbpsc" event={"ID":"9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7","Type":"ContainerStarted","Data":"625fbeba408345b8dad2f534a227abc76033c3cc54cfe02331345cfc3eb135f9"}
Jul 24 19:32:34.064488 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:34.064453    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwhfw\" (UniqueName: \"kubernetes.io/projected/55803b5e-0a8a-4fb8-be43-66ae2384ae83-kube-api-access-xwhfw\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l265r\" (UID: \"55803b5e-0a8a-4fb8-be43-66ae2384ae83\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l265r"
Jul 24 19:32:34.064660 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:34.064524    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55803b5e-0a8a-4fb8-be43-66ae2384ae83-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l265r\" (UID: \"55803b5e-0a8a-4fb8-be43-66ae2384ae83\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l265r"
Jul 24 19:32:34.064660 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:34.064589    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55803b5e-0a8a-4fb8-be43-66ae2384ae83-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l265r\" (UID: \"55803b5e-0a8a-4fb8-be43-66ae2384ae83\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l265r"
Jul 24 19:32:34.065000 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:34.064979    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55803b5e-0a8a-4fb8-be43-66ae2384ae83-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l265r\" (UID: \"55803b5e-0a8a-4fb8-be43-66ae2384ae83\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l265r"
Jul 24 19:32:34.065072 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:34.065009    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55803b5e-0a8a-4fb8-be43-66ae2384ae83-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l265r\" (UID: \"55803b5e-0a8a-4fb8-be43-66ae2384ae83\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l265r"
Jul 24 19:32:34.072893 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:34.072871    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwhfw\" (UniqueName: \"kubernetes.io/projected/55803b5e-0a8a-4fb8-be43-66ae2384ae83-kube-api-access-xwhfw\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l265r\" (UID: \"55803b5e-0a8a-4fb8-be43-66ae2384ae83\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l265r"
Jul 24 19:32:34.196516 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:34.196475    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l265r"
Jul 24 19:32:34.265146 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:34.265119    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73284sb"]
Jul 24 19:32:34.267919 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:34.267899    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73284sb"
Jul 24 19:32:34.277884 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:34.277860    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73284sb"]
Jul 24 19:32:34.329618 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:34.329592    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l265r"]
Jul 24 19:32:34.332146 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:32:34.332112    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55803b5e_0a8a_4fb8_be43_66ae2384ae83.slice/crio-370a25664b1aeda6ceb45102c33e33a7a929cb8f44efe3e0fe3db10472eea645 WatchSource:0}: Error finding container 370a25664b1aeda6ceb45102c33e33a7a929cb8f44efe3e0fe3db10472eea645: Status 404 returned error can't find the container with id 370a25664b1aeda6ceb45102c33e33a7a929cb8f44efe3e0fe3db10472eea645
Jul 24 19:32:34.366405 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:34.366380    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv4l9\" (UniqueName: \"kubernetes.io/projected/6ba14f7d-5712-47c8-b953-7dd2ae929de2-kube-api-access-lv4l9\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73284sb\" (UID: \"6ba14f7d-5712-47c8-b953-7dd2ae929de2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73284sb"
Jul 24 19:32:34.366536 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:34.366437    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ba14f7d-5712-47c8-b953-7dd2ae929de2-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73284sb\" (UID: \"6ba14f7d-5712-47c8-b953-7dd2ae929de2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73284sb"
Jul 24 19:32:34.366536 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:34.366473    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ba14f7d-5712-47c8-b953-7dd2ae929de2-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73284sb\" (UID: \"6ba14f7d-5712-47c8-b953-7dd2ae929de2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73284sb"
Jul 24 19:32:34.467745 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:34.467686    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv4l9\" (UniqueName: \"kubernetes.io/projected/6ba14f7d-5712-47c8-b953-7dd2ae929de2-kube-api-access-lv4l9\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73284sb\" (UID: \"6ba14f7d-5712-47c8-b953-7dd2ae929de2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73284sb"
Jul 24 19:32:34.467916 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:34.467773    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ba14f7d-5712-47c8-b953-7dd2ae929de2-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73284sb\" (UID: \"6ba14f7d-5712-47c8-b953-7dd2ae929de2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73284sb"
Jul 24 19:32:34.467916 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:34.467793    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ba14f7d-5712-47c8-b953-7dd2ae929de2-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73284sb\" (UID: \"6ba14f7d-5712-47c8-b953-7dd2ae929de2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73284sb"
Jul 24 19:32:34.468114 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:34.468099    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ba14f7d-5712-47c8-b953-7dd2ae929de2-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73284sb\" (UID: \"6ba14f7d-5712-47c8-b953-7dd2ae929de2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73284sb"
Jul 24 19:32:34.468155 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:34.468128    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ba14f7d-5712-47c8-b953-7dd2ae929de2-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73284sb\" (UID: \"6ba14f7d-5712-47c8-b953-7dd2ae929de2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73284sb"
Jul 24 19:32:34.476880 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:34.476849    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv4l9\" (UniqueName: \"kubernetes.io/projected/6ba14f7d-5712-47c8-b953-7dd2ae929de2-kube-api-access-lv4l9\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73284sb\" (UID: \"6ba14f7d-5712-47c8-b953-7dd2ae929de2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73284sb"
Jul 24 19:32:34.577521 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:34.577482    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73284sb"
Jul 24 19:32:34.711946 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:34.711921    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73284sb"]
Jul 24 19:32:34.714331 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:32:34.714309    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ba14f7d_5712_47c8_b953_7dd2ae929de2.slice/crio-76f95431d5febe084fbcf4c4ea25fbea3c27b3e372589d62950aad5fda46fe48 WatchSource:0}: Error finding container 76f95431d5febe084fbcf4c4ea25fbea3c27b3e372589d62950aad5fda46fe48: Status 404 returned error can't find the container with id 76f95431d5febe084fbcf4c4ea25fbea3c27b3e372589d62950aad5fda46fe48
Jul 24 19:32:34.980017 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:34.979987    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldnfs" event={"ID":"648defd1-90ce-4050-b16a-b7d4e987b2ae","Type":"ContainerStarted","Data":"33ee1eea9392fe16c62bc136d6c06688cb3ecdaa5d3b38f70f246e1026eeabf9"}
Jul 24 19:32:34.981527 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:34.981505    2579 generic.go:356] "Generic (PLEG): container finished" podID="9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7" containerID="e261bfb6a261faa2ddd6e5f1e50783ff038f6179d7fba71f2aed685367c423da" exitCode=0
Jul 24 19:32:34.981622 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:34.981548    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbpsc" event={"ID":"9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7","Type":"ContainerDied","Data":"e261bfb6a261faa2ddd6e5f1e50783ff038f6179d7fba71f2aed685367c423da"}
Jul 24 19:32:34.983336 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:34.983311    2579 generic.go:356] "Generic (PLEG): container finished" podID="55803b5e-0a8a-4fb8-be43-66ae2384ae83" containerID="247d67c38542d8067df33468195a4e0bc6e86688d5c144684290c7db6cb73374" exitCode=0
Jul 24 19:32:34.983455 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:34.983426    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l265r" event={"ID":"55803b5e-0a8a-4fb8-be43-66ae2384ae83","Type":"ContainerDied","Data":"247d67c38542d8067df33468195a4e0bc6e86688d5c144684290c7db6cb73374"}
Jul 24 19:32:34.983532 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:34.983506    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l265r" event={"ID":"55803b5e-0a8a-4fb8-be43-66ae2384ae83","Type":"ContainerStarted","Data":"370a25664b1aeda6ceb45102c33e33a7a929cb8f44efe3e0fe3db10472eea645"}
Jul 24 19:32:34.985153 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:34.985131    2579 generic.go:356] "Generic (PLEG): container finished" podID="6ba14f7d-5712-47c8-b953-7dd2ae929de2" containerID="de3e5101665047432029329a7df88144b0d86bb6b78fd7a1df1435cf26c3e20a" exitCode=0
Jul 24 19:32:34.985259 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:34.985178    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73284sb" event={"ID":"6ba14f7d-5712-47c8-b953-7dd2ae929de2","Type":"ContainerDied","Data":"de3e5101665047432029329a7df88144b0d86bb6b78fd7a1df1435cf26c3e20a"}
Jul 24 19:32:34.985259 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:34.985210    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73284sb" event={"ID":"6ba14f7d-5712-47c8-b953-7dd2ae929de2","Type":"ContainerStarted","Data":"76f95431d5febe084fbcf4c4ea25fbea3c27b3e372589d62950aad5fda46fe48"}
Jul 24 19:32:35.991466 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:35.991427    2579 generic.go:356] "Generic (PLEG): container finished" podID="6ba14f7d-5712-47c8-b953-7dd2ae929de2" containerID="9b22a93c70e9badc92d24be4e2289581f05f919fa36cdf544cafd564e3b953d6" exitCode=0
Jul 24 19:32:35.991867 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:35.991513    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73284sb" event={"ID":"6ba14f7d-5712-47c8-b953-7dd2ae929de2","Type":"ContainerDied","Data":"9b22a93c70e9badc92d24be4e2289581f05f919fa36cdf544cafd564e3b953d6"}
Jul 24 19:32:35.993413 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:35.993393    2579 generic.go:356] "Generic (PLEG): container finished" podID="648defd1-90ce-4050-b16a-b7d4e987b2ae" containerID="33ee1eea9392fe16c62bc136d6c06688cb3ecdaa5d3b38f70f246e1026eeabf9" exitCode=0
Jul 24 19:32:35.993517 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:35.993483    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldnfs" event={"ID":"648defd1-90ce-4050-b16a-b7d4e987b2ae","Type":"ContainerDied","Data":"33ee1eea9392fe16c62bc136d6c06688cb3ecdaa5d3b38f70f246e1026eeabf9"}
Jul 24 19:32:35.995420 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:35.995401    2579 generic.go:356] "Generic (PLEG): container finished" podID="9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7" containerID="fe218143dfbf660d32e857e94cc0ea7d7d36964858dd4193cea9fcc338c030d8" exitCode=0
Jul 24 19:32:35.995503 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:35.995464    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbpsc" event={"ID":"9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7","Type":"ContainerDied","Data":"fe218143dfbf660d32e857e94cc0ea7d7d36964858dd4193cea9fcc338c030d8"}
Jul 24 19:32:35.997519 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:35.997499    2579 generic.go:356] "Generic (PLEG): container finished" podID="55803b5e-0a8a-4fb8-be43-66ae2384ae83" containerID="cae9ff4a451dc78a3da7d98424ac24144eb07afcea8ec3024aaf323e3648274e" exitCode=0
Jul 24 19:32:35.997622 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:35.997548    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l265r" event={"ID":"55803b5e-0a8a-4fb8-be43-66ae2384ae83","Type":"ContainerDied","Data":"cae9ff4a451dc78a3da7d98424ac24144eb07afcea8ec3024aaf323e3648274e"}
Jul 24 19:32:37.004659 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:37.004622    2579 generic.go:356] "Generic (PLEG): container finished" podID="9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7" containerID="87c4287525e6524d6e810813d88723fe5f6f87001b9b1a4d1527cf00c74dbfc2" exitCode=0
Jul 24 19:32:37.005068 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:37.004712    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbpsc" event={"ID":"9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7","Type":"ContainerDied","Data":"87c4287525e6524d6e810813d88723fe5f6f87001b9b1a4d1527cf00c74dbfc2"}
Jul 24 19:32:37.006873 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:37.006850    2579 generic.go:356] "Generic (PLEG): container finished" podID="55803b5e-0a8a-4fb8-be43-66ae2384ae83" containerID="d9c767c678b6be8f74eed741a3eea46576a89aa6079ed9c816ade94b7b0eeee5" exitCode=0
Jul 24 19:32:37.006998 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:37.006925    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l265r" event={"ID":"55803b5e-0a8a-4fb8-be43-66ae2384ae83","Type":"ContainerDied","Data":"d9c767c678b6be8f74eed741a3eea46576a89aa6079ed9c816ade94b7b0eeee5"}
Jul 24 19:32:37.008992 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:37.008973    2579 generic.go:356] "Generic (PLEG): container finished" podID="6ba14f7d-5712-47c8-b953-7dd2ae929de2" containerID="6950dc42c0e37af23658dc1e526190215f91abf85a40354869abfeae917815df" exitCode=0
Jul 24 19:32:37.009086 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:37.009052    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73284sb" event={"ID":"6ba14f7d-5712-47c8-b953-7dd2ae929de2","Type":"ContainerDied","Data":"6950dc42c0e37af23658dc1e526190215f91abf85a40354869abfeae917815df"}
Jul 24 19:32:37.011211 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:37.011192    2579 generic.go:356] "Generic (PLEG): container finished" podID="648defd1-90ce-4050-b16a-b7d4e987b2ae" containerID="1bf1c54bde87f17d1c9d5f026365cf48d478b391a6271561c4130e68c0cbd678" exitCode=0
Jul 24 19:32:37.011308 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:37.011221    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldnfs" event={"ID":"648defd1-90ce-4050-b16a-b7d4e987b2ae","Type":"ContainerDied","Data":"1bf1c54bde87f17d1c9d5f026365cf48d478b391a6271561c4130e68c0cbd678"}
Jul 24 19:32:38.178950 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:38.178923    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73284sb"
Jul 24 19:32:38.200991 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:38.200846    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ba14f7d-5712-47c8-b953-7dd2ae929de2-util\") pod \"6ba14f7d-5712-47c8-b953-7dd2ae929de2\" (UID: \"6ba14f7d-5712-47c8-b953-7dd2ae929de2\") "
Jul 24 19:32:38.200991 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:38.200964    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lv4l9\" (UniqueName: \"kubernetes.io/projected/6ba14f7d-5712-47c8-b953-7dd2ae929de2-kube-api-access-lv4l9\") pod \"6ba14f7d-5712-47c8-b953-7dd2ae929de2\" (UID: \"6ba14f7d-5712-47c8-b953-7dd2ae929de2\") "
Jul 24 19:32:38.200991 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:38.200989    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ba14f7d-5712-47c8-b953-7dd2ae929de2-bundle\") pod \"6ba14f7d-5712-47c8-b953-7dd2ae929de2\" (UID: \"6ba14f7d-5712-47c8-b953-7dd2ae929de2\") "
Jul 24 19:32:38.201980 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:38.201939    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ba14f7d-5712-47c8-b953-7dd2ae929de2-bundle" (OuterVolumeSpecName: "bundle") pod "6ba14f7d-5712-47c8-b953-7dd2ae929de2" (UID: "6ba14f7d-5712-47c8-b953-7dd2ae929de2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:32:38.204050 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:38.204021    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ba14f7d-5712-47c8-b953-7dd2ae929de2-kube-api-access-lv4l9" (OuterVolumeSpecName: "kube-api-access-lv4l9") pod "6ba14f7d-5712-47c8-b953-7dd2ae929de2" (UID: "6ba14f7d-5712-47c8-b953-7dd2ae929de2"). InnerVolumeSpecName "kube-api-access-lv4l9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:32:38.209760 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:38.209712    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ba14f7d-5712-47c8-b953-7dd2ae929de2-util" (OuterVolumeSpecName: "util") pod "6ba14f7d-5712-47c8-b953-7dd2ae929de2" (UID: "6ba14f7d-5712-47c8-b953-7dd2ae929de2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:32:38.218713 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:38.218690    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l265r"
Jul 24 19:32:38.221485 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:38.221466    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldnfs"
Jul 24 19:32:38.224573 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:38.224557    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbpsc"
Jul 24 19:32:38.302003 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:38.301922    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7-bundle\") pod \"9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7\" (UID: \"9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7\") "
Jul 24 19:32:38.302003 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:38.301959    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwhfw\" (UniqueName: \"kubernetes.io/projected/55803b5e-0a8a-4fb8-be43-66ae2384ae83-kube-api-access-xwhfw\") pod \"55803b5e-0a8a-4fb8-be43-66ae2384ae83\" (UID: \"55803b5e-0a8a-4fb8-be43-66ae2384ae83\") "
Jul 24 19:32:38.302003 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:38.301979    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6t4w\" (UniqueName: \"kubernetes.io/projected/648defd1-90ce-4050-b16a-b7d4e987b2ae-kube-api-access-g6t4w\") pod \"648defd1-90ce-4050-b16a-b7d4e987b2ae\" (UID: \"648defd1-90ce-4050-b16a-b7d4e987b2ae\") "
Jul 24 19:32:38.302249 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:38.302007    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55803b5e-0a8a-4fb8-be43-66ae2384ae83-util\") pod \"55803b5e-0a8a-4fb8-be43-66ae2384ae83\" (UID: \"55803b5e-0a8a-4fb8-be43-66ae2384ae83\") "
Jul 24 19:32:38.302249 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:38.302060    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/648defd1-90ce-4050-b16a-b7d4e987b2ae-bundle\") pod \"648defd1-90ce-4050-b16a-b7d4e987b2ae\" (UID: \"648defd1-90ce-4050-b16a-b7d4e987b2ae\") "
Jul 24 19:32:38.302249 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:38.302100    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/648defd1-90ce-4050-b16a-b7d4e987b2ae-util\") pod \"648defd1-90ce-4050-b16a-b7d4e987b2ae\" (UID: \"648defd1-90ce-4050-b16a-b7d4e987b2ae\") "
Jul 24 19:32:38.302249 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:38.302139    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8w42v\" (UniqueName: \"kubernetes.io/projected/9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7-kube-api-access-8w42v\") pod \"9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7\" (UID: \"9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7\") "
Jul 24 19:32:38.302249 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:38.302186    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55803b5e-0a8a-4fb8-be43-66ae2384ae83-bundle\") pod \"55803b5e-0a8a-4fb8-be43-66ae2384ae83\" (UID: \"55803b5e-0a8a-4fb8-be43-66ae2384ae83\") "
Jul 24 19:32:38.302249 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:38.302207    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7-util\") pod \"9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7\" (UID: \"9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7\") "
Jul 24 19:32:38.302538 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:38.302490    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lv4l9\" (UniqueName: \"kubernetes.io/projected/6ba14f7d-5712-47c8-b953-7dd2ae929de2-kube-api-access-lv4l9\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 19:32:38.302538 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:38.302506    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ba14f7d-5712-47c8-b953-7dd2ae929de2-bundle\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 19:32:38.302538 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:38.302518    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ba14f7d-5712-47c8-b953-7dd2ae929de2-util\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 19:32:38.302538 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:38.302519    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7-bundle" (OuterVolumeSpecName: "bundle") pod "9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7" (UID: "9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:32:38.304088 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:38.303109    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55803b5e-0a8a-4fb8-be43-66ae2384ae83-bundle" (OuterVolumeSpecName: "bundle") pod "55803b5e-0a8a-4fb8-be43-66ae2384ae83" (UID: "55803b5e-0a8a-4fb8-be43-66ae2384ae83"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:32:38.304088 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:38.303056    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/648defd1-90ce-4050-b16a-b7d4e987b2ae-bundle" (OuterVolumeSpecName: "bundle") pod "648defd1-90ce-4050-b16a-b7d4e987b2ae" (UID: "648defd1-90ce-4050-b16a-b7d4e987b2ae"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:32:38.304468 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:38.304443    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/648defd1-90ce-4050-b16a-b7d4e987b2ae-kube-api-access-g6t4w" (OuterVolumeSpecName: "kube-api-access-g6t4w") pod "648defd1-90ce-4050-b16a-b7d4e987b2ae" (UID: "648defd1-90ce-4050-b16a-b7d4e987b2ae"). InnerVolumeSpecName "kube-api-access-g6t4w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:32:38.304594 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:38.304501    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55803b5e-0a8a-4fb8-be43-66ae2384ae83-kube-api-access-xwhfw" (OuterVolumeSpecName: "kube-api-access-xwhfw") pod "55803b5e-0a8a-4fb8-be43-66ae2384ae83" (UID: "55803b5e-0a8a-4fb8-be43-66ae2384ae83"). InnerVolumeSpecName "kube-api-access-xwhfw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:32:38.304926 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:38.304897    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7-kube-api-access-8w42v" (OuterVolumeSpecName: "kube-api-access-8w42v") pod "9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7" (UID: "9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7"). InnerVolumeSpecName "kube-api-access-8w42v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:32:38.308366 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:38.308344    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55803b5e-0a8a-4fb8-be43-66ae2384ae83-util" (OuterVolumeSpecName: "util") pod "55803b5e-0a8a-4fb8-be43-66ae2384ae83" (UID: "55803b5e-0a8a-4fb8-be43-66ae2384ae83"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:32:38.309409 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:38.309390    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7-util" (OuterVolumeSpecName: "util") pod "9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7" (UID: "9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:32:38.309459 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:38.309437    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/648defd1-90ce-4050-b16a-b7d4e987b2ae-util" (OuterVolumeSpecName: "util") pod "648defd1-90ce-4050-b16a-b7d4e987b2ae" (UID: "648defd1-90ce-4050-b16a-b7d4e987b2ae"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:32:38.403264 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:38.403240    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/648defd1-90ce-4050-b16a-b7d4e987b2ae-bundle\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 19:32:38.403264 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:38.403267    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/648defd1-90ce-4050-b16a-b7d4e987b2ae-util\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 19:32:38.403436 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:38.403280    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8w42v\" (UniqueName: \"kubernetes.io/projected/9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7-kube-api-access-8w42v\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 19:32:38.403436 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:38.403293    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55803b5e-0a8a-4fb8-be43-66ae2384ae83-bundle\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 19:32:38.403436 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:38.403306    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7-util\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 19:32:38.403436 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:38.403316    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7-bundle\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 19:32:38.403436 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:38.403328    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwhfw\" (UniqueName: \"kubernetes.io/projected/55803b5e-0a8a-4fb8-be43-66ae2384ae83-kube-api-access-xwhfw\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 19:32:38.403436 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:38.403339    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6t4w\" (UniqueName: \"kubernetes.io/projected/648defd1-90ce-4050-b16a-b7d4e987b2ae-kube-api-access-g6t4w\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 19:32:38.403436 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:38.403351    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55803b5e-0a8a-4fb8-be43-66ae2384ae83-util\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 19:32:39.025948 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:39.025922    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73284sb"
Jul 24 19:32:39.025948 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:39.025929    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73284sb" event={"ID":"6ba14f7d-5712-47c8-b953-7dd2ae929de2","Type":"ContainerDied","Data":"76f95431d5febe084fbcf4c4ea25fbea3c27b3e372589d62950aad5fda46fe48"}
Jul 24 19:32:39.026170 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:39.025975    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="76f95431d5febe084fbcf4c4ea25fbea3c27b3e372589d62950aad5fda46fe48"
Jul 24 19:32:39.028002 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:39.027982    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldnfs"
Jul 24 19:32:39.028124 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:39.028025    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldnfs" event={"ID":"648defd1-90ce-4050-b16a-b7d4e987b2ae","Type":"ContainerDied","Data":"09f1688b9ee6345a251ebfcf4f9acf949a28a6b0705be379f88585dcd65c143a"}
Jul 24 19:32:39.028124 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:39.028063    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="09f1688b9ee6345a251ebfcf4f9acf949a28a6b0705be379f88585dcd65c143a"
Jul 24 19:32:39.030037 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:39.030016    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbpsc"
Jul 24 19:32:39.030178 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:39.030022    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbpsc" event={"ID":"9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7","Type":"ContainerDied","Data":"625fbeba408345b8dad2f534a227abc76033c3cc54cfe02331345cfc3eb135f9"}
Jul 24 19:32:39.030178 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:39.030075    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="625fbeba408345b8dad2f534a227abc76033c3cc54cfe02331345cfc3eb135f9"
Jul 24 19:32:39.031962 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:39.031937    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l265r" event={"ID":"55803b5e-0a8a-4fb8-be43-66ae2384ae83","Type":"ContainerDied","Data":"370a25664b1aeda6ceb45102c33e33a7a929cb8f44efe3e0fe3db10472eea645"}
Jul 24 19:32:39.032063 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:39.031981    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="370a25664b1aeda6ceb45102c33e33a7a929cb8f44efe3e0fe3db10472eea645"
Jul 24 19:32:39.032063 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:32:39.031996    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l265r"
Jul 24 19:33:41.102991 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:41.102956    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:33:41.103419 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:41.103245    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ba14f7d-5712-47c8-b953-7dd2ae929de2" containerName="extract"
Jul 24 19:33:41.103419 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:41.103256    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ba14f7d-5712-47c8-b953-7dd2ae929de2" containerName="extract"
Jul 24 19:33:41.103419 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:41.103265    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="648defd1-90ce-4050-b16a-b7d4e987b2ae" containerName="util"
Jul 24 19:33:41.103419 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:41.103271    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="648defd1-90ce-4050-b16a-b7d4e987b2ae" containerName="util"
Jul 24 19:33:41.103419 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:41.103279    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ba14f7d-5712-47c8-b953-7dd2ae929de2" containerName="pull"
Jul 24 19:33:41.103419 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:41.103285    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ba14f7d-5712-47c8-b953-7dd2ae929de2" containerName="pull"
Jul 24 19:33:41.103419 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:41.103291    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55803b5e-0a8a-4fb8-be43-66ae2384ae83" containerName="util"
Jul 24 19:33:41.103419 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:41.103296    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="55803b5e-0a8a-4fb8-be43-66ae2384ae83" containerName="util"
Jul 24 19:33:41.103419 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:41.103303    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ba14f7d-5712-47c8-b953-7dd2ae929de2" containerName="util"
Jul 24 19:33:41.103419 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:41.103307    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ba14f7d-5712-47c8-b953-7dd2ae929de2" containerName="util"
Jul 24 19:33:41.103419 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:41.103314    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7" containerName="extract"
Jul 24 19:33:41.103419 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:41.103319    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7" containerName="extract"
Jul 24 19:33:41.103419 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:41.103332    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55803b5e-0a8a-4fb8-be43-66ae2384ae83" containerName="pull"
Jul 24 19:33:41.103419 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:41.103337    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="55803b5e-0a8a-4fb8-be43-66ae2384ae83" containerName="pull"
Jul 24 19:33:41.103419 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:41.103343    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55803b5e-0a8a-4fb8-be43-66ae2384ae83" containerName="extract"
Jul 24 19:33:41.103419 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:41.103347    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="55803b5e-0a8a-4fb8-be43-66ae2384ae83" containerName="extract"
Jul 24 19:33:41.103419 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:41.103354    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="648defd1-90ce-4050-b16a-b7d4e987b2ae" containerName="extract"
Jul 24 19:33:41.103419 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:41.103359    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="648defd1-90ce-4050-b16a-b7d4e987b2ae" containerName="extract"
Jul 24 19:33:41.103419 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:41.103367    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="648defd1-90ce-4050-b16a-b7d4e987b2ae" containerName="pull"
Jul 24 19:33:41.103419 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:41.103372    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="648defd1-90ce-4050-b16a-b7d4e987b2ae" containerName="pull"
Jul 24 19:33:41.103419 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:41.103378    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7" containerName="util"
Jul 24 19:33:41.103419 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:41.103383    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7" containerName="util"
Jul 24 19:33:41.103419 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:41.103388    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7" containerName="pull"
Jul 24 19:33:41.103419 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:41.103392    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7" containerName="pull"
Jul 24 19:33:41.104113 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:41.103440    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="648defd1-90ce-4050-b16a-b7d4e987b2ae" containerName="extract"
Jul 24 19:33:41.104113 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:41.103448    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7" containerName="extract"
Jul 24 19:33:41.104113 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:41.103454    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="55803b5e-0a8a-4fb8-be43-66ae2384ae83" containerName="extract"
Jul 24 19:33:41.104113 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:41.103459    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ba14f7d-5712-47c8-b953-7dd2ae929de2" containerName="extract"
Jul 24 19:33:41.105465 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:41.105449    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"
Jul 24 19:33:41.108239 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:41.108216    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-h25wg\""
Jul 24 19:33:41.108382 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:41.108304    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 24 19:33:41.109300 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:41.109279    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 24 19:33:41.109300 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:41.109301    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 24 19:33:41.117395 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:41.117374    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:33:41.127535 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:41.127513    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c37179b3-74c5-4aa0-85be-27cda6e021e1-config-file\") pod \"limitador-limitador-54d6d988d5-f9dbl\" (UID: \"c37179b3-74c5-4aa0-85be-27cda6e021e1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"
Jul 24 19:33:41.127651 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:41.127545    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2td7\" (UniqueName: \"kubernetes.io/projected/c37179b3-74c5-4aa0-85be-27cda6e021e1-kube-api-access-q2td7\") pod \"limitador-limitador-54d6d988d5-f9dbl\" (UID: \"c37179b3-74c5-4aa0-85be-27cda6e021e1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"
Jul 24 19:33:41.153741 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:41.153697    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:33:41.228542 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:41.228508    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c37179b3-74c5-4aa0-85be-27cda6e021e1-config-file\") pod \"limitador-limitador-54d6d988d5-f9dbl\" (UID: \"c37179b3-74c5-4aa0-85be-27cda6e021e1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"
Jul 24 19:33:41.228746 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:41.228548    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2td7\" (UniqueName: \"kubernetes.io/projected/c37179b3-74c5-4aa0-85be-27cda6e021e1-kube-api-access-q2td7\") pod \"limitador-limitador-54d6d988d5-f9dbl\" (UID: \"c37179b3-74c5-4aa0-85be-27cda6e021e1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"
Jul 24 19:33:41.229253 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:41.229233    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c37179b3-74c5-4aa0-85be-27cda6e021e1-config-file\") pod \"limitador-limitador-54d6d988d5-f9dbl\" (UID: \"c37179b3-74c5-4aa0-85be-27cda6e021e1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"
Jul 24 19:33:41.236921 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:41.236898    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2td7\" (UniqueName: \"kubernetes.io/projected/c37179b3-74c5-4aa0-85be-27cda6e021e1-kube-api-access-q2td7\") pod \"limitador-limitador-54d6d988d5-f9dbl\" (UID: \"c37179b3-74c5-4aa0-85be-27cda6e021e1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"
Jul 24 19:33:41.416265 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:41.416175    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"
Jul 24 19:33:41.552186 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:41.552163    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:33:41.554188 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:33:41.554162    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc37179b3_74c5_4aa0_85be_27cda6e021e1.slice/crio-50f04cf975698b6acca29ad93b96ab57938deb443da0fbbe320e3fe0b70e165d WatchSource:0}: Error finding container 50f04cf975698b6acca29ad93b96ab57938deb443da0fbbe320e3fe0b70e165d: Status 404 returned error can't find the container with id 50f04cf975698b6acca29ad93b96ab57938deb443da0fbbe320e3fe0b70e165d
Jul 24 19:33:42.335178 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:42.335083    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-f9dbl" event={"ID":"c37179b3-74c5-4aa0-85be-27cda6e021e1","Type":"ContainerStarted","Data":"50f04cf975698b6acca29ad93b96ab57938deb443da0fbbe320e3fe0b70e165d"}
Jul 24 19:33:44.346671 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:44.346632    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-f9dbl" event={"ID":"c37179b3-74c5-4aa0-85be-27cda6e021e1","Type":"ContainerStarted","Data":"8f259af2f3ee0e40cfa4b719c92bc683bedbd44f6c072d1b125f383c4ce64310"}
Jul 24 19:33:44.347109 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:44.346705    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"
Jul 24 19:33:44.364226 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:44.364127    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-f9dbl" podStartSLOduration=0.741783029 podStartE2EDuration="3.364105212s" totalImagesPullingTime="2.622322183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:33:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:33:44.361386339 +0000 UTC m=+422.550460653" watchObservedRunningTime="2026-07-24 19:33:44.364105212 +0000 UTC m=+422.553179526"
Jul 24 19:33:55.352833 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:33:55.352795    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"
Jul 24 19:34:55.689592 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:34:55.689560    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:35:20.902085 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:35:20.902052    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw"]
Jul 24 19:35:20.904283 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:35:20.904263    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw"
Jul 24 19:35:20.908436 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:35:20.908417    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mdztr\""
Jul 24 19:35:20.908551 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:35:20.908488    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 24 19:35:20.909109 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:35:20.909090    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 24 19:35:20.911238 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:35:20.911005    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 24 19:35:20.928618 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:35:20.928584    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw"]
Jul 24 19:35:21.035068 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:35:21.035008    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqfp2\" (UniqueName: \"kubernetes.io/projected/0dd37235-69bc-473d-bfde-a02cbdde454a-kube-api-access-cqfp2\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw\" (UID: \"0dd37235-69bc-473d-bfde-a02cbdde454a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw"
Jul 24 19:35:21.035251 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:35:21.035087    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0dd37235-69bc-473d-bfde-a02cbdde454a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw\" (UID: \"0dd37235-69bc-473d-bfde-a02cbdde454a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw"
Jul 24 19:35:21.035251 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:35:21.035138    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0dd37235-69bc-473d-bfde-a02cbdde454a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw\" (UID: \"0dd37235-69bc-473d-bfde-a02cbdde454a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw"
Jul 24 19:35:21.035251 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:35:21.035184    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0dd37235-69bc-473d-bfde-a02cbdde454a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw\" (UID: \"0dd37235-69bc-473d-bfde-a02cbdde454a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw"
Jul 24 19:35:21.035251 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:35:21.035211    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0dd37235-69bc-473d-bfde-a02cbdde454a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw\" (UID: \"0dd37235-69bc-473d-bfde-a02cbdde454a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw"
Jul 24 19:35:21.035400 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:35:21.035289    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0dd37235-69bc-473d-bfde-a02cbdde454a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw\" (UID: \"0dd37235-69bc-473d-bfde-a02cbdde454a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw"
Jul 24 19:35:21.135988 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:35:21.135951    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0dd37235-69bc-473d-bfde-a02cbdde454a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw\" (UID: \"0dd37235-69bc-473d-bfde-a02cbdde454a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw"
Jul 24 19:35:21.135988 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:35:21.135993    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqfp2\" (UniqueName: \"kubernetes.io/projected/0dd37235-69bc-473d-bfde-a02cbdde454a-kube-api-access-cqfp2\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw\" (UID: \"0dd37235-69bc-473d-bfde-a02cbdde454a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw"
Jul 24 19:35:21.136234 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:35:21.136017    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0dd37235-69bc-473d-bfde-a02cbdde454a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw\" (UID: \"0dd37235-69bc-473d-bfde-a02cbdde454a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw"
Jul 24 19:35:21.136234 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:35:21.136045    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0dd37235-69bc-473d-bfde-a02cbdde454a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw\" (UID: \"0dd37235-69bc-473d-bfde-a02cbdde454a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw"
Jul 24 19:35:21.136234 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:35:21.136114    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0dd37235-69bc-473d-bfde-a02cbdde454a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw\" (UID: \"0dd37235-69bc-473d-bfde-a02cbdde454a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw"
Jul 24 19:35:21.136234 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:35:21.136148    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0dd37235-69bc-473d-bfde-a02cbdde454a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw\" (UID: \"0dd37235-69bc-473d-bfde-a02cbdde454a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw"
Jul 24 19:35:21.136446 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:35:21.136425    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0dd37235-69bc-473d-bfde-a02cbdde454a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw\" (UID: \"0dd37235-69bc-473d-bfde-a02cbdde454a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw"
Jul 24 19:35:21.136563 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:35:21.136545    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0dd37235-69bc-473d-bfde-a02cbdde454a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw\" (UID: \"0dd37235-69bc-473d-bfde-a02cbdde454a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw"
Jul 24 19:35:21.136618 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:35:21.136554    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0dd37235-69bc-473d-bfde-a02cbdde454a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw\" (UID: \"0dd37235-69bc-473d-bfde-a02cbdde454a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw"
Jul 24 19:35:21.138593 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:35:21.138559    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0dd37235-69bc-473d-bfde-a02cbdde454a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw\" (UID: \"0dd37235-69bc-473d-bfde-a02cbdde454a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw"
Jul 24 19:35:21.138884 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:35:21.138865    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0dd37235-69bc-473d-bfde-a02cbdde454a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw\" (UID: \"0dd37235-69bc-473d-bfde-a02cbdde454a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw"
Jul 24 19:35:21.144284 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:35:21.144243    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqfp2\" (UniqueName: \"kubernetes.io/projected/0dd37235-69bc-473d-bfde-a02cbdde454a-kube-api-access-cqfp2\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw\" (UID: \"0dd37235-69bc-473d-bfde-a02cbdde454a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw"
Jul 24 19:35:21.220655 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:35:21.220562    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw"
Jul 24 19:35:21.355859 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:35:21.355835    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw"]
Jul 24 19:35:21.357912 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:35:21.357879    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dd37235_69bc_473d_bfde_a02cbdde454a.slice/crio-769dc1dcf7945d7a244843e3279bb4a48ce22d73805ef95b879402612045bae1 WatchSource:0}: Error finding container 769dc1dcf7945d7a244843e3279bb4a48ce22d73805ef95b879402612045bae1: Status 404 returned error can't find the container with id 769dc1dcf7945d7a244843e3279bb4a48ce22d73805ef95b879402612045bae1
Jul 24 19:35:21.493412 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:35:21.493339    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:35:21.814332 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:35:21.814290    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw" event={"ID":"0dd37235-69bc-473d-bfde-a02cbdde454a","Type":"ContainerStarted","Data":"769dc1dcf7945d7a244843e3279bb4a48ce22d73805ef95b879402612045bae1"}
Jul 24 19:35:22.820634 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:35:22.820588    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw" event={"ID":"0dd37235-69bc-473d-bfde-a02cbdde454a","Type":"ContainerStarted","Data":"68c60dc5e8936098715f1aab8fe46fa7598d75f7c7c9fa1ce05f39d3f5da05e9"}
Jul 24 19:35:22.842783 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:35:22.842697    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw" podStartSLOduration=1.70109969 podStartE2EDuration="2.842680194s" totalImagesPullingTime="1.141580504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:35:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:35:22.839895295 +0000 UTC m=+521.028969609" watchObservedRunningTime="2026-07-24 19:35:22.842680194 +0000 UTC m=+521.031754484"
Jul 24 19:35:31.221010 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:35:31.220962    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw"
Jul 24 19:35:31.221502 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:35:31.221045    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw"
Jul 24 19:35:31.233794 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:35:31.233765    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw"
Jul 24 19:35:31.874198 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:35:31.874164    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw"
Jul 24 19:35:36.787396 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:35:36.787314    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:36:03.422334 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:36:03.422296    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:36:07.803936 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:36:07.803906    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:36:17.500453 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:36:17.500420    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-sk6sd"]
Jul 24 19:36:17.503854 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:36:17.503838    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sk6sd"
Jul 24 19:36:17.507594 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:36:17.507573    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 24 19:36:17.518284 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:36:17.518258    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-sk6sd"]
Jul 24 19:36:17.608117 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:36:17.608064    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ktw9\" (UniqueName: \"kubernetes.io/projected/0a948a2a-9db9-48ac-b7d3-a22976d0f6b6-kube-api-access-9ktw9\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sk6sd\" (UID: \"0a948a2a-9db9-48ac-b7d3-a22976d0f6b6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sk6sd"
Jul 24 19:36:17.608117 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:36:17.608116    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a948a2a-9db9-48ac-b7d3-a22976d0f6b6-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sk6sd\" (UID: \"0a948a2a-9db9-48ac-b7d3-a22976d0f6b6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sk6sd"
Jul 24 19:36:17.608338 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:36:17.608142    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a948a2a-9db9-48ac-b7d3-a22976d0f6b6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sk6sd\" (UID: \"0a948a2a-9db9-48ac-b7d3-a22976d0f6b6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sk6sd"
Jul 24 19:36:17.608338 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:36:17.608211    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a948a2a-9db9-48ac-b7d3-a22976d0f6b6-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sk6sd\" (UID: \"0a948a2a-9db9-48ac-b7d3-a22976d0f6b6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sk6sd"
Jul 24 19:36:17.608338 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:36:17.608240    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a948a2a-9db9-48ac-b7d3-a22976d0f6b6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sk6sd\" (UID: \"0a948a2a-9db9-48ac-b7d3-a22976d0f6b6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sk6sd"
Jul 24 19:36:17.608338 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:36:17.608258    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a948a2a-9db9-48ac-b7d3-a22976d0f6b6-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sk6sd\" (UID: \"0a948a2a-9db9-48ac-b7d3-a22976d0f6b6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sk6sd"
Jul 24 19:36:17.709586 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:36:17.709536    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ktw9\" (UniqueName: \"kubernetes.io/projected/0a948a2a-9db9-48ac-b7d3-a22976d0f6b6-kube-api-access-9ktw9\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sk6sd\" (UID: \"0a948a2a-9db9-48ac-b7d3-a22976d0f6b6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sk6sd"
Jul 24 19:36:17.709586 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:36:17.709586    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a948a2a-9db9-48ac-b7d3-a22976d0f6b6-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sk6sd\" (UID: \"0a948a2a-9db9-48ac-b7d3-a22976d0f6b6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sk6sd"
Jul 24 19:36:17.709899 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:36:17.709607    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a948a2a-9db9-48ac-b7d3-a22976d0f6b6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sk6sd\" (UID: \"0a948a2a-9db9-48ac-b7d3-a22976d0f6b6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sk6sd"
Jul 24 19:36:17.709899 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:36:17.709636    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a948a2a-9db9-48ac-b7d3-a22976d0f6b6-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sk6sd\" (UID: \"0a948a2a-9db9-48ac-b7d3-a22976d0f6b6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sk6sd"
Jul 24 19:36:17.709899 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:36:17.709674    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a948a2a-9db9-48ac-b7d3-a22976d0f6b6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sk6sd\" (UID: \"0a948a2a-9db9-48ac-b7d3-a22976d0f6b6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sk6sd"
Jul 24 19:36:17.709899 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:36:17.709690    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a948a2a-9db9-48ac-b7d3-a22976d0f6b6-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sk6sd\" (UID: \"0a948a2a-9db9-48ac-b7d3-a22976d0f6b6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sk6sd"
Jul 24 19:36:17.710090 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:36:17.710074    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a948a2a-9db9-48ac-b7d3-a22976d0f6b6-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sk6sd\" (UID: \"0a948a2a-9db9-48ac-b7d3-a22976d0f6b6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sk6sd"
Jul 24 19:36:17.710142 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:36:17.710089    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a948a2a-9db9-48ac-b7d3-a22976d0f6b6-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sk6sd\" (UID: \"0a948a2a-9db9-48ac-b7d3-a22976d0f6b6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sk6sd"
Jul 24 19:36:17.710142 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:36:17.710127    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a948a2a-9db9-48ac-b7d3-a22976d0f6b6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sk6sd\" (UID: \"0a948a2a-9db9-48ac-b7d3-a22976d0f6b6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sk6sd"
Jul 24 19:36:17.711958 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:36:17.711934    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a948a2a-9db9-48ac-b7d3-a22976d0f6b6-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sk6sd\" (UID: \"0a948a2a-9db9-48ac-b7d3-a22976d0f6b6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sk6sd"
Jul 24 19:36:17.712211 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:36:17.712194    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a948a2a-9db9-48ac-b7d3-a22976d0f6b6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sk6sd\" (UID: \"0a948a2a-9db9-48ac-b7d3-a22976d0f6b6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sk6sd"
Jul 24 19:36:17.725570 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:36:17.725545    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ktw9\" (UniqueName: \"kubernetes.io/projected/0a948a2a-9db9-48ac-b7d3-a22976d0f6b6-kube-api-access-9ktw9\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sk6sd\" (UID: \"0a948a2a-9db9-48ac-b7d3-a22976d0f6b6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sk6sd"
Jul 24 19:36:17.813529 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:36:17.813478    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sk6sd"
Jul 24 19:36:17.955815 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:36:17.955790    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-sk6sd"]
Jul 24 19:36:17.957579 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:36:17.957549    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a948a2a_9db9_48ac_b7d3_a22976d0f6b6.slice/crio-692d9702471bc2733a0a6b9d767391bb58b4a72371617051192d042927f84481 WatchSource:0}: Error finding container 692d9702471bc2733a0a6b9d767391bb58b4a72371617051192d042927f84481: Status 404 returned error can't find the container with id 692d9702471bc2733a0a6b9d767391bb58b4a72371617051192d042927f84481
Jul 24 19:36:18.083311 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:36:18.083221    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sk6sd" event={"ID":"0a948a2a-9db9-48ac-b7d3-a22976d0f6b6","Type":"ContainerStarted","Data":"692d9702471bc2733a0a6b9d767391bb58b4a72371617051192d042927f84481"}
Jul 24 19:36:19.089788 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:36:19.089747    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sk6sd" event={"ID":"0a948a2a-9db9-48ac-b7d3-a22976d0f6b6","Type":"ContainerStarted","Data":"e878ca17692ea451b03dbd04e483725c3e3b2d53e1e253439e4794290e716b6a"}
Jul 24 19:36:19.109153 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:36:19.109105    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sk6sd" podStartSLOduration=1.930505012 podStartE2EDuration="2.109089628s" totalImagesPullingTime="178.584616ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:36:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:36:19.107363502 +0000 UTC m=+577.296437816" watchObservedRunningTime="2026-07-24 19:36:19.109089628 +0000 UTC m=+577.298163940"
Jul 24 19:36:19.789568 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:36:19.789516    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:36:27.813862 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:36:27.813814    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sk6sd"
Jul 24 19:36:27.814312 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:36:27.813888    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sk6sd"
Jul 24 19:36:27.826646 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:36:27.826612    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sk6sd"
Jul 24 19:36:28.145794 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:36:28.145705    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sk6sd"
Jul 24 19:36:37.485333 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:36:37.485296    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:36:42.280216 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:36:42.280190    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vclnd_fa8789c9-6c39-46cd-a540-657dea710eb8/ovn-acl-logging/0.log"
Jul 24 19:36:42.280610 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:36:42.280199    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vclnd_fa8789c9-6c39-46cd-a540-657dea710eb8/ovn-acl-logging/0.log"
Jul 24 19:38:01.995467 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:38:01.995430    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:38:13.386226 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:38:13.386191    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:38:23.892103 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:38:23.892063    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:40:07.085532 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:40:07.085450    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:40:16.185481 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:40:16.185444    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:40:29.035328 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:40:29.035293    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:40:45.689308 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:40:45.689271    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:40:55.877423 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:40:55.877387    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:41:05.196635 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:41:05.193709    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:41:16.994169 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:41:16.994128    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:41:26.386867 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:41:26.386817    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:41:35.494035 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:41:35.493950    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:41:42.312268 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:41:42.312239    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vclnd_fa8789c9-6c39-46cd-a540-657dea710eb8/ovn-acl-logging/0.log"
Jul 24 19:41:42.315098 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:41:42.315072    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vclnd_fa8789c9-6c39-46cd-a540-657dea710eb8/ovn-acl-logging/0.log"
Jul 24 19:41:46.887041 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:41:46.887004    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:41:56.486699 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:41:56.486657    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:42:19.191810 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:42:19.191769    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:42:28.894259 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:42:28.894223    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:42:51.604372 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:42:51.604336    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:43:02.782586 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:43:02.782501    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:43:18.996045 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:43:18.996006    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:43:28.693768 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:43:28.693713    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:43:38.392644 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:43:38.392608    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:43:47.692507 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:43:47.692467    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:43:56.990363 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:43:56.990317    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:45:44.488702 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:45:44.488661    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:45:54.491367 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:45:54.491330    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:46:07.493817 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:46:07.493707    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:46:17.987502 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:46:17.987467    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:46:29.788432 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:46:29.788392    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:46:39.087652 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:46:39.087617    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:46:42.345455 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:46:42.345426    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vclnd_fa8789c9-6c39-46cd-a540-657dea710eb8/ovn-acl-logging/0.log"
Jul 24 19:46:42.349300 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:46:42.349279    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vclnd_fa8789c9-6c39-46cd-a540-657dea710eb8/ovn-acl-logging/0.log"
Jul 24 19:46:49.387781 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:46:49.387739    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:47:00.383831 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:47:00.383798    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:47:10.985257 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:47:10.985224    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:47:19.484858 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:47:19.484822    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:47:32.584426 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:47:32.584352    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:47:49.986000 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:47:49.985963    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:47:59.386939 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:47:59.386904    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:48:13.179157 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:48:13.179118    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:48:22.501313 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:48:22.501278    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:48:49.001544 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:48:49.001507    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:49:03.386712 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:49:03.386623    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:49:10.489458 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:49:10.489422    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:49:26.186709 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:49:26.186672    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:49:36.893532 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:49:36.893499    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:49:46.278742 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:49:46.278697    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:49:56.598251 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:49:56.598213    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:50:05.984225 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:50:05.984187    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:50:16.087852 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:50:16.087815    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:50:29.593824 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:50:29.593788    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:50:39.087671 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:50:39.087588    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:50:53.402651 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:50:53.402621    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:51:01.286448 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:51:01.286413    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:51:13.483285 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:51:13.483247    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:51:29.188228 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:51:29.188190    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:51:38.792295 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:51:38.792263    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:51:42.379170 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:51:42.379141    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vclnd_fa8789c9-6c39-46cd-a540-657dea710eb8/ovn-acl-logging/0.log"
Jul 24 19:51:42.388448 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:51:42.388425    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vclnd_fa8789c9-6c39-46cd-a540-657dea710eb8/ovn-acl-logging/0.log"
Jul 24 19:51:48.644574 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:51:48.644537    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:51:57.395796 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:51:57.395755    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:52:06.196151 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:52:06.196060    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:52:28.194241 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:52:28.194211    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:52:36.369703 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:52:36.369668    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9bce955c-78c767c74d-zhjzr"]
Jul 24 19:52:36.373405 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:52:36.373386    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9bce955c-78c767c74d-zhjzr"
Jul 24 19:52:36.377026 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:52:36.376995    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 24 19:52:36.377183 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:52:36.377083    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-z5t42\""
Jul 24 19:52:36.377183 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:52:36.377083    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-9bce955c-serving-cert\""
Jul 24 19:52:36.377407 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:52:36.377349    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 19:52:36.379388 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:52:36.379358    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9bce955c-78c767c74d-zhjzr"]
Jul 24 19:52:36.423991 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:52:36.423966    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36a73de9-96c8-4539-9d8d-84c468809707-maas-api-tls\") pod \"maas-api-e2e-ait-9bce955c-78c767c74d-zhjzr\" (UID: \"36a73de9-96c8-4539-9d8d-84c468809707\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9bce955c-78c767c74d-zhjzr"
Jul 24 19:52:36.424150 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:52:36.424000    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36a73de9-96c8-4539-9d8d-84c468809707-openshift-service-ca\") pod \"maas-api-e2e-ait-9bce955c-78c767c74d-zhjzr\" (UID: \"36a73de9-96c8-4539-9d8d-84c468809707\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9bce955c-78c767c74d-zhjzr"
Jul 24 19:52:36.424150 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:52:36.424033    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cdf5\" (UniqueName: \"kubernetes.io/projected/36a73de9-96c8-4539-9d8d-84c468809707-kube-api-access-2cdf5\") pod \"maas-api-e2e-ait-9bce955c-78c767c74d-zhjzr\" (UID: \"36a73de9-96c8-4539-9d8d-84c468809707\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9bce955c-78c767c74d-zhjzr"
Jul 24 19:52:36.525137 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:52:36.525098    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cdf5\" (UniqueName: \"kubernetes.io/projected/36a73de9-96c8-4539-9d8d-84c468809707-kube-api-access-2cdf5\") pod \"maas-api-e2e-ait-9bce955c-78c767c74d-zhjzr\" (UID: \"36a73de9-96c8-4539-9d8d-84c468809707\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9bce955c-78c767c74d-zhjzr"
Jul 24 19:52:36.525312 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:52:36.525217    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36a73de9-96c8-4539-9d8d-84c468809707-maas-api-tls\") pod \"maas-api-e2e-ait-9bce955c-78c767c74d-zhjzr\" (UID: \"36a73de9-96c8-4539-9d8d-84c468809707\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9bce955c-78c767c74d-zhjzr"
Jul 24 19:52:36.525312 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:52:36.525245    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36a73de9-96c8-4539-9d8d-84c468809707-openshift-service-ca\") pod \"maas-api-e2e-ait-9bce955c-78c767c74d-zhjzr\" (UID: \"36a73de9-96c8-4539-9d8d-84c468809707\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9bce955c-78c767c74d-zhjzr"
Jul 24 19:52:36.525397 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:52:36.525354    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-9bce955c-serving-cert: secret "maas-api-e2e-ait-9bce955c-serving-cert" not found
Jul 24 19:52:36.525437 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:52:36.525428    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36a73de9-96c8-4539-9d8d-84c468809707-maas-api-tls podName:36a73de9-96c8-4539-9d8d-84c468809707 nodeName:}" failed. No retries permitted until 2026-07-24 19:52:37.025410261 +0000 UTC m=+1555.214484551 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/36a73de9-96c8-4539-9d8d-84c468809707-maas-api-tls") pod "maas-api-e2e-ait-9bce955c-78c767c74d-zhjzr" (UID: "36a73de9-96c8-4539-9d8d-84c468809707") : secret "maas-api-e2e-ait-9bce955c-serving-cert" not found
Jul 24 19:52:36.525911 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:52:36.525894    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36a73de9-96c8-4539-9d8d-84c468809707-openshift-service-ca\") pod \"maas-api-e2e-ait-9bce955c-78c767c74d-zhjzr\" (UID: \"36a73de9-96c8-4539-9d8d-84c468809707\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9bce955c-78c767c74d-zhjzr"
Jul 24 19:52:36.535583 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:52:36.535561    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cdf5\" (UniqueName: \"kubernetes.io/projected/36a73de9-96c8-4539-9d8d-84c468809707-kube-api-access-2cdf5\") pod \"maas-api-e2e-ait-9bce955c-78c767c74d-zhjzr\" (UID: \"36a73de9-96c8-4539-9d8d-84c468809707\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9bce955c-78c767c74d-zhjzr"
Jul 24 19:52:37.029750 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:52:37.029700    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36a73de9-96c8-4539-9d8d-84c468809707-maas-api-tls\") pod \"maas-api-e2e-ait-9bce955c-78c767c74d-zhjzr\" (UID: \"36a73de9-96c8-4539-9d8d-84c468809707\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9bce955c-78c767c74d-zhjzr"
Jul 24 19:52:37.032309 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:52:37.032289    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36a73de9-96c8-4539-9d8d-84c468809707-maas-api-tls\") pod \"maas-api-e2e-ait-9bce955c-78c767c74d-zhjzr\" (UID: \"36a73de9-96c8-4539-9d8d-84c468809707\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9bce955c-78c767c74d-zhjzr"
Jul 24 19:52:37.285830 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:52:37.285750    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9bce955c-78c767c74d-zhjzr"
Jul 24 19:52:37.424180 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:52:37.424116    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9bce955c-78c767c74d-zhjzr"]
Jul 24 19:52:37.426447 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:52:37.426421    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36a73de9_96c8_4539_9d8d_84c468809707.slice/crio-bd73fdd742a76cb1c51ac61f7814d7fb390d5fa8b1aebb62ae3e1258ab90c2a3 WatchSource:0}: Error finding container bd73fdd742a76cb1c51ac61f7814d7fb390d5fa8b1aebb62ae3e1258ab90c2a3: Status 404 returned error can't find the container with id bd73fdd742a76cb1c51ac61f7814d7fb390d5fa8b1aebb62ae3e1258ab90c2a3
Jul 24 19:52:37.427767 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:52:37.427750    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 19:52:37.813416 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:52:37.813378    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9bce955c-78c767c74d-zhjzr" event={"ID":"36a73de9-96c8-4539-9d8d-84c468809707","Type":"ContainerStarted","Data":"bd73fdd742a76cb1c51ac61f7814d7fb390d5fa8b1aebb62ae3e1258ab90c2a3"}
Jul 24 19:52:39.830014 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:52:39.829982    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9bce955c-78c767c74d-zhjzr" event={"ID":"36a73de9-96c8-4539-9d8d-84c468809707","Type":"ContainerStarted","Data":"2db780bb9e2aab1f38999c8673534bdc4eb85a968a4634b231ee7a87340d262e"}
Jul 24 19:52:39.830421 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:52:39.830094    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9bce955c-78c767c74d-zhjzr"
Jul 24 19:52:39.846392 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:52:39.846349    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9bce955c-78c767c74d-zhjzr" podStartSLOduration=1.523978524 podStartE2EDuration="3.84633546s" totalImagesPullingTime="2.322356936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:52:39.845386288 +0000 UTC m=+1558.034460605" watchObservedRunningTime="2026-07-24 19:52:39.84633546 +0000 UTC m=+1558.035409773"
Jul 24 19:52:43.488546 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:52:43.488514    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:52:45.841244 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:52:45.841208    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9bce955c-78c767c74d-zhjzr"
Jul 24 19:53:12.165318 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:12.165280    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9bce955c-78c767c74d-zhjzr"]
Jul 24 19:53:12.165864 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:12.165597    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9bce955c-78c767c74d-zhjzr" podUID="36a73de9-96c8-4539-9d8d-84c468809707" containerName="maas-api" containerID="cri-o://2db780bb9e2aab1f38999c8673534bdc4eb85a968a4634b231ee7a87340d262e" gracePeriod=30
Jul 24 19:53:12.416141 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:12.416072    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9bce955c-78c767c74d-zhjzr"
Jul 24 19:53:12.441180 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:12.441147    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36a73de9-96c8-4539-9d8d-84c468809707-maas-api-tls\") pod \"36a73de9-96c8-4539-9d8d-84c468809707\" (UID: \"36a73de9-96c8-4539-9d8d-84c468809707\") "
Jul 24 19:53:12.441339 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:12.441268    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36a73de9-96c8-4539-9d8d-84c468809707-openshift-service-ca\") pod \"36a73de9-96c8-4539-9d8d-84c468809707\" (UID: \"36a73de9-96c8-4539-9d8d-84c468809707\") "
Jul 24 19:53:12.441339 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:12.441334    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cdf5\" (UniqueName: \"kubernetes.io/projected/36a73de9-96c8-4539-9d8d-84c468809707-kube-api-access-2cdf5\") pod \"36a73de9-96c8-4539-9d8d-84c468809707\" (UID: \"36a73de9-96c8-4539-9d8d-84c468809707\") "
Jul 24 19:53:12.441600 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:12.441573    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36a73de9-96c8-4539-9d8d-84c468809707-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "36a73de9-96c8-4539-9d8d-84c468809707" (UID: "36a73de9-96c8-4539-9d8d-84c468809707"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:53:12.443577 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:12.443549    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36a73de9-96c8-4539-9d8d-84c468809707-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "36a73de9-96c8-4539-9d8d-84c468809707" (UID: "36a73de9-96c8-4539-9d8d-84c468809707"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:53:12.443678 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:12.443548    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36a73de9-96c8-4539-9d8d-84c468809707-kube-api-access-2cdf5" (OuterVolumeSpecName: "kube-api-access-2cdf5") pod "36a73de9-96c8-4539-9d8d-84c468809707" (UID: "36a73de9-96c8-4539-9d8d-84c468809707"). InnerVolumeSpecName "kube-api-access-2cdf5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:53:12.541887 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:12.541846    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cdf5\" (UniqueName: \"kubernetes.io/projected/36a73de9-96c8-4539-9d8d-84c468809707-kube-api-access-2cdf5\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 19:53:12.541887 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:12.541883    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36a73de9-96c8-4539-9d8d-84c468809707-maas-api-tls\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 19:53:12.541887 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:12.541893    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36a73de9-96c8-4539-9d8d-84c468809707-openshift-service-ca\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 19:53:12.993013 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:12.992978    2579 generic.go:356] "Generic (PLEG): container finished" podID="36a73de9-96c8-4539-9d8d-84c468809707" containerID="2db780bb9e2aab1f38999c8673534bdc4eb85a968a4634b231ee7a87340d262e" exitCode=0
Jul 24 19:53:12.993193 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:12.993028    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9bce955c-78c767c74d-zhjzr"
Jul 24 19:53:12.993193 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:12.993077    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9bce955c-78c767c74d-zhjzr" event={"ID":"36a73de9-96c8-4539-9d8d-84c468809707","Type":"ContainerDied","Data":"2db780bb9e2aab1f38999c8673534bdc4eb85a968a4634b231ee7a87340d262e"}
Jul 24 19:53:12.993193 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:12.993131    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9bce955c-78c767c74d-zhjzr" event={"ID":"36a73de9-96c8-4539-9d8d-84c468809707","Type":"ContainerDied","Data":"bd73fdd742a76cb1c51ac61f7814d7fb390d5fa8b1aebb62ae3e1258ab90c2a3"}
Jul 24 19:53:12.993193 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:12.993156    2579 scope.go:117] "RemoveContainer" containerID="2db780bb9e2aab1f38999c8673534bdc4eb85a968a4634b231ee7a87340d262e"
Jul 24 19:53:13.002500 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:13.002481    2579 scope.go:117] "RemoveContainer" containerID="2db780bb9e2aab1f38999c8673534bdc4eb85a968a4634b231ee7a87340d262e"
Jul 24 19:53:13.002764 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:53:13.002713    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2db780bb9e2aab1f38999c8673534bdc4eb85a968a4634b231ee7a87340d262e\": container with ID starting with 2db780bb9e2aab1f38999c8673534bdc4eb85a968a4634b231ee7a87340d262e not found: ID does not exist" containerID="2db780bb9e2aab1f38999c8673534bdc4eb85a968a4634b231ee7a87340d262e"
Jul 24 19:53:13.002866 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:13.002775    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2db780bb9e2aab1f38999c8673534bdc4eb85a968a4634b231ee7a87340d262e"} err="failed to get container status \"2db780bb9e2aab1f38999c8673534bdc4eb85a968a4634b231ee7a87340d262e\": rpc error: code = NotFound desc = could not find container \"2db780bb9e2aab1f38999c8673534bdc4eb85a968a4634b231ee7a87340d262e\": container with ID starting with 2db780bb9e2aab1f38999c8673534bdc4eb85a968a4634b231ee7a87340d262e not found: ID does not exist"
Jul 24 19:53:13.013891 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:13.013866    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9bce955c-78c767c74d-zhjzr"]
Jul 24 19:53:13.017337 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:13.017314    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9bce955c-78c767c74d-zhjzr"]
Jul 24 19:53:14.369663 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:14.369628    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36a73de9-96c8-4539-9d8d-84c468809707" path="/var/lib/kubelet/pods/36a73de9-96c8-4539-9d8d-84c468809707/volumes"
Jul 24 19:53:15.283027 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:15.282996    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:53:22.945741 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:22.945691    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-301a8697-54b9c4db79-qhgvm"]
Jul 24 19:53:22.946118 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:22.946068    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36a73de9-96c8-4539-9d8d-84c468809707" containerName="maas-api"
Jul 24 19:53:22.946118 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:22.946081    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="36a73de9-96c8-4539-9d8d-84c468809707" containerName="maas-api"
Jul 24 19:53:22.946195 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:22.946151    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="36a73de9-96c8-4539-9d8d-84c468809707" containerName="maas-api"
Jul 24 19:53:22.950371 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:22.950353    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-301a8697-54b9c4db79-qhgvm"
Jul 24 19:53:22.952572 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:22.952545    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-301a8697-serving-cert\""
Jul 24 19:53:22.952888 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:22.952867    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 19:53:22.953007 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:22.952868    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 24 19:53:22.953638 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:22.953621    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-z5t42\""
Jul 24 19:53:22.960009 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:22.959986    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-301a8697-54b9c4db79-qhgvm"]
Jul 24 19:53:23.032580 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:23.032548    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9160132-223c-4e8a-a9c0-67e592dc065d-maas-api-tls\") pod \"maas-api-e2e-migrate-301a8697-54b9c4db79-qhgvm\" (UID: \"b9160132-223c-4e8a-a9c0-67e592dc065d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-301a8697-54b9c4db79-qhgvm"
Jul 24 19:53:23.032580 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:23.032577    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz9cl\" (UniqueName: \"kubernetes.io/projected/b9160132-223c-4e8a-a9c0-67e592dc065d-kube-api-access-lz9cl\") pod \"maas-api-e2e-migrate-301a8697-54b9c4db79-qhgvm\" (UID: \"b9160132-223c-4e8a-a9c0-67e592dc065d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-301a8697-54b9c4db79-qhgvm"
Jul 24 19:53:23.032816 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:23.032600    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9160132-223c-4e8a-a9c0-67e592dc065d-openshift-service-ca\") pod \"maas-api-e2e-migrate-301a8697-54b9c4db79-qhgvm\" (UID: \"b9160132-223c-4e8a-a9c0-67e592dc065d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-301a8697-54b9c4db79-qhgvm"
Jul 24 19:53:23.133530 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:23.133499    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9160132-223c-4e8a-a9c0-67e592dc065d-maas-api-tls\") pod \"maas-api-e2e-migrate-301a8697-54b9c4db79-qhgvm\" (UID: \"b9160132-223c-4e8a-a9c0-67e592dc065d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-301a8697-54b9c4db79-qhgvm"
Jul 24 19:53:23.133530 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:23.133532    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz9cl\" (UniqueName: \"kubernetes.io/projected/b9160132-223c-4e8a-a9c0-67e592dc065d-kube-api-access-lz9cl\") pod \"maas-api-e2e-migrate-301a8697-54b9c4db79-qhgvm\" (UID: \"b9160132-223c-4e8a-a9c0-67e592dc065d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-301a8697-54b9c4db79-qhgvm"
Jul 24 19:53:23.133828 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:23.133550    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9160132-223c-4e8a-a9c0-67e592dc065d-openshift-service-ca\") pod \"maas-api-e2e-migrate-301a8697-54b9c4db79-qhgvm\" (UID: \"b9160132-223c-4e8a-a9c0-67e592dc065d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-301a8697-54b9c4db79-qhgvm"
Jul 24 19:53:23.133828 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:53:23.133671    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-301a8697-serving-cert: secret "maas-api-e2e-migrate-301a8697-serving-cert" not found
Jul 24 19:53:23.133828 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:53:23.133782    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9160132-223c-4e8a-a9c0-67e592dc065d-maas-api-tls podName:b9160132-223c-4e8a-a9c0-67e592dc065d nodeName:}" failed. No retries permitted until 2026-07-24 19:53:23.633760515 +0000 UTC m=+1601.822834822 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b9160132-223c-4e8a-a9c0-67e592dc065d-maas-api-tls") pod "maas-api-e2e-migrate-301a8697-54b9c4db79-qhgvm" (UID: "b9160132-223c-4e8a-a9c0-67e592dc065d") : secret "maas-api-e2e-migrate-301a8697-serving-cert" not found
Jul 24 19:53:23.134167 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:23.134148    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9160132-223c-4e8a-a9c0-67e592dc065d-openshift-service-ca\") pod \"maas-api-e2e-migrate-301a8697-54b9c4db79-qhgvm\" (UID: \"b9160132-223c-4e8a-a9c0-67e592dc065d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-301a8697-54b9c4db79-qhgvm"
Jul 24 19:53:23.141936 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:23.141914    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz9cl\" (UniqueName: \"kubernetes.io/projected/b9160132-223c-4e8a-a9c0-67e592dc065d-kube-api-access-lz9cl\") pod \"maas-api-e2e-migrate-301a8697-54b9c4db79-qhgvm\" (UID: \"b9160132-223c-4e8a-a9c0-67e592dc065d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-301a8697-54b9c4db79-qhgvm"
Jul 24 19:53:23.639516 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:23.639485    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9160132-223c-4e8a-a9c0-67e592dc065d-maas-api-tls\") pod \"maas-api-e2e-migrate-301a8697-54b9c4db79-qhgvm\" (UID: \"b9160132-223c-4e8a-a9c0-67e592dc065d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-301a8697-54b9c4db79-qhgvm"
Jul 24 19:53:23.642116 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:23.642090    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9160132-223c-4e8a-a9c0-67e592dc065d-maas-api-tls\") pod \"maas-api-e2e-migrate-301a8697-54b9c4db79-qhgvm\" (UID: \"b9160132-223c-4e8a-a9c0-67e592dc065d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-301a8697-54b9c4db79-qhgvm"
Jul 24 19:53:23.862419 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:23.862374    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-301a8697-54b9c4db79-qhgvm"
Jul 24 19:53:23.997760 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:23.997714    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-301a8697-54b9c4db79-qhgvm"]
Jul 24 19:53:23.999682 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:53:23.999650    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9160132_223c_4e8a_a9c0_67e592dc065d.slice/crio-12a0a4a0839e68fca3b6e66609bc60421ed5e483580e181d130b332a51a54be7 WatchSource:0}: Error finding container 12a0a4a0839e68fca3b6e66609bc60421ed5e483580e181d130b332a51a54be7: Status 404 returned error can't find the container with id 12a0a4a0839e68fca3b6e66609bc60421ed5e483580e181d130b332a51a54be7
Jul 24 19:53:24.048471 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:24.048437    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-301a8697-54b9c4db79-qhgvm" event={"ID":"b9160132-223c-4e8a-a9c0-67e592dc065d","Type":"ContainerStarted","Data":"12a0a4a0839e68fca3b6e66609bc60421ed5e483580e181d130b332a51a54be7"}
Jul 24 19:53:25.060459 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:25.060416    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-301a8697-54b9c4db79-qhgvm" event={"ID":"b9160132-223c-4e8a-a9c0-67e592dc065d","Type":"ContainerStarted","Data":"cfe691316b80ae7080be39f62ec92966b30723091ce9a1fd0d7a5bf6792cf526"}
Jul 24 19:53:25.060866 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:25.060506    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-301a8697-54b9c4db79-qhgvm"
Jul 24 19:53:25.076335 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:25.076287    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-301a8697-54b9c4db79-qhgvm" podStartSLOduration=2.768435147 podStartE2EDuration="3.076265017s" totalImagesPullingTime="307.82987ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:53:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:53:25.075858516 +0000 UTC m=+1603.264932833" watchObservedRunningTime="2026-07-24 19:53:25.076265017 +0000 UTC m=+1603.265339328"
Jul 24 19:53:27.291622 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:27.291582    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:53:31.072237 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:53:31.072207    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-301a8697-54b9c4db79-qhgvm"
Jul 24 19:54:18.292708 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:18.292672    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-301a8697-54b9c4db79-qhgvm"]
Jul 24 19:54:18.293296 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:18.292961    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-301a8697-54b9c4db79-qhgvm" podUID="b9160132-223c-4e8a-a9c0-67e592dc065d" containerName="maas-api" containerID="cri-o://cfe691316b80ae7080be39f62ec92966b30723091ce9a1fd0d7a5bf6792cf526" gracePeriod=30
Jul 24 19:54:18.544472 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:18.544406    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-301a8697-54b9c4db79-qhgvm"
Jul 24 19:54:18.623601 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:18.623567    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9160132-223c-4e8a-a9c0-67e592dc065d-openshift-service-ca\") pod \"b9160132-223c-4e8a-a9c0-67e592dc065d\" (UID: \"b9160132-223c-4e8a-a9c0-67e592dc065d\") "
Jul 24 19:54:18.623798 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:18.623648    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lz9cl\" (UniqueName: \"kubernetes.io/projected/b9160132-223c-4e8a-a9c0-67e592dc065d-kube-api-access-lz9cl\") pod \"b9160132-223c-4e8a-a9c0-67e592dc065d\" (UID: \"b9160132-223c-4e8a-a9c0-67e592dc065d\") "
Jul 24 19:54:18.623798 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:18.623684    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9160132-223c-4e8a-a9c0-67e592dc065d-maas-api-tls\") pod \"b9160132-223c-4e8a-a9c0-67e592dc065d\" (UID: \"b9160132-223c-4e8a-a9c0-67e592dc065d\") "
Jul 24 19:54:18.623945 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:18.623922    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9160132-223c-4e8a-a9c0-67e592dc065d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b9160132-223c-4e8a-a9c0-67e592dc065d" (UID: "b9160132-223c-4e8a-a9c0-67e592dc065d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:54:18.625877 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:18.625852    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9160132-223c-4e8a-a9c0-67e592dc065d-kube-api-access-lz9cl" (OuterVolumeSpecName: "kube-api-access-lz9cl") pod "b9160132-223c-4e8a-a9c0-67e592dc065d" (UID: "b9160132-223c-4e8a-a9c0-67e592dc065d"). InnerVolumeSpecName "kube-api-access-lz9cl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:54:18.625877 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:18.625864    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9160132-223c-4e8a-a9c0-67e592dc065d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b9160132-223c-4e8a-a9c0-67e592dc065d" (UID: "b9160132-223c-4e8a-a9c0-67e592dc065d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:54:18.724576 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:18.724532    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lz9cl\" (UniqueName: \"kubernetes.io/projected/b9160132-223c-4e8a-a9c0-67e592dc065d-kube-api-access-lz9cl\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 19:54:18.724576 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:18.724568    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9160132-223c-4e8a-a9c0-67e592dc065d-maas-api-tls\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 19:54:18.724576 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:18.724581    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9160132-223c-4e8a-a9c0-67e592dc065d-openshift-service-ca\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 19:54:19.321864 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:19.321827    2579 generic.go:356] "Generic (PLEG): container finished" podID="b9160132-223c-4e8a-a9c0-67e592dc065d" containerID="cfe691316b80ae7080be39f62ec92966b30723091ce9a1fd0d7a5bf6792cf526" exitCode=0
Jul 24 19:54:19.322275 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:19.321872    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-301a8697-54b9c4db79-qhgvm"
Jul 24 19:54:19.322275 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:19.321908    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-301a8697-54b9c4db79-qhgvm" event={"ID":"b9160132-223c-4e8a-a9c0-67e592dc065d","Type":"ContainerDied","Data":"cfe691316b80ae7080be39f62ec92966b30723091ce9a1fd0d7a5bf6792cf526"}
Jul 24 19:54:19.322275 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:19.321961    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-301a8697-54b9c4db79-qhgvm" event={"ID":"b9160132-223c-4e8a-a9c0-67e592dc065d","Type":"ContainerDied","Data":"12a0a4a0839e68fca3b6e66609bc60421ed5e483580e181d130b332a51a54be7"}
Jul 24 19:54:19.322275 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:19.321984    2579 scope.go:117] "RemoveContainer" containerID="cfe691316b80ae7080be39f62ec92966b30723091ce9a1fd0d7a5bf6792cf526"
Jul 24 19:54:19.331374 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:19.331358    2579 scope.go:117] "RemoveContainer" containerID="cfe691316b80ae7080be39f62ec92966b30723091ce9a1fd0d7a5bf6792cf526"
Jul 24 19:54:19.331597 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:54:19.331580    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfe691316b80ae7080be39f62ec92966b30723091ce9a1fd0d7a5bf6792cf526\": container with ID starting with cfe691316b80ae7080be39f62ec92966b30723091ce9a1fd0d7a5bf6792cf526 not found: ID does not exist" containerID="cfe691316b80ae7080be39f62ec92966b30723091ce9a1fd0d7a5bf6792cf526"
Jul 24 19:54:19.331636 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:19.331604    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfe691316b80ae7080be39f62ec92966b30723091ce9a1fd0d7a5bf6792cf526"} err="failed to get container status \"cfe691316b80ae7080be39f62ec92966b30723091ce9a1fd0d7a5bf6792cf526\": rpc error: code = NotFound desc = could not find container \"cfe691316b80ae7080be39f62ec92966b30723091ce9a1fd0d7a5bf6792cf526\": container with ID starting with cfe691316b80ae7080be39f62ec92966b30723091ce9a1fd0d7a5bf6792cf526 not found: ID does not exist"
Jul 24 19:54:19.342694 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:19.342669    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-301a8697-54b9c4db79-qhgvm"]
Jul 24 19:54:19.347170 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:19.347149    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-301a8697-54b9c4db79-qhgvm"]
Jul 24 19:54:20.368143 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:20.368110    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9160132-223c-4e8a-a9c0-67e592dc065d" path="/var/lib/kubelet/pods/b9160132-223c-4e8a-a9c0-67e592dc065d/volumes"
Jul 24 19:54:21.381996 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:21.381965    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:54:26.388944 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:26.388914    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4babb888-67fc567b5d-wk4r7"]
Jul 24 19:54:26.389447 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:26.389359    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9160132-223c-4e8a-a9c0-67e592dc065d" containerName="maas-api"
Jul 24 19:54:26.389447 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:26.389374    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9160132-223c-4e8a-a9c0-67e592dc065d" containerName="maas-api"
Jul 24 19:54:26.389527 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:26.389465    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9160132-223c-4e8a-a9c0-67e592dc065d" containerName="maas-api"
Jul 24 19:54:26.393780 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:26.393760    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4babb888-67fc567b5d-wk4r7"
Jul 24 19:54:26.396529 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:26.396502    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-4babb888-serving-cert\""
Jul 24 19:54:26.396649 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:26.396536    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-z5t42\""
Jul 24 19:54:26.396649 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:26.396571    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 19:54:26.397151 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:26.397137    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 24 19:54:26.401893 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:26.401872    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4babb888-67fc567b5d-wk4r7"]
Jul 24 19:54:26.491658 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:26.491625    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff10e8bf-be3c-4d34-b47c-3403dd0e054b-maas-api-tls\") pod \"maas-api-e2e-ait-4babb888-67fc567b5d-wk4r7\" (UID: \"ff10e8bf-be3c-4d34-b47c-3403dd0e054b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4babb888-67fc567b5d-wk4r7"
Jul 24 19:54:26.491868 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:26.491821    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff10e8bf-be3c-4d34-b47c-3403dd0e054b-openshift-service-ca\") pod \"maas-api-e2e-ait-4babb888-67fc567b5d-wk4r7\" (UID: \"ff10e8bf-be3c-4d34-b47c-3403dd0e054b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4babb888-67fc567b5d-wk4r7"
Jul 24 19:54:26.492028 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:26.491997    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-767f9\" (UniqueName: \"kubernetes.io/projected/ff10e8bf-be3c-4d34-b47c-3403dd0e054b-kube-api-access-767f9\") pod \"maas-api-e2e-ait-4babb888-67fc567b5d-wk4r7\" (UID: \"ff10e8bf-be3c-4d34-b47c-3403dd0e054b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4babb888-67fc567b5d-wk4r7"
Jul 24 19:54:26.592885 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:26.592850    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff10e8bf-be3c-4d34-b47c-3403dd0e054b-openshift-service-ca\") pod \"maas-api-e2e-ait-4babb888-67fc567b5d-wk4r7\" (UID: \"ff10e8bf-be3c-4d34-b47c-3403dd0e054b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4babb888-67fc567b5d-wk4r7"
Jul 24 19:54:26.592885 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:26.592890    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-767f9\" (UniqueName: \"kubernetes.io/projected/ff10e8bf-be3c-4d34-b47c-3403dd0e054b-kube-api-access-767f9\") pod \"maas-api-e2e-ait-4babb888-67fc567b5d-wk4r7\" (UID: \"ff10e8bf-be3c-4d34-b47c-3403dd0e054b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4babb888-67fc567b5d-wk4r7"
Jul 24 19:54:26.593091 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:26.592946    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff10e8bf-be3c-4d34-b47c-3403dd0e054b-maas-api-tls\") pod \"maas-api-e2e-ait-4babb888-67fc567b5d-wk4r7\" (UID: \"ff10e8bf-be3c-4d34-b47c-3403dd0e054b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4babb888-67fc567b5d-wk4r7"
Jul 24 19:54:26.593643 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:26.593619    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff10e8bf-be3c-4d34-b47c-3403dd0e054b-openshift-service-ca\") pod \"maas-api-e2e-ait-4babb888-67fc567b5d-wk4r7\" (UID: \"ff10e8bf-be3c-4d34-b47c-3403dd0e054b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4babb888-67fc567b5d-wk4r7"
Jul 24 19:54:26.595510 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:26.595484    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff10e8bf-be3c-4d34-b47c-3403dd0e054b-maas-api-tls\") pod \"maas-api-e2e-ait-4babb888-67fc567b5d-wk4r7\" (UID: \"ff10e8bf-be3c-4d34-b47c-3403dd0e054b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4babb888-67fc567b5d-wk4r7"
Jul 24 19:54:26.602169 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:26.602147    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-767f9\" (UniqueName: \"kubernetes.io/projected/ff10e8bf-be3c-4d34-b47c-3403dd0e054b-kube-api-access-767f9\") pod \"maas-api-e2e-ait-4babb888-67fc567b5d-wk4r7\" (UID: \"ff10e8bf-be3c-4d34-b47c-3403dd0e054b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4babb888-67fc567b5d-wk4r7"
Jul 24 19:54:26.705374 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:26.705283    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4babb888-67fc567b5d-wk4r7"
Jul 24 19:54:26.849140 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:26.849116    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4babb888-67fc567b5d-wk4r7"]
Jul 24 19:54:26.851009 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:54:26.850981    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff10e8bf_be3c_4d34_b47c_3403dd0e054b.slice/crio-3e713090a9aa553f2d09065129561e60425aa2e028c68bc5bbe9542cef5edb00 WatchSource:0}: Error finding container 3e713090a9aa553f2d09065129561e60425aa2e028c68bc5bbe9542cef5edb00: Status 404 returned error can't find the container with id 3e713090a9aa553f2d09065129561e60425aa2e028c68bc5bbe9542cef5edb00
Jul 24 19:54:27.363263 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:27.363226    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4babb888-67fc567b5d-wk4r7" event={"ID":"ff10e8bf-be3c-4d34-b47c-3403dd0e054b","Type":"ContainerStarted","Data":"1dd78f9db5f4bf4ecefc74b653461067a6cf89f92d13477d69c53872f55ab641"}
Jul 24 19:54:27.363455 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:27.363283    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4babb888-67fc567b5d-wk4r7" event={"ID":"ff10e8bf-be3c-4d34-b47c-3403dd0e054b","Type":"ContainerStarted","Data":"3e713090a9aa553f2d09065129561e60425aa2e028c68bc5bbe9542cef5edb00"}
Jul 24 19:54:27.363455 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:27.363368    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4babb888-67fc567b5d-wk4r7"
Jul 24 19:54:27.381550 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:27.381491    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4babb888-67fc567b5d-wk4r7" podStartSLOduration=1.051452257 podStartE2EDuration="1.381473504s" totalImagesPullingTime="330.021247ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:54:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:54:27.379822991 +0000 UTC m=+1665.568897308" watchObservedRunningTime="2026-07-24 19:54:27.381473504 +0000 UTC m=+1665.570547818"
Jul 24 19:54:29.380267 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:29.380231    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:54:33.381083 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:33.381056    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4babb888-67fc567b5d-wk4r7"
Jul 24 19:54:51.865355 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:51.865318    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4babb888-4r5sv"]
Jul 24 19:54:51.871485 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:51.871457    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4babb888-4r5sv"
Jul 24 19:54:51.872916 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:51.872892    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4babb888-4r5sv"]
Jul 24 19:54:51.875154 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:51.875130    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gqw4p\""
Jul 24 19:54:51.911914 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:51.911868    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/52feddd9-4f3e-4ebd-a76c-64aebad84b00-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4babb888-4r5sv\" (UID: \"52feddd9-4f3e-4ebd-a76c-64aebad84b00\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4babb888-4r5sv"
Jul 24 19:54:52.012540 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:52.012486    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/52feddd9-4f3e-4ebd-a76c-64aebad84b00-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4babb888-4r5sv\" (UID: \"52feddd9-4f3e-4ebd-a76c-64aebad84b00\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4babb888-4r5sv"
Jul 24 19:54:52.013165 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:52.013144    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/52feddd9-4f3e-4ebd-a76c-64aebad84b00-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4babb888-4r5sv\" (UID: \"52feddd9-4f3e-4ebd-a76c-64aebad84b00\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4babb888-4r5sv"
Jul 24 19:54:52.184555 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:52.184457    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4babb888-4r5sv"
Jul 24 19:54:52.317176 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:52.317150    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4babb888-4r5sv"]
Jul 24 19:54:52.319358 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:54:52.319332    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52feddd9_4f3e_4ebd_a76c_64aebad84b00.slice/crio-66fe68dabe43ea301cd9dfbd7a55221054e4e2d91dead93f115090e06c4208fd WatchSource:0}: Error finding container 66fe68dabe43ea301cd9dfbd7a55221054e4e2d91dead93f115090e06c4208fd: Status 404 returned error can't find the container with id 66fe68dabe43ea301cd9dfbd7a55221054e4e2d91dead93f115090e06c4208fd
Jul 24 19:54:52.495950 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:52.495859    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4babb888-4r5sv" event={"ID":"52feddd9-4f3e-4ebd-a76c-64aebad84b00","Type":"ContainerStarted","Data":"66fe68dabe43ea301cd9dfbd7a55221054e4e2d91dead93f115090e06c4208fd"}
Jul 24 19:54:55.512987 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:55.512951    2579 generic.go:356] "Generic (PLEG): container finished" podID="52feddd9-4f3e-4ebd-a76c-64aebad84b00" containerID="ca70c40ffff8b7753047f0c3a1978537785302e9c4163ff1d20987b5b38c4319" exitCode=0
Jul 24 19:54:55.513360 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:55.513033    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4babb888-4r5sv" event={"ID":"52feddd9-4f3e-4ebd-a76c-64aebad84b00","Type":"ContainerDied","Data":"ca70c40ffff8b7753047f0c3a1978537785302e9c4163ff1d20987b5b38c4319"}
Jul 24 19:54:56.639077 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:56.639051    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4babb888-4r5sv"
Jul 24 19:54:56.650567 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:56.650539    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/52feddd9-4f3e-4ebd-a76c-64aebad84b00-maas-api-service-ca\") pod \"52feddd9-4f3e-4ebd-a76c-64aebad84b00\" (UID: \"52feddd9-4f3e-4ebd-a76c-64aebad84b00\") "
Jul 24 19:54:56.650883 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:56.650860    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52feddd9-4f3e-4ebd-a76c-64aebad84b00-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "52feddd9-4f3e-4ebd-a76c-64aebad84b00" (UID: "52feddd9-4f3e-4ebd-a76c-64aebad84b00"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:54:56.751586 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:56.751551    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/52feddd9-4f3e-4ebd-a76c-64aebad84b00-maas-api-service-ca\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 19:54:57.526536 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:57.526505    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4babb888-4r5sv"
Jul 24 19:54:57.526799 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:57.526540    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4babb888-4r5sv" event={"ID":"52feddd9-4f3e-4ebd-a76c-64aebad84b00","Type":"ContainerDied","Data":"66fe68dabe43ea301cd9dfbd7a55221054e4e2d91dead93f115090e06c4208fd"}
Jul 24 19:54:57.526799 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:54:57.526607    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="66fe68dabe43ea301cd9dfbd7a55221054e4e2d91dead93f115090e06c4208fd"
Jul 24 19:55:02.493095 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:02.493044    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4babb888-67fc567b5d-wk4r7"]
Jul 24 19:55:02.493576 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:02.493259    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4babb888-67fc567b5d-wk4r7" podUID="ff10e8bf-be3c-4d34-b47c-3403dd0e054b" containerName="maas-api" containerID="cri-o://1dd78f9db5f4bf4ecefc74b653461067a6cf89f92d13477d69c53872f55ab641" gracePeriod=30
Jul 24 19:55:02.747597 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:02.747533    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4babb888-67fc567b5d-wk4r7"
Jul 24 19:55:02.795354 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:02.795327    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff10e8bf-be3c-4d34-b47c-3403dd0e054b-maas-api-tls\") pod \"ff10e8bf-be3c-4d34-b47c-3403dd0e054b\" (UID: \"ff10e8bf-be3c-4d34-b47c-3403dd0e054b\") "
Jul 24 19:55:02.795543 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:02.795372    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff10e8bf-be3c-4d34-b47c-3403dd0e054b-openshift-service-ca\") pod \"ff10e8bf-be3c-4d34-b47c-3403dd0e054b\" (UID: \"ff10e8bf-be3c-4d34-b47c-3403dd0e054b\") "
Jul 24 19:55:02.795543 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:02.795394    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-767f9\" (UniqueName: \"kubernetes.io/projected/ff10e8bf-be3c-4d34-b47c-3403dd0e054b-kube-api-access-767f9\") pod \"ff10e8bf-be3c-4d34-b47c-3403dd0e054b\" (UID: \"ff10e8bf-be3c-4d34-b47c-3403dd0e054b\") "
Jul 24 19:55:02.795840 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:02.795810    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff10e8bf-be3c-4d34-b47c-3403dd0e054b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ff10e8bf-be3c-4d34-b47c-3403dd0e054b" (UID: "ff10e8bf-be3c-4d34-b47c-3403dd0e054b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:55:02.797631 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:02.797607    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff10e8bf-be3c-4d34-b47c-3403dd0e054b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ff10e8bf-be3c-4d34-b47c-3403dd0e054b" (UID: "ff10e8bf-be3c-4d34-b47c-3403dd0e054b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:55:02.797631 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:02.797619    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff10e8bf-be3c-4d34-b47c-3403dd0e054b-kube-api-access-767f9" (OuterVolumeSpecName: "kube-api-access-767f9") pod "ff10e8bf-be3c-4d34-b47c-3403dd0e054b" (UID: "ff10e8bf-be3c-4d34-b47c-3403dd0e054b"). InnerVolumeSpecName "kube-api-access-767f9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:55:02.895950 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:02.895904    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff10e8bf-be3c-4d34-b47c-3403dd0e054b-maas-api-tls\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 19:55:02.895950 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:02.895944    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff10e8bf-be3c-4d34-b47c-3403dd0e054b-openshift-service-ca\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 19:55:02.895950 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:02.895954    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-767f9\" (UniqueName: \"kubernetes.io/projected/ff10e8bf-be3c-4d34-b47c-3403dd0e054b-kube-api-access-767f9\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 19:55:03.557641 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:03.557600    2579 generic.go:356] "Generic (PLEG): container finished" podID="ff10e8bf-be3c-4d34-b47c-3403dd0e054b" containerID="1dd78f9db5f4bf4ecefc74b653461067a6cf89f92d13477d69c53872f55ab641" exitCode=0
Jul 24 19:55:03.557641 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:03.557640    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4babb888-67fc567b5d-wk4r7" event={"ID":"ff10e8bf-be3c-4d34-b47c-3403dd0e054b","Type":"ContainerDied","Data":"1dd78f9db5f4bf4ecefc74b653461067a6cf89f92d13477d69c53872f55ab641"}
Jul 24 19:55:03.557641 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:03.557643    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4babb888-67fc567b5d-wk4r7"
Jul 24 19:55:03.558244 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:03.557691    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4babb888-67fc567b5d-wk4r7" event={"ID":"ff10e8bf-be3c-4d34-b47c-3403dd0e054b","Type":"ContainerDied","Data":"3e713090a9aa553f2d09065129561e60425aa2e028c68bc5bbe9542cef5edb00"}
Jul 24 19:55:03.558244 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:03.557715    2579 scope.go:117] "RemoveContainer" containerID="1dd78f9db5f4bf4ecefc74b653461067a6cf89f92d13477d69c53872f55ab641"
Jul 24 19:55:03.566871 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:03.566852    2579 scope.go:117] "RemoveContainer" containerID="1dd78f9db5f4bf4ecefc74b653461067a6cf89f92d13477d69c53872f55ab641"
Jul 24 19:55:03.567147 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:55:03.567129    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dd78f9db5f4bf4ecefc74b653461067a6cf89f92d13477d69c53872f55ab641\": container with ID starting with 1dd78f9db5f4bf4ecefc74b653461067a6cf89f92d13477d69c53872f55ab641 not found: ID does not exist" containerID="1dd78f9db5f4bf4ecefc74b653461067a6cf89f92d13477d69c53872f55ab641"
Jul 24 19:55:03.567186 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:03.567158    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dd78f9db5f4bf4ecefc74b653461067a6cf89f92d13477d69c53872f55ab641"} err="failed to get container status \"1dd78f9db5f4bf4ecefc74b653461067a6cf89f92d13477d69c53872f55ab641\": rpc error: code = NotFound desc = could not find container \"1dd78f9db5f4bf4ecefc74b653461067a6cf89f92d13477d69c53872f55ab641\": container with ID starting with 1dd78f9db5f4bf4ecefc74b653461067a6cf89f92d13477d69c53872f55ab641 not found: ID does not exist"
Jul 24 19:55:03.578438 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:03.578412    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4babb888-67fc567b5d-wk4r7"]
Jul 24 19:55:03.583925 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:03.583906    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4babb888-67fc567b5d-wk4r7"]
Jul 24 19:55:04.368392 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:04.368359    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff10e8bf-be3c-4d34-b47c-3403dd0e054b" path="/var/lib/kubelet/pods/ff10e8bf-be3c-4d34-b47c-3403dd0e054b/volumes"
Jul 24 19:55:05.881600 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:05.881563    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:55:06.939449 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:06.939404    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4babb888-4r5sv"]
Jul 24 19:55:06.942128 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:06.942091    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4babb888-4r5sv"]
Jul 24 19:55:08.367766 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:08.367718    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52feddd9-4f3e-4ebd-a76c-64aebad84b00" path="/var/lib/kubelet/pods/52feddd9-4f3e-4ebd-a76c-64aebad84b00/volumes"
Jul 24 19:55:11.600966 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:11.600933    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9b3176cc-645cdfbbb-gnggv"]
Jul 24 19:55:11.601441 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:11.601289    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff10e8bf-be3c-4d34-b47c-3403dd0e054b" containerName="maas-api"
Jul 24 19:55:11.601441 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:11.601301    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff10e8bf-be3c-4d34-b47c-3403dd0e054b" containerName="maas-api"
Jul 24 19:55:11.601441 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:11.601314    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52feddd9-4f3e-4ebd-a76c-64aebad84b00" containerName="revoke-keys"
Jul 24 19:55:11.601441 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:11.601319    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="52feddd9-4f3e-4ebd-a76c-64aebad84b00" containerName="revoke-keys"
Jul 24 19:55:11.601441 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:11.601385    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="52feddd9-4f3e-4ebd-a76c-64aebad84b00" containerName="revoke-keys"
Jul 24 19:55:11.601441 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:11.601395    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff10e8bf-be3c-4d34-b47c-3403dd0e054b" containerName="maas-api"
Jul 24 19:55:11.605858 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:11.605825    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b3176cc-645cdfbbb-gnggv"
Jul 24 19:55:11.608466 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:11.608417    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-z5t42\""
Jul 24 19:55:11.608466 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:11.608444    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 19:55:11.609637 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:11.609615    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-9b3176cc-serving-cert\""
Jul 24 19:55:11.609771 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:11.609623    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 24 19:55:11.617051 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:11.617031    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9b3176cc-645cdfbbb-gnggv"]
Jul 24 19:55:11.667831 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:11.667797    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fd5afb0-f991-4887-98c4-70e720fd3533-openshift-service-ca\") pod \"maas-api-e2e-derive-9b3176cc-645cdfbbb-gnggv\" (UID: \"4fd5afb0-f991-4887-98c4-70e720fd3533\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b3176cc-645cdfbbb-gnggv"
Jul 24 19:55:11.668000 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:11.667905    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4fd5afb0-f991-4887-98c4-70e720fd3533-maas-api-tls\") pod \"maas-api-e2e-derive-9b3176cc-645cdfbbb-gnggv\" (UID: \"4fd5afb0-f991-4887-98c4-70e720fd3533\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b3176cc-645cdfbbb-gnggv"
Jul 24 19:55:11.668000 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:11.667950    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc278\" (UniqueName: \"kubernetes.io/projected/4fd5afb0-f991-4887-98c4-70e720fd3533-kube-api-access-vc278\") pod \"maas-api-e2e-derive-9b3176cc-645cdfbbb-gnggv\" (UID: \"4fd5afb0-f991-4887-98c4-70e720fd3533\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b3176cc-645cdfbbb-gnggv"
Jul 24 19:55:11.769007 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:11.768969    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4fd5afb0-f991-4887-98c4-70e720fd3533-maas-api-tls\") pod \"maas-api-e2e-derive-9b3176cc-645cdfbbb-gnggv\" (UID: \"4fd5afb0-f991-4887-98c4-70e720fd3533\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b3176cc-645cdfbbb-gnggv"
Jul 24 19:55:11.769207 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:11.769020    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc278\" (UniqueName: \"kubernetes.io/projected/4fd5afb0-f991-4887-98c4-70e720fd3533-kube-api-access-vc278\") pod \"maas-api-e2e-derive-9b3176cc-645cdfbbb-gnggv\" (UID: \"4fd5afb0-f991-4887-98c4-70e720fd3533\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b3176cc-645cdfbbb-gnggv"
Jul 24 19:55:11.769207 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:11.769070    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fd5afb0-f991-4887-98c4-70e720fd3533-openshift-service-ca\") pod \"maas-api-e2e-derive-9b3176cc-645cdfbbb-gnggv\" (UID: \"4fd5afb0-f991-4887-98c4-70e720fd3533\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b3176cc-645cdfbbb-gnggv"
Jul 24 19:55:11.769207 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:55:11.769141    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-9b3176cc-serving-cert: secret "maas-api-e2e-derive-9b3176cc-serving-cert" not found
Jul 24 19:55:11.769365 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:55:11.769213    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fd5afb0-f991-4887-98c4-70e720fd3533-maas-api-tls podName:4fd5afb0-f991-4887-98c4-70e720fd3533 nodeName:}" failed. No retries permitted until 2026-07-24 19:55:12.269190066 +0000 UTC m=+1710.458264362 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4fd5afb0-f991-4887-98c4-70e720fd3533-maas-api-tls") pod "maas-api-e2e-derive-9b3176cc-645cdfbbb-gnggv" (UID: "4fd5afb0-f991-4887-98c4-70e720fd3533") : secret "maas-api-e2e-derive-9b3176cc-serving-cert" not found
Jul 24 19:55:11.769784 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:11.769767    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fd5afb0-f991-4887-98c4-70e720fd3533-openshift-service-ca\") pod \"maas-api-e2e-derive-9b3176cc-645cdfbbb-gnggv\" (UID: \"4fd5afb0-f991-4887-98c4-70e720fd3533\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b3176cc-645cdfbbb-gnggv"
Jul 24 19:55:11.782122 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:11.782096    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc278\" (UniqueName: \"kubernetes.io/projected/4fd5afb0-f991-4887-98c4-70e720fd3533-kube-api-access-vc278\") pod \"maas-api-e2e-derive-9b3176cc-645cdfbbb-gnggv\" (UID: \"4fd5afb0-f991-4887-98c4-70e720fd3533\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b3176cc-645cdfbbb-gnggv"
Jul 24 19:55:12.274828 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:12.274787    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4fd5afb0-f991-4887-98c4-70e720fd3533-maas-api-tls\") pod \"maas-api-e2e-derive-9b3176cc-645cdfbbb-gnggv\" (UID: \"4fd5afb0-f991-4887-98c4-70e720fd3533\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b3176cc-645cdfbbb-gnggv"
Jul 24 19:55:12.277446 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:12.277416    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4fd5afb0-f991-4887-98c4-70e720fd3533-maas-api-tls\") pod \"maas-api-e2e-derive-9b3176cc-645cdfbbb-gnggv\" (UID: \"4fd5afb0-f991-4887-98c4-70e720fd3533\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b3176cc-645cdfbbb-gnggv"
Jul 24 19:55:12.518799 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:12.518767    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b3176cc-645cdfbbb-gnggv"
Jul 24 19:55:12.652381 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:12.652355    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9b3176cc-645cdfbbb-gnggv"]
Jul 24 19:55:12.654489 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:55:12.654457    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fd5afb0_f991_4887_98c4_70e720fd3533.slice/crio-6d836e6a514550d145aabc396c6622bd09c2e9e0b0f09ff99c23b1926d1c7db8 WatchSource:0}: Error finding container 6d836e6a514550d145aabc396c6622bd09c2e9e0b0f09ff99c23b1926d1c7db8: Status 404 returned error can't find the container with id 6d836e6a514550d145aabc396c6622bd09c2e9e0b0f09ff99c23b1926d1c7db8
Jul 24 19:55:13.613182 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:13.613152    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b3176cc-645cdfbbb-gnggv" event={"ID":"4fd5afb0-f991-4887-98c4-70e720fd3533","Type":"ContainerStarted","Data":"053558a92357b9fdc44015ea642a5b768459f7900d83bb307ab95f78d427f1d5"}
Jul 24 19:55:13.613375 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:13.613208    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b3176cc-645cdfbbb-gnggv" event={"ID":"4fd5afb0-f991-4887-98c4-70e720fd3533","Type":"ContainerStarted","Data":"6d836e6a514550d145aabc396c6622bd09c2e9e0b0f09ff99c23b1926d1c7db8"}
Jul 24 19:55:13.613375 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:13.613238    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b3176cc-645cdfbbb-gnggv"
Jul 24 19:55:13.631138 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:13.631084    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b3176cc-645cdfbbb-gnggv" podStartSLOduration=2.274025359 podStartE2EDuration="2.631068272s" totalImagesPullingTime="357.042913ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:55:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:55:13.628607841 +0000 UTC m=+1711.817682155" watchObservedRunningTime="2026-07-24 19:55:13.631068272 +0000 UTC m=+1711.820142584"
Jul 24 19:55:16.990985 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:16.990948    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:55:19.624121 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:19.624090    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b3176cc-645cdfbbb-gnggv"
Jul 24 19:55:36.205230 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:36.205193    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9b3176cc-d98t6"]
Jul 24 19:55:36.212234 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:36.212213    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9b3176cc-d98t6"
Jul 24 19:55:36.214978 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:36.214952    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gqw4p\""
Jul 24 19:55:36.215383 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:36.215358    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9b3176cc-d98t6"]
Jul 24 19:55:36.288018 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:36.287988    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/94ac053c-107a-4518-b53a-9343303714f5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-9b3176cc-d98t6\" (UID: \"94ac053c-107a-4518-b53a-9343303714f5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9b3176cc-d98t6"
Jul 24 19:55:36.388878 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:36.388849    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/94ac053c-107a-4518-b53a-9343303714f5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-9b3176cc-d98t6\" (UID: \"94ac053c-107a-4518-b53a-9343303714f5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9b3176cc-d98t6"
Jul 24 19:55:36.389424 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:36.389407    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/94ac053c-107a-4518-b53a-9343303714f5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-9b3176cc-d98t6\" (UID: \"94ac053c-107a-4518-b53a-9343303714f5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9b3176cc-d98t6"
Jul 24 19:55:36.523537 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:36.523506    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9b3176cc-d98t6"
Jul 24 19:55:36.656413 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:36.656388    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9b3176cc-d98t6"]
Jul 24 19:55:36.657914 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:55:36.657888    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94ac053c_107a_4518_b53a_9343303714f5.slice/crio-f65d967d0c13027e2951db0ab357cf626da9d35480705d23b9fb55702080bf8c WatchSource:0}: Error finding container f65d967d0c13027e2951db0ab357cf626da9d35480705d23b9fb55702080bf8c: Status 404 returned error can't find the container with id f65d967d0c13027e2951db0ab357cf626da9d35480705d23b9fb55702080bf8c
Jul 24 19:55:36.729782 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:36.729752    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9b3176cc-d98t6" event={"ID":"94ac053c-107a-4518-b53a-9343303714f5","Type":"ContainerStarted","Data":"f65d967d0c13027e2951db0ab357cf626da9d35480705d23b9fb55702080bf8c"}
Jul 24 19:55:37.737240 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:37.737136    2579 generic.go:356] "Generic (PLEG): container finished" podID="94ac053c-107a-4518-b53a-9343303714f5" containerID="013a15b5d0d44bbd5cb8db1863f978f6c824432d5df180646dd27d900bcb1010" exitCode=0
Jul 24 19:55:37.737612 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:37.737233    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9b3176cc-d98t6" event={"ID":"94ac053c-107a-4518-b53a-9343303714f5","Type":"ContainerDied","Data":"013a15b5d0d44bbd5cb8db1863f978f6c824432d5df180646dd27d900bcb1010"}
Jul 24 19:55:38.870468 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:38.870441    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9b3176cc-d98t6"
Jul 24 19:55:39.011038 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:39.011006    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/94ac053c-107a-4518-b53a-9343303714f5-maas-api-service-ca\") pod \"94ac053c-107a-4518-b53a-9343303714f5\" (UID: \"94ac053c-107a-4518-b53a-9343303714f5\") "
Jul 24 19:55:39.011374 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:39.011349    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94ac053c-107a-4518-b53a-9343303714f5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "94ac053c-107a-4518-b53a-9343303714f5" (UID: "94ac053c-107a-4518-b53a-9343303714f5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:55:39.112501 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:39.112454    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/94ac053c-107a-4518-b53a-9343303714f5-maas-api-service-ca\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 19:55:39.749132 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:39.749101    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9b3176cc-d98t6"
Jul 24 19:55:39.749294 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:39.749142    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9b3176cc-d98t6" event={"ID":"94ac053c-107a-4518-b53a-9343303714f5","Type":"ContainerDied","Data":"f65d967d0c13027e2951db0ab357cf626da9d35480705d23b9fb55702080bf8c"}
Jul 24 19:55:39.749294 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:39.749187    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f65d967d0c13027e2951db0ab357cf626da9d35480705d23b9fb55702080bf8c"
Jul 24 19:55:46.704390 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:46.704354    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9b3176cc-645cdfbbb-gnggv"]
Jul 24 19:55:46.704845 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:46.704604    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b3176cc-645cdfbbb-gnggv" podUID="4fd5afb0-f991-4887-98c4-70e720fd3533" containerName="maas-api" containerID="cri-o://053558a92357b9fdc44015ea642a5b768459f7900d83bb307ab95f78d427f1d5" gracePeriod=30
Jul 24 19:55:46.955899 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:46.955840    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b3176cc-645cdfbbb-gnggv"
Jul 24 19:55:46.980612 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:46.980579    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vc278\" (UniqueName: \"kubernetes.io/projected/4fd5afb0-f991-4887-98c4-70e720fd3533-kube-api-access-vc278\") pod \"4fd5afb0-f991-4887-98c4-70e720fd3533\" (UID: \"4fd5afb0-f991-4887-98c4-70e720fd3533\") "
Jul 24 19:55:46.980804 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:46.980632    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4fd5afb0-f991-4887-98c4-70e720fd3533-maas-api-tls\") pod \"4fd5afb0-f991-4887-98c4-70e720fd3533\" (UID: \"4fd5afb0-f991-4887-98c4-70e720fd3533\") "
Jul 24 19:55:46.980804 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:46.980711    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fd5afb0-f991-4887-98c4-70e720fd3533-openshift-service-ca\") pod \"4fd5afb0-f991-4887-98c4-70e720fd3533\" (UID: \"4fd5afb0-f991-4887-98c4-70e720fd3533\") "
Jul 24 19:55:46.981540 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:46.981508    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fd5afb0-f991-4887-98c4-70e720fd3533-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4fd5afb0-f991-4887-98c4-70e720fd3533" (UID: "4fd5afb0-f991-4887-98c4-70e720fd3533"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:55:46.983474 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:46.983441    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fd5afb0-f991-4887-98c4-70e720fd3533-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4fd5afb0-f991-4887-98c4-70e720fd3533" (UID: "4fd5afb0-f991-4887-98c4-70e720fd3533"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:55:46.984009 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:46.983986    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fd5afb0-f991-4887-98c4-70e720fd3533-kube-api-access-vc278" (OuterVolumeSpecName: "kube-api-access-vc278") pod "4fd5afb0-f991-4887-98c4-70e720fd3533" (UID: "4fd5afb0-f991-4887-98c4-70e720fd3533"). InnerVolumeSpecName "kube-api-access-vc278". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:55:47.082570 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:47.082532    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vc278\" (UniqueName: \"kubernetes.io/projected/4fd5afb0-f991-4887-98c4-70e720fd3533-kube-api-access-vc278\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 19:55:47.082570 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:47.082566    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4fd5afb0-f991-4887-98c4-70e720fd3533-maas-api-tls\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 19:55:47.082570 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:47.082576    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fd5afb0-f991-4887-98c4-70e720fd3533-openshift-service-ca\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 19:55:47.792624 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:47.792587    2579 generic.go:356] "Generic (PLEG): container finished" podID="4fd5afb0-f991-4887-98c4-70e720fd3533" containerID="053558a92357b9fdc44015ea642a5b768459f7900d83bb307ab95f78d427f1d5" exitCode=0
Jul 24 19:55:47.793073 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:47.792638    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b3176cc-645cdfbbb-gnggv" event={"ID":"4fd5afb0-f991-4887-98c4-70e720fd3533","Type":"ContainerDied","Data":"053558a92357b9fdc44015ea642a5b768459f7900d83bb307ab95f78d427f1d5"}
Jul 24 19:55:47.793073 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:47.792702    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b3176cc-645cdfbbb-gnggv" event={"ID":"4fd5afb0-f991-4887-98c4-70e720fd3533","Type":"ContainerDied","Data":"6d836e6a514550d145aabc396c6622bd09c2e9e0b0f09ff99c23b1926d1c7db8"}
Jul 24 19:55:47.793073 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:47.792641    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b3176cc-645cdfbbb-gnggv"
Jul 24 19:55:47.793073 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:47.792747    2579 scope.go:117] "RemoveContainer" containerID="053558a92357b9fdc44015ea642a5b768459f7900d83bb307ab95f78d427f1d5"
Jul 24 19:55:47.801744 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:47.801700    2579 scope.go:117] "RemoveContainer" containerID="053558a92357b9fdc44015ea642a5b768459f7900d83bb307ab95f78d427f1d5"
Jul 24 19:55:47.802008 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:55:47.801989    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"053558a92357b9fdc44015ea642a5b768459f7900d83bb307ab95f78d427f1d5\": container with ID starting with 053558a92357b9fdc44015ea642a5b768459f7900d83bb307ab95f78d427f1d5 not found: ID does not exist" containerID="053558a92357b9fdc44015ea642a5b768459f7900d83bb307ab95f78d427f1d5"
Jul 24 19:55:47.802056 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:47.802016    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"053558a92357b9fdc44015ea642a5b768459f7900d83bb307ab95f78d427f1d5"} err="failed to get container status \"053558a92357b9fdc44015ea642a5b768459f7900d83bb307ab95f78d427f1d5\": rpc error: code = NotFound desc = could not find container \"053558a92357b9fdc44015ea642a5b768459f7900d83bb307ab95f78d427f1d5\": container with ID starting with 053558a92357b9fdc44015ea642a5b768459f7900d83bb307ab95f78d427f1d5 not found: ID does not exist"
Jul 24 19:55:47.814189 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:47.814160    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9b3176cc-645cdfbbb-gnggv"]
Jul 24 19:55:47.818052 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:47.818030    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9b3176cc-645cdfbbb-gnggv"]
Jul 24 19:55:48.367739 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:48.367698    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fd5afb0-f991-4887-98c4-70e720fd3533" path="/var/lib/kubelet/pods/4fd5afb0-f991-4887-98c4-70e720fd3533/volumes"
Jul 24 19:55:49.586004 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:49.585969    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:55:51.290863 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:51.290819    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9b3176cc-d98t6"]
Jul 24 19:55:51.292629 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:51.292609    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9b3176cc-d98t6"]
Jul 24 19:55:52.367359 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:55:52.367329    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94ac053c-107a-4518-b53a-9343303714f5" path="/var/lib/kubelet/pods/94ac053c-107a-4518-b53a-9343303714f5/volumes"
Jul 24 19:56:42.416989 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:56:42.416965    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vclnd_fa8789c9-6c39-46cd-a540-657dea710eb8/ovn-acl-logging/0.log"
Jul 24 19:56:42.426906 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:56:42.426883    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vclnd_fa8789c9-6c39-46cd-a540-657dea710eb8/ovn-acl-logging/0.log"
Jul 24 19:57:17.498713 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:17.498667    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:57:27.687563 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:27.687524    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:57:33.697533 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:33.697502    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-67d08912-68b8cc8f8c-dvd58"]
Jul 24 19:57:33.697921 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:33.697840    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fd5afb0-f991-4887-98c4-70e720fd3533" containerName="maas-api"
Jul 24 19:57:33.697921 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:33.697852    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fd5afb0-f991-4887-98c4-70e720fd3533" containerName="maas-api"
Jul 24 19:57:33.697921 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:33.697864    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94ac053c-107a-4518-b53a-9343303714f5" containerName="revoke-keys"
Jul 24 19:57:33.697921 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:33.697869    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="94ac053c-107a-4518-b53a-9343303714f5" containerName="revoke-keys"
Jul 24 19:57:33.698051 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:33.697930    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="94ac053c-107a-4518-b53a-9343303714f5" containerName="revoke-keys"
Jul 24 19:57:33.698051 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:33.697938    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fd5afb0-f991-4887-98c4-70e720fd3533" containerName="maas-api"
Jul 24 19:57:33.701015 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:33.700997    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-67d08912-68b8cc8f8c-dvd58"
Jul 24 19:57:33.704008 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:33.703988    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-67d08912-serving-cert\""
Jul 24 19:57:33.704186 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:33.704169    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 19:57:33.705077 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:33.705059    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-z5t42\""
Jul 24 19:57:33.705160 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:33.705075    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 24 19:57:33.711540 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:33.711513    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-67d08912-68b8cc8f8c-dvd58"]
Jul 24 19:57:33.793250 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:33.793212    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89232757-a30d-4bac-8c8c-85ec5feaf724-maas-api-tls\") pod \"maas-api-e2e-mt-67d08912-68b8cc8f8c-dvd58\" (UID: \"89232757-a30d-4bac-8c8c-85ec5feaf724\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-67d08912-68b8cc8f8c-dvd58"
Jul 24 19:57:33.793448 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:33.793261    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89232757-a30d-4bac-8c8c-85ec5feaf724-openshift-service-ca\") pod \"maas-api-e2e-mt-67d08912-68b8cc8f8c-dvd58\" (UID: \"89232757-a30d-4bac-8c8c-85ec5feaf724\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-67d08912-68b8cc8f8c-dvd58"
Jul 24 19:57:33.793448 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:33.793368    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5sbn\" (UniqueName: \"kubernetes.io/projected/89232757-a30d-4bac-8c8c-85ec5feaf724-kube-api-access-v5sbn\") pod \"maas-api-e2e-mt-67d08912-68b8cc8f8c-dvd58\" (UID: \"89232757-a30d-4bac-8c8c-85ec5feaf724\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-67d08912-68b8cc8f8c-dvd58"
Jul 24 19:57:33.894337 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:33.894293    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89232757-a30d-4bac-8c8c-85ec5feaf724-maas-api-tls\") pod \"maas-api-e2e-mt-67d08912-68b8cc8f8c-dvd58\" (UID: \"89232757-a30d-4bac-8c8c-85ec5feaf724\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-67d08912-68b8cc8f8c-dvd58"
Jul 24 19:57:33.894337 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:33.894347    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89232757-a30d-4bac-8c8c-85ec5feaf724-openshift-service-ca\") pod \"maas-api-e2e-mt-67d08912-68b8cc8f8c-dvd58\" (UID: \"89232757-a30d-4bac-8c8c-85ec5feaf724\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-67d08912-68b8cc8f8c-dvd58"
Jul 24 19:57:33.894615 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:33.894400    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5sbn\" (UniqueName: \"kubernetes.io/projected/89232757-a30d-4bac-8c8c-85ec5feaf724-kube-api-access-v5sbn\") pod \"maas-api-e2e-mt-67d08912-68b8cc8f8c-dvd58\" (UID: \"89232757-a30d-4bac-8c8c-85ec5feaf724\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-67d08912-68b8cc8f8c-dvd58"
Jul 24 19:57:33.894615 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:57:33.894480    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-67d08912-serving-cert: secret "maas-api-e2e-mt-67d08912-serving-cert" not found
Jul 24 19:57:33.894615 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:57:33.894588    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89232757-a30d-4bac-8c8c-85ec5feaf724-maas-api-tls podName:89232757-a30d-4bac-8c8c-85ec5feaf724 nodeName:}" failed. No retries permitted until 2026-07-24 19:57:34.394564604 +0000 UTC m=+1852.583638896 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/89232757-a30d-4bac-8c8c-85ec5feaf724-maas-api-tls") pod "maas-api-e2e-mt-67d08912-68b8cc8f8c-dvd58" (UID: "89232757-a30d-4bac-8c8c-85ec5feaf724") : secret "maas-api-e2e-mt-67d08912-serving-cert" not found
Jul 24 19:57:33.895108 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:33.895087    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89232757-a30d-4bac-8c8c-85ec5feaf724-openshift-service-ca\") pod \"maas-api-e2e-mt-67d08912-68b8cc8f8c-dvd58\" (UID: \"89232757-a30d-4bac-8c8c-85ec5feaf724\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-67d08912-68b8cc8f8c-dvd58"
Jul 24 19:57:33.906096 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:33.906073    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5sbn\" (UniqueName: \"kubernetes.io/projected/89232757-a30d-4bac-8c8c-85ec5feaf724-kube-api-access-v5sbn\") pod \"maas-api-e2e-mt-67d08912-68b8cc8f8c-dvd58\" (UID: \"89232757-a30d-4bac-8c8c-85ec5feaf724\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-67d08912-68b8cc8f8c-dvd58"
Jul 24 19:57:34.398621 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:34.398589    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89232757-a30d-4bac-8c8c-85ec5feaf724-maas-api-tls\") pod \"maas-api-e2e-mt-67d08912-68b8cc8f8c-dvd58\" (UID: \"89232757-a30d-4bac-8c8c-85ec5feaf724\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-67d08912-68b8cc8f8c-dvd58"
Jul 24 19:57:34.401279 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:34.401252    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89232757-a30d-4bac-8c8c-85ec5feaf724-maas-api-tls\") pod \"maas-api-e2e-mt-67d08912-68b8cc8f8c-dvd58\" (UID: \"89232757-a30d-4bac-8c8c-85ec5feaf724\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-67d08912-68b8cc8f8c-dvd58"
Jul 24 19:57:34.611775 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:34.611711    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-67d08912-68b8cc8f8c-dvd58"
Jul 24 19:57:34.754966 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:34.754926    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-67d08912-68b8cc8f8c-dvd58"]
Jul 24 19:57:34.757981 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:57:34.757951    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89232757_a30d_4bac_8c8c_85ec5feaf724.slice/crio-e095d6c341c47f87cbed99b5f5afcfcabdeac925086c9ec3fc3f0e315eaca335 WatchSource:0}: Error finding container e095d6c341c47f87cbed99b5f5afcfcabdeac925086c9ec3fc3f0e315eaca335: Status 404 returned error can't find the container with id e095d6c341c47f87cbed99b5f5afcfcabdeac925086c9ec3fc3f0e315eaca335
Jul 24 19:57:35.329315 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:35.329285    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-67d08912-68b8cc8f8c-dvd58" event={"ID":"89232757-a30d-4bac-8c8c-85ec5feaf724","Type":"ContainerStarted","Data":"e095d6c341c47f87cbed99b5f5afcfcabdeac925086c9ec3fc3f0e315eaca335"}
Jul 24 19:57:36.336627 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:36.336590    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-67d08912-68b8cc8f8c-dvd58" event={"ID":"89232757-a30d-4bac-8c8c-85ec5feaf724","Type":"ContainerStarted","Data":"b753b01474666ad688739e1e58671db26984696f84cce2d16d90754ce4b70db3"}
Jul 24 19:57:36.337029 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:36.336760    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-67d08912-68b8cc8f8c-dvd58"
Jul 24 19:57:36.353515 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:36.353461    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-67d08912-68b8cc8f8c-dvd58" podStartSLOduration=2.792898577 podStartE2EDuration="3.353445657s" totalImagesPullingTime="560.54708ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:57:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:57:36.352935053 +0000 UTC m=+1854.542009369" watchObservedRunningTime="2026-07-24 19:57:36.353445657 +0000 UTC m=+1854.542519972"
Jul 24 19:57:40.096015 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:40.095976    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:57:42.347662 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:42.347629    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-67d08912-68b8cc8f8c-dvd58"
Jul 24 19:57:45.673590 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:45.673557    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-67d08912-7pzzd"]
Jul 24 19:57:45.676769 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:45.676753    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-67d08912-7pzzd"
Jul 24 19:57:45.679248 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:45.679228    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gqw4p\""
Jul 24 19:57:45.685759 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:45.685713    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-67d08912-7pzzd"]
Jul 24 19:57:45.802925 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:45.802887    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a00fc97e-6f5b-4e25-b737-f58fcf179eae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-67d08912-7pzzd\" (UID: \"a00fc97e-6f5b-4e25-b737-f58fcf179eae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-67d08912-7pzzd"
Jul 24 19:57:45.903799 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:45.903763    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a00fc97e-6f5b-4e25-b737-f58fcf179eae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-67d08912-7pzzd\" (UID: \"a00fc97e-6f5b-4e25-b737-f58fcf179eae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-67d08912-7pzzd"
Jul 24 19:57:45.904402 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:45.904379    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a00fc97e-6f5b-4e25-b737-f58fcf179eae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-67d08912-7pzzd\" (UID: \"a00fc97e-6f5b-4e25-b737-f58fcf179eae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-67d08912-7pzzd"
Jul 24 19:57:45.989057 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:45.988964    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-67d08912-7pzzd"
Jul 24 19:57:46.124471 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:46.124415    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-67d08912-7pzzd"]
Jul 24 19:57:46.126549 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:57:46.126522    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda00fc97e_6f5b_4e25_b737_f58fcf179eae.slice/crio-894efb87d57a11deee240fc8cf0ca4409c59f78ee62b18ee874094615d520a78 WatchSource:0}: Error finding container 894efb87d57a11deee240fc8cf0ca4409c59f78ee62b18ee874094615d520a78: Status 404 returned error can't find the container with id 894efb87d57a11deee240fc8cf0ca4409c59f78ee62b18ee874094615d520a78
Jul 24 19:57:46.389685 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:46.389655    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-67d08912-7pzzd" event={"ID":"a00fc97e-6f5b-4e25-b737-f58fcf179eae","Type":"ContainerStarted","Data":"c7b0e43a3c4ac6ecfdf09029cfa9eb58822d3132d59b90cee6f56b43fef7e68a"}
Jul 24 19:57:46.389815 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:46.389711    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-67d08912-7pzzd" event={"ID":"a00fc97e-6f5b-4e25-b737-f58fcf179eae","Type":"ContainerStarted","Data":"894efb87d57a11deee240fc8cf0ca4409c59f78ee62b18ee874094615d520a78"}
Jul 24 19:57:46.406311 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:46.406269    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-67d08912-7pzzd" podStartSLOduration=1.406252584 podStartE2EDuration="1.406252584s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:57:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:57:46.404438491 +0000 UTC m=+1864.593512805" watchObservedRunningTime="2026-07-24 19:57:46.406252584 +0000 UTC m=+1864.595326896"
Jul 24 19:57:47.396718 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:47.396683    2579 generic.go:356] "Generic (PLEG): container finished" podID="a00fc97e-6f5b-4e25-b737-f58fcf179eae" containerID="c7b0e43a3c4ac6ecfdf09029cfa9eb58822d3132d59b90cee6f56b43fef7e68a" exitCode=0
Jul 24 19:57:47.397149 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:47.396772    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-67d08912-7pzzd" event={"ID":"a00fc97e-6f5b-4e25-b737-f58fcf179eae","Type":"ContainerDied","Data":"c7b0e43a3c4ac6ecfdf09029cfa9eb58822d3132d59b90cee6f56b43fef7e68a"}
Jul 24 19:57:48.530040 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:48.530015    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-67d08912-7pzzd"
Jul 24 19:57:48.626957 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:48.626926    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a00fc97e-6f5b-4e25-b737-f58fcf179eae-maas-api-service-ca\") pod \"a00fc97e-6f5b-4e25-b737-f58fcf179eae\" (UID: \"a00fc97e-6f5b-4e25-b737-f58fcf179eae\") "
Jul 24 19:57:48.627285 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:48.627263    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a00fc97e-6f5b-4e25-b737-f58fcf179eae-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a00fc97e-6f5b-4e25-b737-f58fcf179eae" (UID: "a00fc97e-6f5b-4e25-b737-f58fcf179eae"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:57:48.728320 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:48.728240    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a00fc97e-6f5b-4e25-b737-f58fcf179eae-maas-api-service-ca\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 19:57:49.411119 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:49.411079    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-67d08912-7pzzd"
Jul 24 19:57:49.411119 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:49.411106    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-67d08912-7pzzd" event={"ID":"a00fc97e-6f5b-4e25-b737-f58fcf179eae","Type":"ContainerDied","Data":"894efb87d57a11deee240fc8cf0ca4409c59f78ee62b18ee874094615d520a78"}
Jul 24 19:57:49.411373 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:49.411148    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="894efb87d57a11deee240fc8cf0ca4409c59f78ee62b18ee874094615d520a78"
Jul 24 19:57:55.779438 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:55.779400    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-67d08912-68b8cc8f8c-dvd58"]
Jul 24 19:57:55.779832 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:55.779641    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-67d08912-68b8cc8f8c-dvd58" podUID="89232757-a30d-4bac-8c8c-85ec5feaf724" containerName="maas-api" containerID="cri-o://b753b01474666ad688739e1e58671db26984696f84cce2d16d90754ce4b70db3" gracePeriod=30
Jul 24 19:57:56.028545 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:56.028522    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-67d08912-68b8cc8f8c-dvd58"
Jul 24 19:57:56.092977 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:56.092881    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5sbn\" (UniqueName: \"kubernetes.io/projected/89232757-a30d-4bac-8c8c-85ec5feaf724-kube-api-access-v5sbn\") pod \"89232757-a30d-4bac-8c8c-85ec5feaf724\" (UID: \"89232757-a30d-4bac-8c8c-85ec5feaf724\") "
Jul 24 19:57:56.092977 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:56.092923    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89232757-a30d-4bac-8c8c-85ec5feaf724-maas-api-tls\") pod \"89232757-a30d-4bac-8c8c-85ec5feaf724\" (UID: \"89232757-a30d-4bac-8c8c-85ec5feaf724\") "
Jul 24 19:57:56.092977 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:56.092959    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89232757-a30d-4bac-8c8c-85ec5feaf724-openshift-service-ca\") pod \"89232757-a30d-4bac-8c8c-85ec5feaf724\" (UID: \"89232757-a30d-4bac-8c8c-85ec5feaf724\") "
Jul 24 19:57:56.093369 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:56.093345    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89232757-a30d-4bac-8c8c-85ec5feaf724-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "89232757-a30d-4bac-8c8c-85ec5feaf724" (UID: "89232757-a30d-4bac-8c8c-85ec5feaf724"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:57:56.095135 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:56.095113    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89232757-a30d-4bac-8c8c-85ec5feaf724-kube-api-access-v5sbn" (OuterVolumeSpecName: "kube-api-access-v5sbn") pod "89232757-a30d-4bac-8c8c-85ec5feaf724" (UID: "89232757-a30d-4bac-8c8c-85ec5feaf724"). InnerVolumeSpecName "kube-api-access-v5sbn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:57:56.095228 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:56.095190    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89232757-a30d-4bac-8c8c-85ec5feaf724-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "89232757-a30d-4bac-8c8c-85ec5feaf724" (UID: "89232757-a30d-4bac-8c8c-85ec5feaf724"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:57:56.193925 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:56.193886    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89232757-a30d-4bac-8c8c-85ec5feaf724-openshift-service-ca\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 19:57:56.193925 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:56.193917    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5sbn\" (UniqueName: \"kubernetes.io/projected/89232757-a30d-4bac-8c8c-85ec5feaf724-kube-api-access-v5sbn\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 19:57:56.193925 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:56.193927    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89232757-a30d-4bac-8c8c-85ec5feaf724-maas-api-tls\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 19:57:56.446029 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:56.445998    2579 generic.go:356] "Generic (PLEG): container finished" podID="89232757-a30d-4bac-8c8c-85ec5feaf724" containerID="b753b01474666ad688739e1e58671db26984696f84cce2d16d90754ce4b70db3" exitCode=0
Jul 24 19:57:56.446202 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:56.446045    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-67d08912-68b8cc8f8c-dvd58"
Jul 24 19:57:56.446202 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:56.446088    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-67d08912-68b8cc8f8c-dvd58" event={"ID":"89232757-a30d-4bac-8c8c-85ec5feaf724","Type":"ContainerDied","Data":"b753b01474666ad688739e1e58671db26984696f84cce2d16d90754ce4b70db3"}
Jul 24 19:57:56.446202 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:56.446144    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-67d08912-68b8cc8f8c-dvd58" event={"ID":"89232757-a30d-4bac-8c8c-85ec5feaf724","Type":"ContainerDied","Data":"e095d6c341c47f87cbed99b5f5afcfcabdeac925086c9ec3fc3f0e315eaca335"}
Jul 24 19:57:56.446202 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:56.446170    2579 scope.go:117] "RemoveContainer" containerID="b753b01474666ad688739e1e58671db26984696f84cce2d16d90754ce4b70db3"
Jul 24 19:57:56.460788 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:56.460762    2579 scope.go:117] "RemoveContainer" containerID="b753b01474666ad688739e1e58671db26984696f84cce2d16d90754ce4b70db3"
Jul 24 19:57:56.461061 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:57:56.461042    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b753b01474666ad688739e1e58671db26984696f84cce2d16d90754ce4b70db3\": container with ID starting with b753b01474666ad688739e1e58671db26984696f84cce2d16d90754ce4b70db3 not found: ID does not exist" containerID="b753b01474666ad688739e1e58671db26984696f84cce2d16d90754ce4b70db3"
Jul 24 19:57:56.461113 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:56.461069    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b753b01474666ad688739e1e58671db26984696f84cce2d16d90754ce4b70db3"} err="failed to get container status \"b753b01474666ad688739e1e58671db26984696f84cce2d16d90754ce4b70db3\": rpc error: code = NotFound desc = could not find container \"b753b01474666ad688739e1e58671db26984696f84cce2d16d90754ce4b70db3\": container with ID starting with b753b01474666ad688739e1e58671db26984696f84cce2d16d90754ce4b70db3 not found: ID does not exist"
Jul 24 19:57:56.466733 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:56.466696    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-67d08912-68b8cc8f8c-dvd58"]
Jul 24 19:57:56.473012 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:56.472991    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-67d08912-68b8cc8f8c-dvd58"]
Jul 24 19:57:58.367445 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:58.367411    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89232757-a30d-4bac-8c8c-85ec5feaf724" path="/var/lib/kubelet/pods/89232757-a30d-4bac-8c8c-85ec5feaf724/volumes"
Jul 24 19:57:59.044857 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:57:59.044822    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:58:00.745878 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:58:00.745841    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-67d08912-7pzzd"]
Jul 24 19:58:00.749140 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:58:00.749115    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-67d08912-7pzzd"]
Jul 24 19:58:02.375349 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:58:02.375320    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a00fc97e-6f5b-4e25-b737-f58fcf179eae" path="/var/lib/kubelet/pods/a00fc97e-6f5b-4e25-b737-f58fcf179eae/volumes"
Jul 24 19:58:30.085062 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:58:30.085025    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0f165f39-7f5787c54b-zz5gm"]
Jul 24 19:58:30.085688 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:58:30.085503    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89232757-a30d-4bac-8c8c-85ec5feaf724" containerName="maas-api"
Jul 24 19:58:30.085688 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:58:30.085522    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="89232757-a30d-4bac-8c8c-85ec5feaf724" containerName="maas-api"
Jul 24 19:58:30.085688 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:58:30.085542    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a00fc97e-6f5b-4e25-b737-f58fcf179eae" containerName="revoke-keys"
Jul 24 19:58:30.085688 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:58:30.085552    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a00fc97e-6f5b-4e25-b737-f58fcf179eae" containerName="revoke-keys"
Jul 24 19:58:30.085688 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:58:30.085625    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="89232757-a30d-4bac-8c8c-85ec5feaf724" containerName="maas-api"
Jul 24 19:58:30.085688 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:58:30.085639    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a00fc97e-6f5b-4e25-b737-f58fcf179eae" containerName="revoke-keys"
Jul 24 19:58:30.088879 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:58:30.088859    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0f165f39-7f5787c54b-zz5gm"
Jul 24 19:58:30.091116 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:58:30.091093    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-0f165f39-serving-cert\""
Jul 24 19:58:30.092150 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:58:30.092130    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 19:58:30.092284 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:58:30.092149    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-z5t42\""
Jul 24 19:58:30.092284 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:58:30.092130    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 24 19:58:30.101470 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:58:30.101448    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0f165f39-7f5787c54b-zz5gm"]
Jul 24 19:58:30.179922 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:58:30.179892    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b616438-8a43-47db-a2b9-6d4f9fd5ee05-openshift-service-ca\") pod \"maas-api-e2e-mt-0f165f39-7f5787c54b-zz5gm\" (UID: \"2b616438-8a43-47db-a2b9-6d4f9fd5ee05\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0f165f39-7f5787c54b-zz5gm"
Jul 24 19:58:30.180127 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:58:30.179985    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvksj\" (UniqueName: \"kubernetes.io/projected/2b616438-8a43-47db-a2b9-6d4f9fd5ee05-kube-api-access-gvksj\") pod \"maas-api-e2e-mt-0f165f39-7f5787c54b-zz5gm\" (UID: \"2b616438-8a43-47db-a2b9-6d4f9fd5ee05\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0f165f39-7f5787c54b-zz5gm"
Jul 24 19:58:30.180127 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:58:30.180057    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b616438-8a43-47db-a2b9-6d4f9fd5ee05-maas-api-tls\") pod \"maas-api-e2e-mt-0f165f39-7f5787c54b-zz5gm\" (UID: \"2b616438-8a43-47db-a2b9-6d4f9fd5ee05\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0f165f39-7f5787c54b-zz5gm"
Jul 24 19:58:30.281146 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:58:30.281106    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b616438-8a43-47db-a2b9-6d4f9fd5ee05-openshift-service-ca\") pod \"maas-api-e2e-mt-0f165f39-7f5787c54b-zz5gm\" (UID: \"2b616438-8a43-47db-a2b9-6d4f9fd5ee05\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0f165f39-7f5787c54b-zz5gm"
Jul 24 19:58:30.281350 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:58:30.281175    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvksj\" (UniqueName: \"kubernetes.io/projected/2b616438-8a43-47db-a2b9-6d4f9fd5ee05-kube-api-access-gvksj\") pod \"maas-api-e2e-mt-0f165f39-7f5787c54b-zz5gm\" (UID: \"2b616438-8a43-47db-a2b9-6d4f9fd5ee05\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0f165f39-7f5787c54b-zz5gm"
Jul 24 19:58:30.281350 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:58:30.281219    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b616438-8a43-47db-a2b9-6d4f9fd5ee05-maas-api-tls\") pod \"maas-api-e2e-mt-0f165f39-7f5787c54b-zz5gm\" (UID: \"2b616438-8a43-47db-a2b9-6d4f9fd5ee05\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0f165f39-7f5787c54b-zz5gm"
Jul 24 19:58:30.281350 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:58:30.281324    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-0f165f39-serving-cert: secret "maas-api-e2e-mt-0f165f39-serving-cert" not found
Jul 24 19:58:30.281525 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:58:30.281404    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b616438-8a43-47db-a2b9-6d4f9fd5ee05-maas-api-tls podName:2b616438-8a43-47db-a2b9-6d4f9fd5ee05 nodeName:}" failed. No retries permitted until 2026-07-24 19:58:30.781380945 +0000 UTC m=+1908.970455240 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2b616438-8a43-47db-a2b9-6d4f9fd5ee05-maas-api-tls") pod "maas-api-e2e-mt-0f165f39-7f5787c54b-zz5gm" (UID: "2b616438-8a43-47db-a2b9-6d4f9fd5ee05") : secret "maas-api-e2e-mt-0f165f39-serving-cert" not found
Jul 24 19:58:30.281819 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:58:30.281798    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b616438-8a43-47db-a2b9-6d4f9fd5ee05-openshift-service-ca\") pod \"maas-api-e2e-mt-0f165f39-7f5787c54b-zz5gm\" (UID: \"2b616438-8a43-47db-a2b9-6d4f9fd5ee05\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0f165f39-7f5787c54b-zz5gm"
Jul 24 19:58:30.289798 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:58:30.289775    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvksj\" (UniqueName: \"kubernetes.io/projected/2b616438-8a43-47db-a2b9-6d4f9fd5ee05-kube-api-access-gvksj\") pod \"maas-api-e2e-mt-0f165f39-7f5787c54b-zz5gm\" (UID: \"2b616438-8a43-47db-a2b9-6d4f9fd5ee05\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0f165f39-7f5787c54b-zz5gm"
Jul 24 19:58:30.785351 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:58:30.785319    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b616438-8a43-47db-a2b9-6d4f9fd5ee05-maas-api-tls\") pod \"maas-api-e2e-mt-0f165f39-7f5787c54b-zz5gm\" (UID: \"2b616438-8a43-47db-a2b9-6d4f9fd5ee05\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0f165f39-7f5787c54b-zz5gm"
Jul 24 19:58:30.787980 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:58:30.787947    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b616438-8a43-47db-a2b9-6d4f9fd5ee05-maas-api-tls\") pod \"maas-api-e2e-mt-0f165f39-7f5787c54b-zz5gm\" (UID: \"2b616438-8a43-47db-a2b9-6d4f9fd5ee05\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0f165f39-7f5787c54b-zz5gm"
Jul 24 19:58:31.000329 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:58:31.000278    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0f165f39-7f5787c54b-zz5gm"
Jul 24 19:58:31.147049 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:58:31.147020    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b616438_8a43_47db_a2b9_6d4f9fd5ee05.slice/crio-56abb0520cc0c5d2a4d4eaad4de87109bb39b16c2bd2c8ac30262f5a19c8fe9b WatchSource:0}: Error finding container 56abb0520cc0c5d2a4d4eaad4de87109bb39b16c2bd2c8ac30262f5a19c8fe9b: Status 404 returned error can't find the container with id 56abb0520cc0c5d2a4d4eaad4de87109bb39b16c2bd2c8ac30262f5a19c8fe9b
Jul 24 19:58:31.147794 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:58:31.147771    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0f165f39-7f5787c54b-zz5gm"]
Jul 24 19:58:31.148715 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:58:31.148697    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 19:58:31.619091 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:58:31.619050    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0f165f39-7f5787c54b-zz5gm" event={"ID":"2b616438-8a43-47db-a2b9-6d4f9fd5ee05","Type":"ContainerStarted","Data":"efc010a483fdc9486ef28a4e92f4dbabc215066a5f1dbad9ec94124062d229b1"}
Jul 24 19:58:31.619283 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:58:31.619099    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0f165f39-7f5787c54b-zz5gm" event={"ID":"2b616438-8a43-47db-a2b9-6d4f9fd5ee05","Type":"ContainerStarted","Data":"56abb0520cc0c5d2a4d4eaad4de87109bb39b16c2bd2c8ac30262f5a19c8fe9b"}
Jul 24 19:58:31.619283 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:58:31.619120    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0f165f39-7f5787c54b-zz5gm"
Jul 24 19:58:31.640849 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:58:31.640794    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0f165f39-7f5787c54b-zz5gm" podStartSLOduration=1.270969763 podStartE2EDuration="1.640777524s" totalImagesPullingTime="369.807761ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:58:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:58:31.638811564 +0000 UTC m=+1909.827885878" watchObservedRunningTime="2026-07-24 19:58:31.640777524 +0000 UTC m=+1909.829851837"
Jul 24 19:58:35.085211 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:58:35.085176    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:58:37.629836 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:58:37.629806    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0f165f39-7f5787c54b-zz5gm"
Jul 24 19:59:00.600948 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:00.600862    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-0f165f39/e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h"]
Jul 24 19:59:00.604223 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:00.604206    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0f165f39/e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h"
Jul 24 19:59:00.607899 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:00.607872    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-0f165f39\"/\"e2e-lifecycle-model-0f165f39-kserve-self-signed-certs\""
Jul 24 19:59:00.608021 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:00.607905    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-0f165f39\"/\"default-dockercfg-g9zfv\""
Jul 24 19:59:00.608021 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:00.607942    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-0f165f39\"/\"kube-root-ca.crt\""
Jul 24 19:59:00.608021 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:00.608001    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-0f165f39\"/\"openshift-service-ca.crt\""
Jul 24 19:59:00.613488 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:00.613464    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-0f165f39/e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h"]
Jul 24 19:59:00.735275 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:00.735242    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvj94\" (UniqueName: \"kubernetes.io/projected/3dd5ee4f-8c37-469d-9f78-11889a420671-kube-api-access-hvj94\") pod \"e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h\" (UID: \"3dd5ee4f-8c37-469d-9f78-11889a420671\") " pod="ai-tenant-e2e-mt-0f165f39/e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h"
Jul 24 19:59:00.735275 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:00.735279    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3dd5ee4f-8c37-469d-9f78-11889a420671-model-cache\") pod \"e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h\" (UID: \"3dd5ee4f-8c37-469d-9f78-11889a420671\") " pod="ai-tenant-e2e-mt-0f165f39/e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h"
Jul 24 19:59:00.735519 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:00.735344    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3dd5ee4f-8c37-469d-9f78-11889a420671-dshm\") pod \"e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h\" (UID: \"3dd5ee4f-8c37-469d-9f78-11889a420671\") " pod="ai-tenant-e2e-mt-0f165f39/e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h"
Jul 24 19:59:00.735519 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:00.735385    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3dd5ee4f-8c37-469d-9f78-11889a420671-home\") pod \"e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h\" (UID: \"3dd5ee4f-8c37-469d-9f78-11889a420671\") " pod="ai-tenant-e2e-mt-0f165f39/e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h"
Jul 24 19:59:00.735519 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:00.735495    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3dd5ee4f-8c37-469d-9f78-11889a420671-tmp-dir\") pod \"e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h\" (UID: \"3dd5ee4f-8c37-469d-9f78-11889a420671\") " pod="ai-tenant-e2e-mt-0f165f39/e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h"
Jul 24 19:59:00.735656 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:00.735523    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3dd5ee4f-8c37-469d-9f78-11889a420671-tls-certs\") pod \"e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h\" (UID: \"3dd5ee4f-8c37-469d-9f78-11889a420671\") " pod="ai-tenant-e2e-mt-0f165f39/e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h"
Jul 24 19:59:00.836977 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:00.836925    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3dd5ee4f-8c37-469d-9f78-11889a420671-tmp-dir\") pod \"e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h\" (UID: \"3dd5ee4f-8c37-469d-9f78-11889a420671\") " pod="ai-tenant-e2e-mt-0f165f39/e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h"
Jul 24 19:59:00.836977 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:00.836977    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3dd5ee4f-8c37-469d-9f78-11889a420671-tls-certs\") pod \"e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h\" (UID: \"3dd5ee4f-8c37-469d-9f78-11889a420671\") " pod="ai-tenant-e2e-mt-0f165f39/e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h"
Jul 24 19:59:00.837345 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:00.837003    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvj94\" (UniqueName: \"kubernetes.io/projected/3dd5ee4f-8c37-469d-9f78-11889a420671-kube-api-access-hvj94\") pod \"e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h\" (UID: \"3dd5ee4f-8c37-469d-9f78-11889a420671\") " pod="ai-tenant-e2e-mt-0f165f39/e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h"
Jul 24 19:59:00.837345 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:00.837025    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3dd5ee4f-8c37-469d-9f78-11889a420671-model-cache\") pod \"e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h\" (UID: \"3dd5ee4f-8c37-469d-9f78-11889a420671\") " pod="ai-tenant-e2e-mt-0f165f39/e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h"
Jul 24 19:59:00.837345 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:00.837043    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3dd5ee4f-8c37-469d-9f78-11889a420671-dshm\") pod \"e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h\" (UID: \"3dd5ee4f-8c37-469d-9f78-11889a420671\") " pod="ai-tenant-e2e-mt-0f165f39/e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h"
Jul 24 19:59:00.837345 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:00.837064    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3dd5ee4f-8c37-469d-9f78-11889a420671-home\") pod \"e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h\" (UID: \"3dd5ee4f-8c37-469d-9f78-11889a420671\") " pod="ai-tenant-e2e-mt-0f165f39/e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h"
Jul 24 19:59:00.837508 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:00.837389    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3dd5ee4f-8c37-469d-9f78-11889a420671-tmp-dir\") pod \"e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h\" (UID: \"3dd5ee4f-8c37-469d-9f78-11889a420671\") " pod="ai-tenant-e2e-mt-0f165f39/e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h"
Jul 24 19:59:00.837508 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:00.837412    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3dd5ee4f-8c37-469d-9f78-11889a420671-model-cache\") pod \"e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h\" (UID: \"3dd5ee4f-8c37-469d-9f78-11889a420671\") " pod="ai-tenant-e2e-mt-0f165f39/e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h"
Jul 24 19:59:00.837508 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:00.837482    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3dd5ee4f-8c37-469d-9f78-11889a420671-home\") pod \"e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h\" (UID: \"3dd5ee4f-8c37-469d-9f78-11889a420671\") " pod="ai-tenant-e2e-mt-0f165f39/e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h"
Jul 24 19:59:00.839556 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:00.839532    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3dd5ee4f-8c37-469d-9f78-11889a420671-dshm\") pod \"e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h\" (UID: \"3dd5ee4f-8c37-469d-9f78-11889a420671\") " pod="ai-tenant-e2e-mt-0f165f39/e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h"
Jul 24 19:59:00.839648 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:00.839610    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3dd5ee4f-8c37-469d-9f78-11889a420671-tls-certs\") pod \"e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h\" (UID: \"3dd5ee4f-8c37-469d-9f78-11889a420671\") " pod="ai-tenant-e2e-mt-0f165f39/e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h"
Jul 24 19:59:00.846004 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:00.845973    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvj94\" (UniqueName: \"kubernetes.io/projected/3dd5ee4f-8c37-469d-9f78-11889a420671-kube-api-access-hvj94\") pod \"e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h\" (UID: \"3dd5ee4f-8c37-469d-9f78-11889a420671\") " pod="ai-tenant-e2e-mt-0f165f39/e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h"
Jul 24 19:59:00.914479 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:00.914382    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0f165f39/e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h"
Jul 24 19:59:01.049844 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:01.049818    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-0f165f39/e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h"]
Jul 24 19:59:01.051770 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:59:01.051740    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3dd5ee4f_8c37_469d_9f78_11889a420671.slice/crio-807c82cafeb84123742657e2a20a9cd924024f4040707e4c4b4d8e5fba8324a6 WatchSource:0}: Error finding container 807c82cafeb84123742657e2a20a9cd924024f4040707e4c4b4d8e5fba8324a6: Status 404 returned error can't find the container with id 807c82cafeb84123742657e2a20a9cd924024f4040707e4c4b4d8e5fba8324a6
Jul 24 19:59:01.772290 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:01.772248    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0f165f39/e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h" event={"ID":"3dd5ee4f-8c37-469d-9f78-11889a420671","Type":"ContainerStarted","Data":"932343ebc8c847bb8421251ea676e43531ca3aa7d531974c3391d1ea24649c8a"}
Jul 24 19:59:01.772674 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:01.772301    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0f165f39/e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h" event={"ID":"3dd5ee4f-8c37-469d-9f78-11889a420671","Type":"ContainerStarted","Data":"807c82cafeb84123742657e2a20a9cd924024f4040707e4c4b4d8e5fba8324a6"}
Jul 24 19:59:01.791930 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:01.791879    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-0f165f39/e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h" podStartSLOduration=1.791864497 podStartE2EDuration="1.791864497s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:59:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:59:01.789447127 +0000 UTC m=+1939.978521454" watchObservedRunningTime="2026-07-24 19:59:01.791864497 +0000 UTC m=+1939.980938809"
Jul 24 19:59:03.683155 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:03.683124    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:59:10.915283 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:10.915243    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-0f165f39/e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h"
Jul 24 19:59:10.915686 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:10.915308    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-0f165f39/e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h"
Jul 24 19:59:10.927904 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:10.927875    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-0f165f39/e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h"
Jul 24 19:59:11.840461 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:11.840433    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-0f165f39/e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h"
Jul 24 19:59:24.584268 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:24.584219    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:59:29.202954 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:29.202920    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0f165f39-w5wxj"]
Jul 24 19:59:29.206276 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:29.206255    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0f165f39-w5wxj"
Jul 24 19:59:29.209396 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:29.209374    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gqw4p\""
Jul 24 19:59:29.222805 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:29.222775    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0f165f39-w5wxj"]
Jul 24 19:59:29.285948 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:29.285906    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/770a0c3b-c084-4bf1-bf3c-b87d32b3bc62-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-0f165f39-w5wxj\" (UID: \"770a0c3b-c084-4bf1-bf3c-b87d32b3bc62\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0f165f39-w5wxj"
Jul 24 19:59:29.387413 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:29.387370    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/770a0c3b-c084-4bf1-bf3c-b87d32b3bc62-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-0f165f39-w5wxj\" (UID: \"770a0c3b-c084-4bf1-bf3c-b87d32b3bc62\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0f165f39-w5wxj"
Jul 24 19:59:29.388060 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:29.388032    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/770a0c3b-c084-4bf1-bf3c-b87d32b3bc62-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-0f165f39-w5wxj\" (UID: \"770a0c3b-c084-4bf1-bf3c-b87d32b3bc62\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0f165f39-w5wxj"
Jul 24 19:59:29.516713 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:29.516685    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0f165f39-w5wxj"
Jul 24 19:59:29.662849 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:29.662819    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0f165f39-w5wxj"]
Jul 24 19:59:29.664654 ip-10-0-131-150 kubenswrapper[2579]: W0724 19:59:29.664629    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod770a0c3b_c084_4bf1_bf3c_b87d32b3bc62.slice/crio-eadd8455bb5d01f6cdf1269eb2054cf5581e3ce1c3d91597f925195f288619c5 WatchSource:0}: Error finding container eadd8455bb5d01f6cdf1269eb2054cf5581e3ce1c3d91597f925195f288619c5: Status 404 returned error can't find the container with id eadd8455bb5d01f6cdf1269eb2054cf5581e3ce1c3d91597f925195f288619c5
Jul 24 19:59:29.924814 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:29.924777    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0f165f39-w5wxj" event={"ID":"770a0c3b-c084-4bf1-bf3c-b87d32b3bc62","Type":"ContainerStarted","Data":"b0dcdbc705a83e347106a6749e0b17946a66fe4661ef75d8708fd00166702c8f"}
Jul 24 19:59:29.924957 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:29.924875    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0f165f39-w5wxj" event={"ID":"770a0c3b-c084-4bf1-bf3c-b87d32b3bc62","Type":"ContainerStarted","Data":"eadd8455bb5d01f6cdf1269eb2054cf5581e3ce1c3d91597f925195f288619c5"}
Jul 24 19:59:29.943177 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:29.943123    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0f165f39-w5wxj" podStartSLOduration=0.943107956 podStartE2EDuration="943.107956ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:59:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:59:29.941254507 +0000 UTC m=+1968.130328821" watchObservedRunningTime="2026-07-24 19:59:29.943107956 +0000 UTC m=+1968.132182329"
Jul 24 19:59:30.931711 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:30.931672    2579 generic.go:356] "Generic (PLEG): container finished" podID="770a0c3b-c084-4bf1-bf3c-b87d32b3bc62" containerID="b0dcdbc705a83e347106a6749e0b17946a66fe4661ef75d8708fd00166702c8f" exitCode=0
Jul 24 19:59:30.932137 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:30.931817    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0f165f39-w5wxj" event={"ID":"770a0c3b-c084-4bf1-bf3c-b87d32b3bc62","Type":"ContainerDied","Data":"b0dcdbc705a83e347106a6749e0b17946a66fe4661ef75d8708fd00166702c8f"}
Jul 24 19:59:32.068525 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:32.068501    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0f165f39-w5wxj"
Jul 24 19:59:32.110680 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:32.110652    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/770a0c3b-c084-4bf1-bf3c-b87d32b3bc62-maas-api-service-ca\") pod \"770a0c3b-c084-4bf1-bf3c-b87d32b3bc62\" (UID: \"770a0c3b-c084-4bf1-bf3c-b87d32b3bc62\") "
Jul 24 19:59:32.111044 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:32.111023    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/770a0c3b-c084-4bf1-bf3c-b87d32b3bc62-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "770a0c3b-c084-4bf1-bf3c-b87d32b3bc62" (UID: "770a0c3b-c084-4bf1-bf3c-b87d32b3bc62"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:59:32.212137 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:32.212052    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/770a0c3b-c084-4bf1-bf3c-b87d32b3bc62-maas-api-service-ca\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 19:59:32.943028 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:32.942951    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0f165f39-w5wxj"
Jul 24 19:59:32.943028 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:32.942996    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0f165f39-w5wxj" event={"ID":"770a0c3b-c084-4bf1-bf3c-b87d32b3bc62","Type":"ContainerDied","Data":"eadd8455bb5d01f6cdf1269eb2054cf5581e3ce1c3d91597f925195f288619c5"}
Jul 24 19:59:32.943225 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:32.943046    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eadd8455bb5d01f6cdf1269eb2054cf5581e3ce1c3d91597f925195f288619c5"
Jul 24 19:59:43.192336 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:43.192297    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:59:44.621230 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:44.621132    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0f165f39-7f5787c54b-zz5gm"]
Jul 24 19:59:44.621662 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:44.621390    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0f165f39-7f5787c54b-zz5gm" podUID="2b616438-8a43-47db-a2b9-6d4f9fd5ee05" containerName="maas-api" containerID="cri-o://efc010a483fdc9486ef28a4e92f4dbabc215066a5f1dbad9ec94124062d229b1" gracePeriod=30
Jul 24 19:59:44.878850 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:44.878788    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0f165f39-7f5787c54b-zz5gm"
Jul 24 19:59:45.005613 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:45.005576    2579 generic.go:356] "Generic (PLEG): container finished" podID="2b616438-8a43-47db-a2b9-6d4f9fd5ee05" containerID="efc010a483fdc9486ef28a4e92f4dbabc215066a5f1dbad9ec94124062d229b1" exitCode=0
Jul 24 19:59:45.005790 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:45.005621    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0f165f39-7f5787c54b-zz5gm" event={"ID":"2b616438-8a43-47db-a2b9-6d4f9fd5ee05","Type":"ContainerDied","Data":"efc010a483fdc9486ef28a4e92f4dbabc215066a5f1dbad9ec94124062d229b1"}
Jul 24 19:59:45.005790 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:45.005626    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0f165f39-7f5787c54b-zz5gm"
Jul 24 19:59:45.005790 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:45.005675    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0f165f39-7f5787c54b-zz5gm" event={"ID":"2b616438-8a43-47db-a2b9-6d4f9fd5ee05","Type":"ContainerDied","Data":"56abb0520cc0c5d2a4d4eaad4de87109bb39b16c2bd2c8ac30262f5a19c8fe9b"}
Jul 24 19:59:45.005790 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:45.005707    2579 scope.go:117] "RemoveContainer" containerID="efc010a483fdc9486ef28a4e92f4dbabc215066a5f1dbad9ec94124062d229b1"
Jul 24 19:59:45.014536 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:45.014515    2579 scope.go:117] "RemoveContainer" containerID="efc010a483fdc9486ef28a4e92f4dbabc215066a5f1dbad9ec94124062d229b1"
Jul 24 19:59:45.014833 ip-10-0-131-150 kubenswrapper[2579]: E0724 19:59:45.014815    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efc010a483fdc9486ef28a4e92f4dbabc215066a5f1dbad9ec94124062d229b1\": container with ID starting with efc010a483fdc9486ef28a4e92f4dbabc215066a5f1dbad9ec94124062d229b1 not found: ID does not exist" containerID="efc010a483fdc9486ef28a4e92f4dbabc215066a5f1dbad9ec94124062d229b1"
Jul 24 19:59:45.014887 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:45.014845    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efc010a483fdc9486ef28a4e92f4dbabc215066a5f1dbad9ec94124062d229b1"} err="failed to get container status \"efc010a483fdc9486ef28a4e92f4dbabc215066a5f1dbad9ec94124062d229b1\": rpc error: code = NotFound desc = could not find container \"efc010a483fdc9486ef28a4e92f4dbabc215066a5f1dbad9ec94124062d229b1\": container with ID starting with efc010a483fdc9486ef28a4e92f4dbabc215066a5f1dbad9ec94124062d229b1 not found: ID does not exist"
Jul 24 19:59:45.028208 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:45.028184    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b616438-8a43-47db-a2b9-6d4f9fd5ee05-maas-api-tls\") pod \"2b616438-8a43-47db-a2b9-6d4f9fd5ee05\" (UID: \"2b616438-8a43-47db-a2b9-6d4f9fd5ee05\") "
Jul 24 19:59:45.028337 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:45.028227    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvksj\" (UniqueName: \"kubernetes.io/projected/2b616438-8a43-47db-a2b9-6d4f9fd5ee05-kube-api-access-gvksj\") pod \"2b616438-8a43-47db-a2b9-6d4f9fd5ee05\" (UID: \"2b616438-8a43-47db-a2b9-6d4f9fd5ee05\") "
Jul 24 19:59:45.028337 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:45.028272    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b616438-8a43-47db-a2b9-6d4f9fd5ee05-openshift-service-ca\") pod \"2b616438-8a43-47db-a2b9-6d4f9fd5ee05\" (UID: \"2b616438-8a43-47db-a2b9-6d4f9fd5ee05\") "
Jul 24 19:59:45.028656 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:45.028636    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b616438-8a43-47db-a2b9-6d4f9fd5ee05-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2b616438-8a43-47db-a2b9-6d4f9fd5ee05" (UID: "2b616438-8a43-47db-a2b9-6d4f9fd5ee05"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:59:45.030526 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:45.030500    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b616438-8a43-47db-a2b9-6d4f9fd5ee05-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2b616438-8a43-47db-a2b9-6d4f9fd5ee05" (UID: "2b616438-8a43-47db-a2b9-6d4f9fd5ee05"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:59:45.030599 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:45.030503    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b616438-8a43-47db-a2b9-6d4f9fd5ee05-kube-api-access-gvksj" (OuterVolumeSpecName: "kube-api-access-gvksj") pod "2b616438-8a43-47db-a2b9-6d4f9fd5ee05" (UID: "2b616438-8a43-47db-a2b9-6d4f9fd5ee05"). InnerVolumeSpecName "kube-api-access-gvksj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:59:45.129230 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:45.129134    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b616438-8a43-47db-a2b9-6d4f9fd5ee05-openshift-service-ca\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 19:59:45.129230 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:45.129166    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b616438-8a43-47db-a2b9-6d4f9fd5ee05-maas-api-tls\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 19:59:45.129230 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:45.129175    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvksj\" (UniqueName: \"kubernetes.io/projected/2b616438-8a43-47db-a2b9-6d4f9fd5ee05-kube-api-access-gvksj\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 19:59:45.327792 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:45.327757    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0f165f39-7f5787c54b-zz5gm"]
Jul 24 19:59:45.329672 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:45.329651    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0f165f39-7f5787c54b-zz5gm"]
Jul 24 19:59:46.369324 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:46.369286    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b616438-8a43-47db-a2b9-6d4f9fd5ee05" path="/var/lib/kubelet/pods/2b616438-8a43-47db-a2b9-6d4f9fd5ee05/volumes"
Jul 24 19:59:49.284675 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:49.284634    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0f165f39-w5wxj"]
Jul 24 19:59:49.286956 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:49.286933    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0f165f39-w5wxj"]
Jul 24 19:59:50.370081 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:50.370053    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="770a0c3b-c084-4bf1-bf3c-b87d32b3bc62" path="/var/lib/kubelet/pods/770a0c3b-c084-4bf1-bf3c-b87d32b3bc62/volumes"
Jul 24 19:59:52.298475 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:52.298440    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 19:59:57.455593 ip-10-0-131-150 kubenswrapper[2579]: I0724 19:59:57.455558    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-0f165f39/e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h"]
Jul 24 20:00:00.137896 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:00.137856    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748720-28c95"]
Jul 24 20:00:00.138305 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:00.138219    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="770a0c3b-c084-4bf1-bf3c-b87d32b3bc62" containerName="revoke-keys"
Jul 24 20:00:00.138305 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:00.138229    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="770a0c3b-c084-4bf1-bf3c-b87d32b3bc62" containerName="revoke-keys"
Jul 24 20:00:00.138305 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:00.138238    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b616438-8a43-47db-a2b9-6d4f9fd5ee05" containerName="maas-api"
Jul 24 20:00:00.138305 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:00.138243    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b616438-8a43-47db-a2b9-6d4f9fd5ee05" containerName="maas-api"
Jul 24 20:00:00.138305 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:00.138295    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="770a0c3b-c084-4bf1-bf3c-b87d32b3bc62" containerName="revoke-keys"
Jul 24 20:00:00.138305 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:00.138304    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b616438-8a43-47db-a2b9-6d4f9fd5ee05" containerName="maas-api"
Jul 24 20:00:00.142416 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:00.142398    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748720-28c95"
Jul 24 20:00:00.145635 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:00.145608    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gqw4p\""
Jul 24 20:00:00.147792 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:00.147765    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748720-28c95"]
Jul 24 20:00:00.154013 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:00.153991    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748720-28c95"
Jul 24 20:00:00.289064 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:00.289036    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748720-28c95"]
Jul 24 20:00:00.291170 ip-10-0-131-150 kubenswrapper[2579]: W0724 20:00:00.291136    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9206d489_876d_4124_ad4b_0eccf3d1025c.slice/crio-844da3cdbec447e92176a97213f8c255476a845eb68f0295a8413b847abdb5d1 WatchSource:0}: Error finding container 844da3cdbec447e92176a97213f8c255476a845eb68f0295a8413b847abdb5d1: Status 404 returned error can't find the container with id 844da3cdbec447e92176a97213f8c255476a845eb68f0295a8413b847abdb5d1
Jul 24 20:00:01.092126 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:01.092088    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748720-28c95" event={"ID":"9206d489-876d-4124-ad4b-0eccf3d1025c","Type":"ContainerStarted","Data":"c78e4c6d527c8d0359c090585f3f07ba9f763d69c71c9df77c74d6d421706035"}
Jul 24 20:00:01.092324 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:01.092140    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748720-28c95" event={"ID":"9206d489-876d-4124-ad4b-0eccf3d1025c","Type":"ContainerStarted","Data":"844da3cdbec447e92176a97213f8c255476a845eb68f0295a8413b847abdb5d1"}
Jul 24 20:00:01.106195 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:01.106142    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748720-28c95" podStartSLOduration=1.106122487 podStartE2EDuration="1.106122487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:00:01.105915309 +0000 UTC m=+1999.294989623" watchObservedRunningTime="2026-07-24 20:00:01.106122487 +0000 UTC m=+1999.295196797"
Jul 24 20:00:02.098677 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:02.098645    2579 generic.go:356] "Generic (PLEG): container finished" podID="9206d489-876d-4124-ad4b-0eccf3d1025c" containerID="c78e4c6d527c8d0359c090585f3f07ba9f763d69c71c9df77c74d6d421706035" exitCode=0
Jul 24 20:00:02.099166 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:02.098692    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748720-28c95" event={"ID":"9206d489-876d-4124-ad4b-0eccf3d1025c","Type":"ContainerDied","Data":"c78e4c6d527c8d0359c090585f3f07ba9f763d69c71c9df77c74d6d421706035"}
Jul 24 20:00:03.232358 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:03.232329    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748720-28c95"
Jul 24 20:00:04.114855 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:04.114816    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748720-28c95" event={"ID":"9206d489-876d-4124-ad4b-0eccf3d1025c","Type":"ContainerDied","Data":"844da3cdbec447e92176a97213f8c255476a845eb68f0295a8413b847abdb5d1"}
Jul 24 20:00:04.114855 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:04.114852    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748720-28c95"
Jul 24 20:00:04.115065 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:04.114876    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="844da3cdbec447e92176a97213f8c255476a845eb68f0295a8413b847abdb5d1"
Jul 24 20:00:12.475277 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:12.475211    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-0f165f39/e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h" podUID="3dd5ee4f-8c37-469d-9f78-11889a420671" containerName="main" containerID="cri-o://932343ebc8c847bb8421251ea676e43531ca3aa7d531974c3391d1ea24649c8a" gracePeriod=45
Jul 24 20:00:12.726703 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:12.726640    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0f165f39/e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h"
Jul 24 20:00:12.763862 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:12.763832    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3dd5ee4f-8c37-469d-9f78-11889a420671-tmp-dir\") pod \"3dd5ee4f-8c37-469d-9f78-11889a420671\" (UID: \"3dd5ee4f-8c37-469d-9f78-11889a420671\") "
Jul 24 20:00:12.764044 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:12.763896    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3dd5ee4f-8c37-469d-9f78-11889a420671-dshm\") pod \"3dd5ee4f-8c37-469d-9f78-11889a420671\" (UID: \"3dd5ee4f-8c37-469d-9f78-11889a420671\") "
Jul 24 20:00:12.764044 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:12.763927    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3dd5ee4f-8c37-469d-9f78-11889a420671-home\") pod \"3dd5ee4f-8c37-469d-9f78-11889a420671\" (UID: \"3dd5ee4f-8c37-469d-9f78-11889a420671\") "
Jul 24 20:00:12.764044 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:12.763965    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3dd5ee4f-8c37-469d-9f78-11889a420671-tls-certs\") pod \"3dd5ee4f-8c37-469d-9f78-11889a420671\" (UID: \"3dd5ee4f-8c37-469d-9f78-11889a420671\") "
Jul 24 20:00:12.764044 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:12.763992    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3dd5ee4f-8c37-469d-9f78-11889a420671-model-cache\") pod \"3dd5ee4f-8c37-469d-9f78-11889a420671\" (UID: \"3dd5ee4f-8c37-469d-9f78-11889a420671\") "
Jul 24 20:00:12.764044 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:12.764032    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvj94\" (UniqueName: \"kubernetes.io/projected/3dd5ee4f-8c37-469d-9f78-11889a420671-kube-api-access-hvj94\") pod \"3dd5ee4f-8c37-469d-9f78-11889a420671\" (UID: \"3dd5ee4f-8c37-469d-9f78-11889a420671\") "
Jul 24 20:00:12.764290 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:12.764137    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dd5ee4f-8c37-469d-9f78-11889a420671-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3dd5ee4f-8c37-469d-9f78-11889a420671" (UID: "3dd5ee4f-8c37-469d-9f78-11889a420671"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:00:12.764342 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:12.764316    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3dd5ee4f-8c37-469d-9f78-11889a420671-tmp-dir\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:00:12.764410 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:12.764341    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dd5ee4f-8c37-469d-9f78-11889a420671-home" (OuterVolumeSpecName: "home") pod "3dd5ee4f-8c37-469d-9f78-11889a420671" (UID: "3dd5ee4f-8c37-469d-9f78-11889a420671"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:00:12.764483 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:12.764452    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dd5ee4f-8c37-469d-9f78-11889a420671-model-cache" (OuterVolumeSpecName: "model-cache") pod "3dd5ee4f-8c37-469d-9f78-11889a420671" (UID: "3dd5ee4f-8c37-469d-9f78-11889a420671"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:00:12.766499 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:12.766465    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3dd5ee4f-8c37-469d-9f78-11889a420671-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3dd5ee4f-8c37-469d-9f78-11889a420671" (UID: "3dd5ee4f-8c37-469d-9f78-11889a420671"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 20:00:12.766883 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:12.766858    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dd5ee4f-8c37-469d-9f78-11889a420671-dshm" (OuterVolumeSpecName: "dshm") pod "3dd5ee4f-8c37-469d-9f78-11889a420671" (UID: "3dd5ee4f-8c37-469d-9f78-11889a420671"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:00:12.766883 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:12.766863    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dd5ee4f-8c37-469d-9f78-11889a420671-kube-api-access-hvj94" (OuterVolumeSpecName: "kube-api-access-hvj94") pod "3dd5ee4f-8c37-469d-9f78-11889a420671" (UID: "3dd5ee4f-8c37-469d-9f78-11889a420671"). InnerVolumeSpecName "kube-api-access-hvj94". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:00:12.865147 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:12.865109    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3dd5ee4f-8c37-469d-9f78-11889a420671-dshm\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:00:12.865147 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:12.865137    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3dd5ee4f-8c37-469d-9f78-11889a420671-home\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:00:12.865147 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:12.865149    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3dd5ee4f-8c37-469d-9f78-11889a420671-tls-certs\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:00:12.865381 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:12.865160    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3dd5ee4f-8c37-469d-9f78-11889a420671-model-cache\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:00:12.865381 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:12.865172    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvj94\" (UniqueName: \"kubernetes.io/projected/3dd5ee4f-8c37-469d-9f78-11889a420671-kube-api-access-hvj94\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:00:13.161188 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:13.161153    2579 generic.go:356] "Generic (PLEG): container finished" podID="3dd5ee4f-8c37-469d-9f78-11889a420671" containerID="932343ebc8c847bb8421251ea676e43531ca3aa7d531974c3391d1ea24649c8a" exitCode=0
Jul 24 20:00:13.161372 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:13.161202    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0f165f39/e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h" event={"ID":"3dd5ee4f-8c37-469d-9f78-11889a420671","Type":"ContainerDied","Data":"932343ebc8c847bb8421251ea676e43531ca3aa7d531974c3391d1ea24649c8a"}
Jul 24 20:00:13.161372 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:13.161230    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0f165f39/e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h" event={"ID":"3dd5ee4f-8c37-469d-9f78-11889a420671","Type":"ContainerDied","Data":"807c82cafeb84123742657e2a20a9cd924024f4040707e4c4b4d8e5fba8324a6"}
Jul 24 20:00:13.161372 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:13.161246    2579 scope.go:117] "RemoveContainer" containerID="932343ebc8c847bb8421251ea676e43531ca3aa7d531974c3391d1ea24649c8a"
Jul 24 20:00:13.161372 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:13.161201    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0f165f39/e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h"
Jul 24 20:00:13.173217 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:13.173191    2579 scope.go:117] "RemoveContainer" containerID="932343ebc8c847bb8421251ea676e43531ca3aa7d531974c3391d1ea24649c8a"
Jul 24 20:00:13.173642 ip-10-0-131-150 kubenswrapper[2579]: E0724 20:00:13.173616    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"932343ebc8c847bb8421251ea676e43531ca3aa7d531974c3391d1ea24649c8a\": container with ID starting with 932343ebc8c847bb8421251ea676e43531ca3aa7d531974c3391d1ea24649c8a not found: ID does not exist" containerID="932343ebc8c847bb8421251ea676e43531ca3aa7d531974c3391d1ea24649c8a"
Jul 24 20:00:13.173758 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:13.173654    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"932343ebc8c847bb8421251ea676e43531ca3aa7d531974c3391d1ea24649c8a"} err="failed to get container status \"932343ebc8c847bb8421251ea676e43531ca3aa7d531974c3391d1ea24649c8a\": rpc error: code = NotFound desc = could not find container \"932343ebc8c847bb8421251ea676e43531ca3aa7d531974c3391d1ea24649c8a\": container with ID starting with 932343ebc8c847bb8421251ea676e43531ca3aa7d531974c3391d1ea24649c8a not found: ID does not exist"
Jul 24 20:00:13.183951 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:13.183880    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-0f165f39/e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h"]
Jul 24 20:00:13.186021 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:13.185992    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-0f165f39/e2e-lifecycle-model-0f165f39-kserve-7775f986c9-tmx7h"]
Jul 24 20:00:14.368359 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:14.368328    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3dd5ee4f-8c37-469d-9f78-11889a420671" path="/var/lib/kubelet/pods/3dd5ee4f-8c37-469d-9f78-11889a420671/volumes"
Jul 24 20:00:44.290099 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:44.290057    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 20:00:55.689197 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:00:55.689155    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 20:01:39.041141 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:39.041099    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-839a20-7b7488d8cc-q6qqs"]
Jul 24 20:01:39.041775 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:39.041441    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dd5ee4f-8c37-469d-9f78-11889a420671" containerName="main"
Jul 24 20:01:39.041775 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:39.041455    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dd5ee4f-8c37-469d-9f78-11889a420671" containerName="main"
Jul 24 20:01:39.041775 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:39.041471    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9206d489-876d-4124-ad4b-0eccf3d1025c" containerName="cleanup"
Jul 24 20:01:39.041775 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:39.041477    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9206d489-876d-4124-ad4b-0eccf3d1025c" containerName="cleanup"
Jul 24 20:01:39.041775 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:39.041534    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3dd5ee4f-8c37-469d-9f78-11889a420671" containerName="main"
Jul 24 20:01:39.041775 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:39.041542    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9206d489-876d-4124-ad4b-0eccf3d1025c" containerName="cleanup"
Jul 24 20:01:39.044524 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:39.044504    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-839a20-7b7488d8cc-q6qqs"
Jul 24 20:01:39.051318 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:39.051290    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-839a20-serving-cert\""
Jul 24 20:01:39.051533 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:39.051515    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-z5t42\""
Jul 24 20:01:39.052331 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:39.052317    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 20:01:39.052403 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:39.052357    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 24 20:01:39.059711 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:39.059674    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-839a20-7b7488d8cc-q6qqs"]
Jul 24 20:01:39.202647 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:39.202614    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b-maas-api-tls\") pod \"maas-api-e2e-inf-a-839a20-7b7488d8cc-q6qqs\" (UID: \"84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-839a20-7b7488d8cc-q6qqs"
Jul 24 20:01:39.202856 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:39.202665    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p69x8\" (UniqueName: \"kubernetes.io/projected/84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b-kube-api-access-p69x8\") pod \"maas-api-e2e-inf-a-839a20-7b7488d8cc-q6qqs\" (UID: \"84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-839a20-7b7488d8cc-q6qqs"
Jul 24 20:01:39.202856 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:39.202700    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b-openshift-service-ca\") pod \"maas-api-e2e-inf-a-839a20-7b7488d8cc-q6qqs\" (UID: \"84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-839a20-7b7488d8cc-q6qqs"
Jul 24 20:01:39.304043 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:39.303951    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b-maas-api-tls\") pod \"maas-api-e2e-inf-a-839a20-7b7488d8cc-q6qqs\" (UID: \"84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-839a20-7b7488d8cc-q6qqs"
Jul 24 20:01:39.304043 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:39.304008    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p69x8\" (UniqueName: \"kubernetes.io/projected/84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b-kube-api-access-p69x8\") pod \"maas-api-e2e-inf-a-839a20-7b7488d8cc-q6qqs\" (UID: \"84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-839a20-7b7488d8cc-q6qqs"
Jul 24 20:01:39.304218 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:39.304047    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b-openshift-service-ca\") pod \"maas-api-e2e-inf-a-839a20-7b7488d8cc-q6qqs\" (UID: \"84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-839a20-7b7488d8cc-q6qqs"
Jul 24 20:01:39.304218 ip-10-0-131-150 kubenswrapper[2579]: E0724 20:01:39.304122    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-839a20-serving-cert: secret "maas-api-e2e-inf-a-839a20-serving-cert" not found
Jul 24 20:01:39.304218 ip-10-0-131-150 kubenswrapper[2579]: E0724 20:01:39.304188    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b-maas-api-tls podName:84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b nodeName:}" failed. No retries permitted until 2026-07-24 20:01:39.804170601 +0000 UTC m=+2097.993244897 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b-maas-api-tls") pod "maas-api-e2e-inf-a-839a20-7b7488d8cc-q6qqs" (UID: "84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b") : secret "maas-api-e2e-inf-a-839a20-serving-cert" not found
Jul 24 20:01:39.304755 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:39.304712    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b-openshift-service-ca\") pod \"maas-api-e2e-inf-a-839a20-7b7488d8cc-q6qqs\" (UID: \"84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-839a20-7b7488d8cc-q6qqs"
Jul 24 20:01:39.314542 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:39.314509    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p69x8\" (UniqueName: \"kubernetes.io/projected/84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b-kube-api-access-p69x8\") pod \"maas-api-e2e-inf-a-839a20-7b7488d8cc-q6qqs\" (UID: \"84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-839a20-7b7488d8cc-q6qqs"
Jul 24 20:01:39.809406 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:39.809372    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b-maas-api-tls\") pod \"maas-api-e2e-inf-a-839a20-7b7488d8cc-q6qqs\" (UID: \"84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-839a20-7b7488d8cc-q6qqs"
Jul 24 20:01:39.811922 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:39.811894    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b-maas-api-tls\") pod \"maas-api-e2e-inf-a-839a20-7b7488d8cc-q6qqs\" (UID: \"84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-839a20-7b7488d8cc-q6qqs"
Jul 24 20:01:39.955375 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:39.955336    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-839a20-7b7488d8cc-q6qqs"
Jul 24 20:01:40.090076 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:40.090049    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-839a20-7b7488d8cc-q6qqs"]
Jul 24 20:01:40.091869 ip-10-0-131-150 kubenswrapper[2579]: W0724 20:01:40.091843    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84bd00d6_c142_4c51_b9ed_bd36c6fc4d3b.slice/crio-c101b0132ecfd9ed19cc42f4785bd03057c1dd22f8182c2b7f5762951bdc8dea WatchSource:0}: Error finding container c101b0132ecfd9ed19cc42f4785bd03057c1dd22f8182c2b7f5762951bdc8dea: Status 404 returned error can't find the container with id c101b0132ecfd9ed19cc42f4785bd03057c1dd22f8182c2b7f5762951bdc8dea
Jul 24 20:01:40.601929 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:40.601903    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-839a20-7b7488d8cc-q6qqs" event={"ID":"84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b","Type":"ContainerStarted","Data":"c101b0132ecfd9ed19cc42f4785bd03057c1dd22f8182c2b7f5762951bdc8dea"}
Jul 24 20:01:41.608935 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:41.608895    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-839a20-7b7488d8cc-q6qqs" event={"ID":"84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b","Type":"ContainerStarted","Data":"c65344c08abc8bd18242bb06b0644a521f0189fa5dd19d38c641002ae0cfbbf9"}
Jul 24 20:01:41.609394 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:41.609078    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-839a20-7b7488d8cc-q6qqs"
Jul 24 20:01:41.625793 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:41.625714    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-839a20-7b7488d8cc-q6qqs" podStartSLOduration=2.144815166 podStartE2EDuration="2.625698015s" totalImagesPullingTime="480.882849ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:01:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:01:41.624102819 +0000 UTC m=+2099.813177145" watchObservedRunningTime="2026-07-24 20:01:41.625698015 +0000 UTC m=+2099.814772327"
Jul 24 20:01:42.448955 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:42.448921    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vclnd_fa8789c9-6c39-46cd-a540-657dea710eb8/ovn-acl-logging/0.log"
Jul 24 20:01:42.461840 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:42.461820    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vclnd_fa8789c9-6c39-46cd-a540-657dea710eb8/ovn-acl-logging/0.log"
Jul 24 20:01:42.506684 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:42.506653    2579 scope.go:117] "RemoveContainer" containerID="013a15b5d0d44bbd5cb8db1863f978f6c824432d5df180646dd27d900bcb1010"
Jul 24 20:01:42.514923 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:42.514899    2579 scope.go:117] "RemoveContainer" containerID="ca70c40ffff8b7753047f0c3a1978537785302e9c4163ff1d20987b5b38c4319"
Jul 24 20:01:44.782415 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:44.782374    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 20:01:46.850509 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:46.850466    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6a7079-5947d7897c-v48rn"]
Jul 24 20:01:46.855318 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:46.855289    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6a7079-5947d7897c-v48rn"
Jul 24 20:01:46.857710 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:46.857684    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-6a7079-serving-cert\""
Jul 24 20:01:46.861130 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:46.861095    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6a7079-5947d7897c-v48rn"]
Jul 24 20:01:46.974127 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:46.974089    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e478eed7-dfb0-4b9b-bf83-4cf40ca90f83-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6a7079-5947d7897c-v48rn\" (UID: \"e478eed7-dfb0-4b9b-bf83-4cf40ca90f83\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6a7079-5947d7897c-v48rn"
Jul 24 20:01:46.974296 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:46.974154    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e478eed7-dfb0-4b9b-bf83-4cf40ca90f83-maas-api-tls\") pod \"maas-api-e2e-inf-b-6a7079-5947d7897c-v48rn\" (UID: \"e478eed7-dfb0-4b9b-bf83-4cf40ca90f83\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6a7079-5947d7897c-v48rn"
Jul 24 20:01:46.974296 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:46.974217    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfp9g\" (UniqueName: \"kubernetes.io/projected/e478eed7-dfb0-4b9b-bf83-4cf40ca90f83-kube-api-access-gfp9g\") pod \"maas-api-e2e-inf-b-6a7079-5947d7897c-v48rn\" (UID: \"e478eed7-dfb0-4b9b-bf83-4cf40ca90f83\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6a7079-5947d7897c-v48rn"
Jul 24 20:01:47.075121 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:47.075087    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfp9g\" (UniqueName: \"kubernetes.io/projected/e478eed7-dfb0-4b9b-bf83-4cf40ca90f83-kube-api-access-gfp9g\") pod \"maas-api-e2e-inf-b-6a7079-5947d7897c-v48rn\" (UID: \"e478eed7-dfb0-4b9b-bf83-4cf40ca90f83\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6a7079-5947d7897c-v48rn"
Jul 24 20:01:47.075121 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:47.075134    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e478eed7-dfb0-4b9b-bf83-4cf40ca90f83-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6a7079-5947d7897c-v48rn\" (UID: \"e478eed7-dfb0-4b9b-bf83-4cf40ca90f83\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6a7079-5947d7897c-v48rn"
Jul 24 20:01:47.075362 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:47.075170    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e478eed7-dfb0-4b9b-bf83-4cf40ca90f83-maas-api-tls\") pod \"maas-api-e2e-inf-b-6a7079-5947d7897c-v48rn\" (UID: \"e478eed7-dfb0-4b9b-bf83-4cf40ca90f83\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6a7079-5947d7897c-v48rn"
Jul 24 20:01:47.075362 ip-10-0-131-150 kubenswrapper[2579]: E0724 20:01:47.075290    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-6a7079-serving-cert: secret "maas-api-e2e-inf-b-6a7079-serving-cert" not found
Jul 24 20:01:47.075362 ip-10-0-131-150 kubenswrapper[2579]: E0724 20:01:47.075350    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e478eed7-dfb0-4b9b-bf83-4cf40ca90f83-maas-api-tls podName:e478eed7-dfb0-4b9b-bf83-4cf40ca90f83 nodeName:}" failed. No retries permitted until 2026-07-24 20:01:47.575331012 +0000 UTC m=+2105.764405305 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e478eed7-dfb0-4b9b-bf83-4cf40ca90f83-maas-api-tls") pod "maas-api-e2e-inf-b-6a7079-5947d7897c-v48rn" (UID: "e478eed7-dfb0-4b9b-bf83-4cf40ca90f83") : secret "maas-api-e2e-inf-b-6a7079-serving-cert" not found
Jul 24 20:01:47.075858 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:47.075839    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e478eed7-dfb0-4b9b-bf83-4cf40ca90f83-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6a7079-5947d7897c-v48rn\" (UID: \"e478eed7-dfb0-4b9b-bf83-4cf40ca90f83\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6a7079-5947d7897c-v48rn"
Jul 24 20:01:47.090692 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:47.090659    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfp9g\" (UniqueName: \"kubernetes.io/projected/e478eed7-dfb0-4b9b-bf83-4cf40ca90f83-kube-api-access-gfp9g\") pod \"maas-api-e2e-inf-b-6a7079-5947d7897c-v48rn\" (UID: \"e478eed7-dfb0-4b9b-bf83-4cf40ca90f83\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6a7079-5947d7897c-v48rn"
Jul 24 20:01:47.580982 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:47.580945    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e478eed7-dfb0-4b9b-bf83-4cf40ca90f83-maas-api-tls\") pod \"maas-api-e2e-inf-b-6a7079-5947d7897c-v48rn\" (UID: \"e478eed7-dfb0-4b9b-bf83-4cf40ca90f83\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6a7079-5947d7897c-v48rn"
Jul 24 20:01:47.583671 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:47.583634    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e478eed7-dfb0-4b9b-bf83-4cf40ca90f83-maas-api-tls\") pod \"maas-api-e2e-inf-b-6a7079-5947d7897c-v48rn\" (UID: \"e478eed7-dfb0-4b9b-bf83-4cf40ca90f83\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6a7079-5947d7897c-v48rn"
Jul 24 20:01:47.619836 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:47.619810    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-839a20-7b7488d8cc-q6qqs"
Jul 24 20:01:47.769627 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:47.769591    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6a7079-5947d7897c-v48rn"
Jul 24 20:01:47.914451 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:47.914420    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6a7079-5947d7897c-v48rn"]
Jul 24 20:01:47.916174 ip-10-0-131-150 kubenswrapper[2579]: W0724 20:01:47.916146    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode478eed7_dfb0_4b9b_bf83_4cf40ca90f83.slice/crio-bbd79dfb430548c3b0bc6bdb639a2eb5a96dfbc2182a8e4f8734d896c5b35a9f WatchSource:0}: Error finding container bbd79dfb430548c3b0bc6bdb639a2eb5a96dfbc2182a8e4f8734d896c5b35a9f: Status 404 returned error can't find the container with id bbd79dfb430548c3b0bc6bdb639a2eb5a96dfbc2182a8e4f8734d896c5b35a9f
Jul 24 20:01:48.646464 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:48.646432    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6a7079-5947d7897c-v48rn" event={"ID":"e478eed7-dfb0-4b9b-bf83-4cf40ca90f83","Type":"ContainerStarted","Data":"ee4d3ed7e9e6d28abca1e6cdb7d97d36acb71000f8cfb707ef587603b345c319"}
Jul 24 20:01:48.646650 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:48.646484    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6a7079-5947d7897c-v48rn" event={"ID":"e478eed7-dfb0-4b9b-bf83-4cf40ca90f83","Type":"ContainerStarted","Data":"bbd79dfb430548c3b0bc6bdb639a2eb5a96dfbc2182a8e4f8734d896c5b35a9f"}
Jul 24 20:01:48.646650 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:48.646506    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6a7079-5947d7897c-v48rn"
Jul 24 20:01:48.665564 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:48.665509    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6a7079-5947d7897c-v48rn" podStartSLOduration=2.356804585 podStartE2EDuration="2.665495911s" totalImagesPullingTime="308.691326ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:01:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:01:48.662783523 +0000 UTC m=+2106.851857836" watchObservedRunningTime="2026-07-24 20:01:48.665495911 +0000 UTC m=+2106.854570256"
Jul 24 20:01:54.657591 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:54.657554    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6a7079-5947d7897c-v48rn"
Jul 24 20:01:56.005000 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:56.004963    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-839a20/test-model-839a20-kserve-96d466d99-5k9nt"]
Jul 24 20:01:56.008570 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:56.008549    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-839a20/test-model-839a20-kserve-96d466d99-5k9nt"
Jul 24 20:01:56.011039 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:56.011012    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-839a20\"/\"kube-root-ca.crt\""
Jul 24 20:01:56.011169 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:56.011074    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-839a20\"/\"openshift-service-ca.crt\""
Jul 24 20:01:56.011968 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:56.011948    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-839a20\"/\"default-dockercfg-nskg7\""
Jul 24 20:01:56.012081 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:56.011990    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-839a20\"/\"test-model-839a20-kserve-self-signed-certs\""
Jul 24 20:01:56.017941 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:56.017919    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-839a20/test-model-839a20-kserve-96d466d99-5k9nt"]
Jul 24 20:01:56.044689 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:56.044654    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rzsd\" (UniqueName: \"kubernetes.io/projected/5b5e8272-1f8c-49cf-b44b-7359e3fe63d5-kube-api-access-4rzsd\") pod \"test-model-839a20-kserve-96d466d99-5k9nt\" (UID: \"5b5e8272-1f8c-49cf-b44b-7359e3fe63d5\") " pod="ai-tenant-e2e-inf-a-839a20/test-model-839a20-kserve-96d466d99-5k9nt"
Jul 24 20:01:56.044689 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:56.044699    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b5e8272-1f8c-49cf-b44b-7359e3fe63d5-home\") pod \"test-model-839a20-kserve-96d466d99-5k9nt\" (UID: \"5b5e8272-1f8c-49cf-b44b-7359e3fe63d5\") " pod="ai-tenant-e2e-inf-a-839a20/test-model-839a20-kserve-96d466d99-5k9nt"
Jul 24 20:01:56.044920 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:56.044764    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b5e8272-1f8c-49cf-b44b-7359e3fe63d5-tls-certs\") pod \"test-model-839a20-kserve-96d466d99-5k9nt\" (UID: \"5b5e8272-1f8c-49cf-b44b-7359e3fe63d5\") " pod="ai-tenant-e2e-inf-a-839a20/test-model-839a20-kserve-96d466d99-5k9nt"
Jul 24 20:01:56.044920 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:56.044785    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b5e8272-1f8c-49cf-b44b-7359e3fe63d5-dshm\") pod \"test-model-839a20-kserve-96d466d99-5k9nt\" (UID: \"5b5e8272-1f8c-49cf-b44b-7359e3fe63d5\") " pod="ai-tenant-e2e-inf-a-839a20/test-model-839a20-kserve-96d466d99-5k9nt"
Jul 24 20:01:56.044920 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:56.044807    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b5e8272-1f8c-49cf-b44b-7359e3fe63d5-tmp-dir\") pod \"test-model-839a20-kserve-96d466d99-5k9nt\" (UID: \"5b5e8272-1f8c-49cf-b44b-7359e3fe63d5\") " pod="ai-tenant-e2e-inf-a-839a20/test-model-839a20-kserve-96d466d99-5k9nt"
Jul 24 20:01:56.044920 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:56.044847    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b5e8272-1f8c-49cf-b44b-7359e3fe63d5-model-cache\") pod \"test-model-839a20-kserve-96d466d99-5k9nt\" (UID: \"5b5e8272-1f8c-49cf-b44b-7359e3fe63d5\") " pod="ai-tenant-e2e-inf-a-839a20/test-model-839a20-kserve-96d466d99-5k9nt"
Jul 24 20:01:56.146046 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:56.146013    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rzsd\" (UniqueName: \"kubernetes.io/projected/5b5e8272-1f8c-49cf-b44b-7359e3fe63d5-kube-api-access-4rzsd\") pod \"test-model-839a20-kserve-96d466d99-5k9nt\" (UID: \"5b5e8272-1f8c-49cf-b44b-7359e3fe63d5\") " pod="ai-tenant-e2e-inf-a-839a20/test-model-839a20-kserve-96d466d99-5k9nt"
Jul 24 20:01:56.146215 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:56.146054    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b5e8272-1f8c-49cf-b44b-7359e3fe63d5-home\") pod \"test-model-839a20-kserve-96d466d99-5k9nt\" (UID: \"5b5e8272-1f8c-49cf-b44b-7359e3fe63d5\") " pod="ai-tenant-e2e-inf-a-839a20/test-model-839a20-kserve-96d466d99-5k9nt"
Jul 24 20:01:56.146215 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:56.146094    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b5e8272-1f8c-49cf-b44b-7359e3fe63d5-tls-certs\") pod \"test-model-839a20-kserve-96d466d99-5k9nt\" (UID: \"5b5e8272-1f8c-49cf-b44b-7359e3fe63d5\") " pod="ai-tenant-e2e-inf-a-839a20/test-model-839a20-kserve-96d466d99-5k9nt"
Jul 24 20:01:56.146215 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:56.146114    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b5e8272-1f8c-49cf-b44b-7359e3fe63d5-dshm\") pod \"test-model-839a20-kserve-96d466d99-5k9nt\" (UID: \"5b5e8272-1f8c-49cf-b44b-7359e3fe63d5\") " pod="ai-tenant-e2e-inf-a-839a20/test-model-839a20-kserve-96d466d99-5k9nt"
Jul 24 20:01:56.146215 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:56.146135    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b5e8272-1f8c-49cf-b44b-7359e3fe63d5-tmp-dir\") pod \"test-model-839a20-kserve-96d466d99-5k9nt\" (UID: \"5b5e8272-1f8c-49cf-b44b-7359e3fe63d5\") " pod="ai-tenant-e2e-inf-a-839a20/test-model-839a20-kserve-96d466d99-5k9nt"
Jul 24 20:01:56.146215 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:56.146155    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b5e8272-1f8c-49cf-b44b-7359e3fe63d5-model-cache\") pod \"test-model-839a20-kserve-96d466d99-5k9nt\" (UID: \"5b5e8272-1f8c-49cf-b44b-7359e3fe63d5\") " pod="ai-tenant-e2e-inf-a-839a20/test-model-839a20-kserve-96d466d99-5k9nt"
Jul 24 20:01:56.146620 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:56.146540    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b5e8272-1f8c-49cf-b44b-7359e3fe63d5-home\") pod \"test-model-839a20-kserve-96d466d99-5k9nt\" (UID: \"5b5e8272-1f8c-49cf-b44b-7359e3fe63d5\") " pod="ai-tenant-e2e-inf-a-839a20/test-model-839a20-kserve-96d466d99-5k9nt"
Jul 24 20:01:56.146671 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:56.146629    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b5e8272-1f8c-49cf-b44b-7359e3fe63d5-tmp-dir\") pod \"test-model-839a20-kserve-96d466d99-5k9nt\" (UID: \"5b5e8272-1f8c-49cf-b44b-7359e3fe63d5\") " pod="ai-tenant-e2e-inf-a-839a20/test-model-839a20-kserve-96d466d99-5k9nt"
Jul 24 20:01:56.146671 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:56.146659    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b5e8272-1f8c-49cf-b44b-7359e3fe63d5-model-cache\") pod \"test-model-839a20-kserve-96d466d99-5k9nt\" (UID: \"5b5e8272-1f8c-49cf-b44b-7359e3fe63d5\") " pod="ai-tenant-e2e-inf-a-839a20/test-model-839a20-kserve-96d466d99-5k9nt"
Jul 24 20:01:56.148571 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:56.148545    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b5e8272-1f8c-49cf-b44b-7359e3fe63d5-dshm\") pod \"test-model-839a20-kserve-96d466d99-5k9nt\" (UID: \"5b5e8272-1f8c-49cf-b44b-7359e3fe63d5\") " pod="ai-tenant-e2e-inf-a-839a20/test-model-839a20-kserve-96d466d99-5k9nt"
Jul 24 20:01:56.148875 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:56.148858    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b5e8272-1f8c-49cf-b44b-7359e3fe63d5-tls-certs\") pod \"test-model-839a20-kserve-96d466d99-5k9nt\" (UID: \"5b5e8272-1f8c-49cf-b44b-7359e3fe63d5\") " pod="ai-tenant-e2e-inf-a-839a20/test-model-839a20-kserve-96d466d99-5k9nt"
Jul 24 20:01:56.154126 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:56.154105    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rzsd\" (UniqueName: \"kubernetes.io/projected/5b5e8272-1f8c-49cf-b44b-7359e3fe63d5-kube-api-access-4rzsd\") pod \"test-model-839a20-kserve-96d466d99-5k9nt\" (UID: \"5b5e8272-1f8c-49cf-b44b-7359e3fe63d5\") " pod="ai-tenant-e2e-inf-a-839a20/test-model-839a20-kserve-96d466d99-5k9nt"
Jul 24 20:01:56.319683 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:56.319576    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-839a20/test-model-839a20-kserve-96d466d99-5k9nt"
Jul 24 20:01:56.452578 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:56.452405    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-839a20/test-model-839a20-kserve-96d466d99-5k9nt"]
Jul 24 20:01:56.455311 ip-10-0-131-150 kubenswrapper[2579]: W0724 20:01:56.455284    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b5e8272_1f8c_49cf_b44b_7359e3fe63d5.slice/crio-f67edefeab2033396dddcff3b1b5b21a37853ff38d4cdca5f43a5e429fa590cb WatchSource:0}: Error finding container f67edefeab2033396dddcff3b1b5b21a37853ff38d4cdca5f43a5e429fa590cb: Status 404 returned error can't find the container with id f67edefeab2033396dddcff3b1b5b21a37853ff38d4cdca5f43a5e429fa590cb
Jul 24 20:01:56.691255 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:56.691166    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-839a20/test-model-839a20-kserve-96d466d99-5k9nt" event={"ID":"5b5e8272-1f8c-49cf-b44b-7359e3fe63d5","Type":"ContainerStarted","Data":"9f790a8d1b3b045d738f56953efba0b267090490f72b615bb6362d730bbda872"}
Jul 24 20:01:56.691255 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:56.691212    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-839a20/test-model-839a20-kserve-96d466d99-5k9nt" event={"ID":"5b5e8272-1f8c-49cf-b44b-7359e3fe63d5","Type":"ContainerStarted","Data":"f67edefeab2033396dddcff3b1b5b21a37853ff38d4cdca5f43a5e429fa590cb"}
Jul 24 20:01:56.708537 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:01:56.708485    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-839a20/test-model-839a20-kserve-96d466d99-5k9nt" podStartSLOduration=1.70847028 podStartE2EDuration="1.70847028s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:01:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:01:56.706603393 +0000 UTC m=+2114.895677708" watchObservedRunningTime="2026-07-24 20:01:56.70847028 +0000 UTC m=+2114.897544593"
Jul 24 20:02:00.092856 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:02:00.092819    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 20:02:06.319692 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:02:06.319649    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-839a20/test-model-839a20-kserve-96d466d99-5k9nt"
Jul 24 20:02:06.320184 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:02:06.319773    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-839a20/test-model-839a20-kserve-96d466d99-5k9nt"
Jul 24 20:02:06.332443 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:02:06.332414    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-839a20/test-model-839a20-kserve-96d466d99-5k9nt"
Jul 24 20:02:06.761922 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:02:06.761894    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-839a20/test-model-839a20-kserve-96d466d99-5k9nt"
Jul 24 20:02:14.493679 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:02:14.493637    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 20:02:31.486973 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:02:31.486939    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 20:02:50.329143 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:02:50.329108    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-839a20/test-model-839a20-kserve-96d466d99-5k9nt"]
Jul 24 20:02:51.439248 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:02:51.439210    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-839a20-xbptj"]
Jul 24 20:02:51.442852 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:02:51.442830    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-839a20-xbptj"
Jul 24 20:02:51.445282 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:02:51.445259    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gqw4p\""
Jul 24 20:02:51.451095 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:02:51.451002    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-839a20-xbptj"]
Jul 24 20:02:51.548508 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:02:51.548470    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/667e24a7-d08c-4b36-8caf-1bd4d2513017-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-839a20-xbptj\" (UID: \"667e24a7-d08c-4b36-8caf-1bd4d2513017\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-839a20-xbptj"
Jul 24 20:02:51.649340 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:02:51.649304    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/667e24a7-d08c-4b36-8caf-1bd4d2513017-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-839a20-xbptj\" (UID: \"667e24a7-d08c-4b36-8caf-1bd4d2513017\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-839a20-xbptj"
Jul 24 20:02:51.649952 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:02:51.649933    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/667e24a7-d08c-4b36-8caf-1bd4d2513017-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-839a20-xbptj\" (UID: \"667e24a7-d08c-4b36-8caf-1bd4d2513017\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-839a20-xbptj"
Jul 24 20:02:51.754259 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:02:51.754230    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-839a20-xbptj"
Jul 24 20:02:51.889336 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:02:51.889307    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-839a20-xbptj"]
Jul 24 20:02:51.890914 ip-10-0-131-150 kubenswrapper[2579]: W0724 20:02:51.890885    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod667e24a7_d08c_4b36_8caf_1bd4d2513017.slice/crio-94b996723020244a7c3a1a935faf9dc2d05c5dd6945da25fd9f7afa4af742ac9 WatchSource:0}: Error finding container 94b996723020244a7c3a1a935faf9dc2d05c5dd6945da25fd9f7afa4af742ac9: Status 404 returned error can't find the container with id 94b996723020244a7c3a1a935faf9dc2d05c5dd6945da25fd9f7afa4af742ac9
Jul 24 20:02:51.979924 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:02:51.979888    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-839a20-xbptj" event={"ID":"667e24a7-d08c-4b36-8caf-1bd4d2513017","Type":"ContainerStarted","Data":"94b996723020244a7c3a1a935faf9dc2d05c5dd6945da25fd9f7afa4af742ac9"}
Jul 24 20:02:52.986657 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:02:52.986563    2579 generic.go:356] "Generic (PLEG): container finished" podID="667e24a7-d08c-4b36-8caf-1bd4d2513017" containerID="1176bdd136e34b47dc081e597742745c5369a9003d7ec22130763fa9c7440334" exitCode=0
Jul 24 20:02:52.987057 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:02:52.986654    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-839a20-xbptj" event={"ID":"667e24a7-d08c-4b36-8caf-1bd4d2513017","Type":"ContainerDied","Data":"1176bdd136e34b47dc081e597742745c5369a9003d7ec22130763fa9c7440334"}
Jul 24 20:02:54.122279 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:02:54.122241    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-839a20-xbptj"
Jul 24 20:02:54.171716 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:02:54.171671    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/667e24a7-d08c-4b36-8caf-1bd4d2513017-maas-api-service-ca\") pod \"667e24a7-d08c-4b36-8caf-1bd4d2513017\" (UID: \"667e24a7-d08c-4b36-8caf-1bd4d2513017\") "
Jul 24 20:02:54.172085 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:02:54.172060    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/667e24a7-d08c-4b36-8caf-1bd4d2513017-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "667e24a7-d08c-4b36-8caf-1bd4d2513017" (UID: "667e24a7-d08c-4b36-8caf-1bd4d2513017"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:02:54.272792 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:02:54.272755    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/667e24a7-d08c-4b36-8caf-1bd4d2513017-maas-api-service-ca\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:02:54.997552 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:02:54.997521    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-839a20-xbptj"
Jul 24 20:02:54.997757 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:02:54.997548    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-839a20-xbptj" event={"ID":"667e24a7-d08c-4b36-8caf-1bd4d2513017","Type":"ContainerDied","Data":"94b996723020244a7c3a1a935faf9dc2d05c5dd6945da25fd9f7afa4af742ac9"}
Jul 24 20:02:54.997757 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:02:54.997630    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="94b996723020244a7c3a1a935faf9dc2d05c5dd6945da25fd9f7afa4af742ac9"
Jul 24 20:02:55.283430 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:02:55.283398    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 20:03:01.849543 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:01.849505    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-839a20-7b7488d8cc-q6qqs"]
Jul 24 20:03:01.850057 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:01.849858    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-839a20-7b7488d8cc-q6qqs" podUID="84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b" containerName="maas-api" containerID="cri-o://c65344c08abc8bd18242bb06b0644a521f0189fa5dd19d38c641002ae0cfbbf9" gracePeriod=30
Jul 24 20:03:02.034743 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:02.034700    2579 generic.go:356] "Generic (PLEG): container finished" podID="84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b" containerID="c65344c08abc8bd18242bb06b0644a521f0189fa5dd19d38c641002ae0cfbbf9" exitCode=0
Jul 24 20:03:02.034937 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:02.034768    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-839a20-7b7488d8cc-q6qqs" event={"ID":"84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b","Type":"ContainerDied","Data":"c65344c08abc8bd18242bb06b0644a521f0189fa5dd19d38c641002ae0cfbbf9"}
Jul 24 20:03:02.097640 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:02.097611    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-839a20-7b7488d8cc-q6qqs"
Jul 24 20:03:02.249782 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:02.249662    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p69x8\" (UniqueName: \"kubernetes.io/projected/84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b-kube-api-access-p69x8\") pod \"84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b\" (UID: \"84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b\") "
Jul 24 20:03:02.249782 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:02.249766    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b-openshift-service-ca\") pod \"84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b\" (UID: \"84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b\") "
Jul 24 20:03:02.250048 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:02.249787    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b-maas-api-tls\") pod \"84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b\" (UID: \"84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b\") "
Jul 24 20:03:02.250180 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:02.250155    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b" (UID: "84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:03:02.252046 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:02.252022    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b" (UID: "84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 20:03:02.252141 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:02.252126    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b-kube-api-access-p69x8" (OuterVolumeSpecName: "kube-api-access-p69x8") pod "84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b" (UID: "84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b"). InnerVolumeSpecName "kube-api-access-p69x8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:03:02.350969 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:02.350921    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p69x8\" (UniqueName: \"kubernetes.io/projected/84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b-kube-api-access-p69x8\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:03:02.350969 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:02.350963    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b-openshift-service-ca\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:03:02.350969 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:02.350973    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b-maas-api-tls\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:03:03.041324 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:03.041292    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-839a20-7b7488d8cc-q6qqs" event={"ID":"84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b","Type":"ContainerDied","Data":"c101b0132ecfd9ed19cc42f4785bd03057c1dd22f8182c2b7f5762951bdc8dea"}
Jul 24 20:03:03.041324 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:03.041320    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-839a20-7b7488d8cc-q6qqs"
Jul 24 20:03:03.041926 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:03.041350    2579 scope.go:117] "RemoveContainer" containerID="c65344c08abc8bd18242bb06b0644a521f0189fa5dd19d38c641002ae0cfbbf9"
Jul 24 20:03:03.057620 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:03.057564    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-839a20-7b7488d8cc-q6qqs"]
Jul 24 20:03:03.060139 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:03.060115    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-839a20-7b7488d8cc-q6qqs"]
Jul 24 20:03:04.367443 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:04.367409    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b" path="/var/lib/kubelet/pods/84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b/volumes"
Jul 24 20:03:05.348844 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:05.348800    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-839a20/test-model-839a20-kserve-96d466d99-5k9nt" podUID="5b5e8272-1f8c-49cf-b44b-7359e3fe63d5" containerName="main" containerID="cri-o://9f790a8d1b3b045d738f56953efba0b267090490f72b615bb6362d730bbda872" gracePeriod=45
Jul 24 20:03:05.588757 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:05.588714    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-839a20/test-model-839a20-kserve-96d466d99-5k9nt"
Jul 24 20:03:05.683099 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:05.683018    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b5e8272-1f8c-49cf-b44b-7359e3fe63d5-model-cache\") pod \"5b5e8272-1f8c-49cf-b44b-7359e3fe63d5\" (UID: \"5b5e8272-1f8c-49cf-b44b-7359e3fe63d5\") "
Jul 24 20:03:05.683099 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:05.683059    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4rzsd\" (UniqueName: \"kubernetes.io/projected/5b5e8272-1f8c-49cf-b44b-7359e3fe63d5-kube-api-access-4rzsd\") pod \"5b5e8272-1f8c-49cf-b44b-7359e3fe63d5\" (UID: \"5b5e8272-1f8c-49cf-b44b-7359e3fe63d5\") "
Jul 24 20:03:05.683099 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:05.683093    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b5e8272-1f8c-49cf-b44b-7359e3fe63d5-tls-certs\") pod \"5b5e8272-1f8c-49cf-b44b-7359e3fe63d5\" (UID: \"5b5e8272-1f8c-49cf-b44b-7359e3fe63d5\") "
Jul 24 20:03:05.683364 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:05.683129    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b5e8272-1f8c-49cf-b44b-7359e3fe63d5-dshm\") pod \"5b5e8272-1f8c-49cf-b44b-7359e3fe63d5\" (UID: \"5b5e8272-1f8c-49cf-b44b-7359e3fe63d5\") "
Jul 24 20:03:05.683364 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:05.683144    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b5e8272-1f8c-49cf-b44b-7359e3fe63d5-tmp-dir\") pod \"5b5e8272-1f8c-49cf-b44b-7359e3fe63d5\" (UID: \"5b5e8272-1f8c-49cf-b44b-7359e3fe63d5\") "
Jul 24 20:03:05.683364 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:05.683177    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b5e8272-1f8c-49cf-b44b-7359e3fe63d5-home\") pod \"5b5e8272-1f8c-49cf-b44b-7359e3fe63d5\" (UID: \"5b5e8272-1f8c-49cf-b44b-7359e3fe63d5\") "
Jul 24 20:03:05.683364 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:05.683259    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b5e8272-1f8c-49cf-b44b-7359e3fe63d5-model-cache" (OuterVolumeSpecName: "model-cache") pod "5b5e8272-1f8c-49cf-b44b-7359e3fe63d5" (UID: "5b5e8272-1f8c-49cf-b44b-7359e3fe63d5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:03:05.683570 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:05.683456    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b5e8272-1f8c-49cf-b44b-7359e3fe63d5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5b5e8272-1f8c-49cf-b44b-7359e3fe63d5" (UID: "5b5e8272-1f8c-49cf-b44b-7359e3fe63d5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:03:05.683570 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:05.683468    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b5e8272-1f8c-49cf-b44b-7359e3fe63d5-model-cache\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:03:05.683570 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:05.683472    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b5e8272-1f8c-49cf-b44b-7359e3fe63d5-home" (OuterVolumeSpecName: "home") pod "5b5e8272-1f8c-49cf-b44b-7359e3fe63d5" (UID: "5b5e8272-1f8c-49cf-b44b-7359e3fe63d5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:03:05.685618 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:05.685588    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b5e8272-1f8c-49cf-b44b-7359e3fe63d5-dshm" (OuterVolumeSpecName: "dshm") pod "5b5e8272-1f8c-49cf-b44b-7359e3fe63d5" (UID: "5b5e8272-1f8c-49cf-b44b-7359e3fe63d5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:03:05.685755 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:05.685624    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b5e8272-1f8c-49cf-b44b-7359e3fe63d5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5b5e8272-1f8c-49cf-b44b-7359e3fe63d5" (UID: "5b5e8272-1f8c-49cf-b44b-7359e3fe63d5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 20:03:05.685755 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:05.685637    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b5e8272-1f8c-49cf-b44b-7359e3fe63d5-kube-api-access-4rzsd" (OuterVolumeSpecName: "kube-api-access-4rzsd") pod "5b5e8272-1f8c-49cf-b44b-7359e3fe63d5" (UID: "5b5e8272-1f8c-49cf-b44b-7359e3fe63d5"). InnerVolumeSpecName "kube-api-access-4rzsd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:03:05.784157 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:05.784129    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b5e8272-1f8c-49cf-b44b-7359e3fe63d5-tls-certs\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:03:05.784335 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:05.784167    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b5e8272-1f8c-49cf-b44b-7359e3fe63d5-dshm\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:03:05.784335 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:05.784176    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b5e8272-1f8c-49cf-b44b-7359e3fe63d5-tmp-dir\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:03:05.784335 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:05.784183    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b5e8272-1f8c-49cf-b44b-7359e3fe63d5-home\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:03:05.784335 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:05.784191    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rzsd\" (UniqueName: \"kubernetes.io/projected/5b5e8272-1f8c-49cf-b44b-7359e3fe63d5-kube-api-access-4rzsd\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:03:06.059544 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:06.059508    2579 generic.go:356] "Generic (PLEG): container finished" podID="5b5e8272-1f8c-49cf-b44b-7359e3fe63d5" containerID="9f790a8d1b3b045d738f56953efba0b267090490f72b615bb6362d730bbda872" exitCode=0
Jul 24 20:03:06.059746 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:06.059551    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-839a20/test-model-839a20-kserve-96d466d99-5k9nt"
Jul 24 20:03:06.059746 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:06.059587    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-839a20/test-model-839a20-kserve-96d466d99-5k9nt" event={"ID":"5b5e8272-1f8c-49cf-b44b-7359e3fe63d5","Type":"ContainerDied","Data":"9f790a8d1b3b045d738f56953efba0b267090490f72b615bb6362d730bbda872"}
Jul 24 20:03:06.059746 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:06.059626    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-839a20/test-model-839a20-kserve-96d466d99-5k9nt" event={"ID":"5b5e8272-1f8c-49cf-b44b-7359e3fe63d5","Type":"ContainerDied","Data":"f67edefeab2033396dddcff3b1b5b21a37853ff38d4cdca5f43a5e429fa590cb"}
Jul 24 20:03:06.059746 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:06.059647    2579 scope.go:117] "RemoveContainer" containerID="9f790a8d1b3b045d738f56953efba0b267090490f72b615bb6362d730bbda872"
Jul 24 20:03:06.069476 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:06.069458    2579 scope.go:117] "RemoveContainer" containerID="9f790a8d1b3b045d738f56953efba0b267090490f72b615bb6362d730bbda872"
Jul 24 20:03:06.069771 ip-10-0-131-150 kubenswrapper[2579]: E0724 20:03:06.069751    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f790a8d1b3b045d738f56953efba0b267090490f72b615bb6362d730bbda872\": container with ID starting with 9f790a8d1b3b045d738f56953efba0b267090490f72b615bb6362d730bbda872 not found: ID does not exist" containerID="9f790a8d1b3b045d738f56953efba0b267090490f72b615bb6362d730bbda872"
Jul 24 20:03:06.069829 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:06.069780    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f790a8d1b3b045d738f56953efba0b267090490f72b615bb6362d730bbda872"} err="failed to get container status \"9f790a8d1b3b045d738f56953efba0b267090490f72b615bb6362d730bbda872\": rpc error: code = NotFound desc = could not find container \"9f790a8d1b3b045d738f56953efba0b267090490f72b615bb6362d730bbda872\": container with ID starting with 9f790a8d1b3b045d738f56953efba0b267090490f72b615bb6362d730bbda872 not found: ID does not exist"
Jul 24 20:03:06.080927 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:06.080903    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-839a20/test-model-839a20-kserve-96d466d99-5k9nt"]
Jul 24 20:03:06.086377 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:06.086357    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-839a20/test-model-839a20-kserve-96d466d99-5k9nt"]
Jul 24 20:03:06.367577 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:06.367498    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b5e8272-1f8c-49cf-b44b-7359e3fe63d5" path="/var/lib/kubelet/pods/5b5e8272-1f8c-49cf-b44b-7359e3fe63d5/volumes"
Jul 24 20:03:06.516623 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:06.516595    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-839a20-xbptj"]
Jul 24 20:03:06.519558 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:06.519533    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-839a20-xbptj"]
Jul 24 20:03:08.368100 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:08.368065    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="667e24a7-d08c-4b36-8caf-1bd4d2513017" path="/var/lib/kubelet/pods/667e24a7-d08c-4b36-8caf-1bd4d2513017/volumes"
Jul 24 20:03:10.587027 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:10.586989    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 20:03:13.664334 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:13.664300    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6a7079-f4pd2"]
Jul 24 20:03:13.664707 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:13.664630    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="667e24a7-d08c-4b36-8caf-1bd4d2513017" containerName="revoke-keys"
Jul 24 20:03:13.664707 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:13.664641    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="667e24a7-d08c-4b36-8caf-1bd4d2513017" containerName="revoke-keys"
Jul 24 20:03:13.664707 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:13.664659    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b5e8272-1f8c-49cf-b44b-7359e3fe63d5" containerName="main"
Jul 24 20:03:13.664707 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:13.664664    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b5e8272-1f8c-49cf-b44b-7359e3fe63d5" containerName="main"
Jul 24 20:03:13.664707 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:13.664681    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b" containerName="maas-api"
Jul 24 20:03:13.664707 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:13.664686    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b" containerName="maas-api"
Jul 24 20:03:13.664936 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:13.664749    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="84bd00d6-c142-4c51-b9ed-bd36c6fc4d3b" containerName="maas-api"
Jul 24 20:03:13.664936 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:13.664759    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="667e24a7-d08c-4b36-8caf-1bd4d2513017" containerName="revoke-keys"
Jul 24 20:03:13.664936 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:13.664767    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b5e8272-1f8c-49cf-b44b-7359e3fe63d5" containerName="main"
Jul 24 20:03:13.669095 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:13.669078    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6a7079-f4pd2"
Jul 24 20:03:13.671698 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:13.671663    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gqw4p\""
Jul 24 20:03:13.674654 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:13.674625    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6a7079-f4pd2"]
Jul 24 20:03:13.860926 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:13.860889    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae10f182-8d51-42cc-98ca-3ef637f2e63c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-6a7079-f4pd2\" (UID: \"ae10f182-8d51-42cc-98ca-3ef637f2e63c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6a7079-f4pd2"
Jul 24 20:03:13.961783 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:13.961670    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae10f182-8d51-42cc-98ca-3ef637f2e63c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-6a7079-f4pd2\" (UID: \"ae10f182-8d51-42cc-98ca-3ef637f2e63c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6a7079-f4pd2"
Jul 24 20:03:13.962308 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:13.962289    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae10f182-8d51-42cc-98ca-3ef637f2e63c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-6a7079-f4pd2\" (UID: \"ae10f182-8d51-42cc-98ca-3ef637f2e63c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6a7079-f4pd2"
Jul 24 20:03:13.981692 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:13.981660    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6a7079-f4pd2"
Jul 24 20:03:14.120564 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:14.120420    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6a7079-f4pd2"]
Jul 24 20:03:14.122900 ip-10-0-131-150 kubenswrapper[2579]: W0724 20:03:14.122871    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae10f182_8d51_42cc_98ca_3ef637f2e63c.slice/crio-e729cbc16057ea0e8eac5571f182d5d61c02ee5c724cc4cbc5e76f205e100e5b WatchSource:0}: Error finding container e729cbc16057ea0e8eac5571f182d5d61c02ee5c724cc4cbc5e76f205e100e5b: Status 404 returned error can't find the container with id e729cbc16057ea0e8eac5571f182d5d61c02ee5c724cc4cbc5e76f205e100e5b
Jul 24 20:03:15.115014 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:15.114915    2579 generic.go:356] "Generic (PLEG): container finished" podID="ae10f182-8d51-42cc-98ca-3ef637f2e63c" containerID="b178a6aafdb03dd7955ed637494bf8cf736bd7580e472137f24c48e9e43211b0" exitCode=0
Jul 24 20:03:15.115387 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:15.115004    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6a7079-f4pd2" event={"ID":"ae10f182-8d51-42cc-98ca-3ef637f2e63c","Type":"ContainerDied","Data":"b178a6aafdb03dd7955ed637494bf8cf736bd7580e472137f24c48e9e43211b0"}
Jul 24 20:03:15.115387 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:15.115068    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6a7079-f4pd2" event={"ID":"ae10f182-8d51-42cc-98ca-3ef637f2e63c","Type":"ContainerStarted","Data":"e729cbc16057ea0e8eac5571f182d5d61c02ee5c724cc4cbc5e76f205e100e5b"}
Jul 24 20:03:16.246263 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:16.246237    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6a7079-f4pd2"
Jul 24 20:03:16.381867 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:16.381788    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae10f182-8d51-42cc-98ca-3ef637f2e63c-maas-api-service-ca\") pod \"ae10f182-8d51-42cc-98ca-3ef637f2e63c\" (UID: \"ae10f182-8d51-42cc-98ca-3ef637f2e63c\") "
Jul 24 20:03:16.382120 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:16.382098    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae10f182-8d51-42cc-98ca-3ef637f2e63c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ae10f182-8d51-42cc-98ca-3ef637f2e63c" (UID: "ae10f182-8d51-42cc-98ca-3ef637f2e63c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:03:16.483191 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:16.483156    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae10f182-8d51-42cc-98ca-3ef637f2e63c-maas-api-service-ca\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:03:17.126458 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:17.126423    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6a7079-f4pd2" event={"ID":"ae10f182-8d51-42cc-98ca-3ef637f2e63c","Type":"ContainerDied","Data":"e729cbc16057ea0e8eac5571f182d5d61c02ee5c724cc4cbc5e76f205e100e5b"}
Jul 24 20:03:17.126458 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:17.126451    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6a7079-f4pd2"
Jul 24 20:03:17.126458 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:17.126472    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e729cbc16057ea0e8eac5571f182d5d61c02ee5c724cc4cbc5e76f205e100e5b"
Jul 24 20:03:24.190299 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:24.190263    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6a7079-5947d7897c-v48rn"]
Jul 24 20:03:24.190860 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:24.190453    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6a7079-5947d7897c-v48rn" podUID="e478eed7-dfb0-4b9b-bf83-4cf40ca90f83" containerName="maas-api" containerID="cri-o://ee4d3ed7e9e6d28abca1e6cdb7d97d36acb71000f8cfb707ef587603b345c319" gracePeriod=30
Jul 24 20:03:24.436114 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:24.436089    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6a7079-5947d7897c-v48rn"
Jul 24 20:03:24.447949 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:24.447876    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfp9g\" (UniqueName: \"kubernetes.io/projected/e478eed7-dfb0-4b9b-bf83-4cf40ca90f83-kube-api-access-gfp9g\") pod \"e478eed7-dfb0-4b9b-bf83-4cf40ca90f83\" (UID: \"e478eed7-dfb0-4b9b-bf83-4cf40ca90f83\") "
Jul 24 20:03:24.447949 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:24.447940    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e478eed7-dfb0-4b9b-bf83-4cf40ca90f83-maas-api-tls\") pod \"e478eed7-dfb0-4b9b-bf83-4cf40ca90f83\" (UID: \"e478eed7-dfb0-4b9b-bf83-4cf40ca90f83\") "
Jul 24 20:03:24.448135 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:24.448004    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e478eed7-dfb0-4b9b-bf83-4cf40ca90f83-openshift-service-ca\") pod \"e478eed7-dfb0-4b9b-bf83-4cf40ca90f83\" (UID: \"e478eed7-dfb0-4b9b-bf83-4cf40ca90f83\") "
Jul 24 20:03:24.448359 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:24.448332    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e478eed7-dfb0-4b9b-bf83-4cf40ca90f83-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e478eed7-dfb0-4b9b-bf83-4cf40ca90f83" (UID: "e478eed7-dfb0-4b9b-bf83-4cf40ca90f83"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:03:24.450098 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:24.450070    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e478eed7-dfb0-4b9b-bf83-4cf40ca90f83-kube-api-access-gfp9g" (OuterVolumeSpecName: "kube-api-access-gfp9g") pod "e478eed7-dfb0-4b9b-bf83-4cf40ca90f83" (UID: "e478eed7-dfb0-4b9b-bf83-4cf40ca90f83"). InnerVolumeSpecName "kube-api-access-gfp9g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:03:24.450192 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:24.450103    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e478eed7-dfb0-4b9b-bf83-4cf40ca90f83-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e478eed7-dfb0-4b9b-bf83-4cf40ca90f83" (UID: "e478eed7-dfb0-4b9b-bf83-4cf40ca90f83"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 20:03:24.548605 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:24.548572    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e478eed7-dfb0-4b9b-bf83-4cf40ca90f83-maas-api-tls\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:03:24.548605 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:24.548599    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e478eed7-dfb0-4b9b-bf83-4cf40ca90f83-openshift-service-ca\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:03:24.548605 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:24.548608    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfp9g\" (UniqueName: \"kubernetes.io/projected/e478eed7-dfb0-4b9b-bf83-4cf40ca90f83-kube-api-access-gfp9g\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:03:25.176270 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:25.176225    2579 generic.go:356] "Generic (PLEG): container finished" podID="e478eed7-dfb0-4b9b-bf83-4cf40ca90f83" containerID="ee4d3ed7e9e6d28abca1e6cdb7d97d36acb71000f8cfb707ef587603b345c319" exitCode=0
Jul 24 20:03:25.176270 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:25.176274    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6a7079-5947d7897c-v48rn"
Jul 24 20:03:25.176483 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:25.176306    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6a7079-5947d7897c-v48rn" event={"ID":"e478eed7-dfb0-4b9b-bf83-4cf40ca90f83","Type":"ContainerDied","Data":"ee4d3ed7e9e6d28abca1e6cdb7d97d36acb71000f8cfb707ef587603b345c319"}
Jul 24 20:03:25.176483 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:25.176354    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6a7079-5947d7897c-v48rn" event={"ID":"e478eed7-dfb0-4b9b-bf83-4cf40ca90f83","Type":"ContainerDied","Data":"bbd79dfb430548c3b0bc6bdb639a2eb5a96dfbc2182a8e4f8734d896c5b35a9f"}
Jul 24 20:03:25.176483 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:25.176378    2579 scope.go:117] "RemoveContainer" containerID="ee4d3ed7e9e6d28abca1e6cdb7d97d36acb71000f8cfb707ef587603b345c319"
Jul 24 20:03:25.185712 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:25.185687    2579 scope.go:117] "RemoveContainer" containerID="ee4d3ed7e9e6d28abca1e6cdb7d97d36acb71000f8cfb707ef587603b345c319"
Jul 24 20:03:25.185961 ip-10-0-131-150 kubenswrapper[2579]: E0724 20:03:25.185943    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee4d3ed7e9e6d28abca1e6cdb7d97d36acb71000f8cfb707ef587603b345c319\": container with ID starting with ee4d3ed7e9e6d28abca1e6cdb7d97d36acb71000f8cfb707ef587603b345c319 not found: ID does not exist" containerID="ee4d3ed7e9e6d28abca1e6cdb7d97d36acb71000f8cfb707ef587603b345c319"
Jul 24 20:03:25.186013 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:25.185970    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee4d3ed7e9e6d28abca1e6cdb7d97d36acb71000f8cfb707ef587603b345c319"} err="failed to get container status \"ee4d3ed7e9e6d28abca1e6cdb7d97d36acb71000f8cfb707ef587603b345c319\": rpc error: code = NotFound desc = could not find container \"ee4d3ed7e9e6d28abca1e6cdb7d97d36acb71000f8cfb707ef587603b345c319\": container with ID starting with ee4d3ed7e9e6d28abca1e6cdb7d97d36acb71000f8cfb707ef587603b345c319 not found: ID does not exist"
Jul 24 20:03:25.197676 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:25.197651    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6a7079-5947d7897c-v48rn"]
Jul 24 20:03:25.203153 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:25.203127    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6a7079-5947d7897c-v48rn"]
Jul 24 20:03:26.368115 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:26.368079    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e478eed7-dfb0-4b9b-bf83-4cf40ca90f83" path="/var/lib/kubelet/pods/e478eed7-dfb0-4b9b-bf83-4cf40ca90f83/volumes"
Jul 24 20:03:27.181671 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:27.181623    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 20:03:28.744144 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:28.744107    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6a7079-f4pd2"]
Jul 24 20:03:28.751338 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:28.751311    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6a7079-f4pd2"]
Jul 24 20:03:30.368005 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:30.367974    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae10f182-8d51-42cc-98ca-3ef637f2e63c" path="/var/lib/kubelet/pods/ae10f182-8d51-42cc-98ca-3ef637f2e63c/volumes"
Jul 24 20:03:39.456967 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:39.456934    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-cff930-6f9fcdcf4b-6nnpk"]
Jul 24 20:03:39.457454 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:39.457253    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae10f182-8d51-42cc-98ca-3ef637f2e63c" containerName="revoke-keys"
Jul 24 20:03:39.457454 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:39.457264    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae10f182-8d51-42cc-98ca-3ef637f2e63c" containerName="revoke-keys"
Jul 24 20:03:39.457454 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:39.457276    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e478eed7-dfb0-4b9b-bf83-4cf40ca90f83" containerName="maas-api"
Jul 24 20:03:39.457454 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:39.457282    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e478eed7-dfb0-4b9b-bf83-4cf40ca90f83" containerName="maas-api"
Jul 24 20:03:39.457454 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:39.457332    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae10f182-8d51-42cc-98ca-3ef637f2e63c" containerName="revoke-keys"
Jul 24 20:03:39.457454 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:39.457342    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e478eed7-dfb0-4b9b-bf83-4cf40ca90f83" containerName="maas-api"
Jul 24 20:03:39.461628 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:39.461605    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cff930-6f9fcdcf4b-6nnpk"
Jul 24 20:03:39.464405 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:39.464377    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-cff930-serving-cert\""
Jul 24 20:03:39.464573 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:39.464555    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-z5t42\""
Jul 24 20:03:39.464665 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:39.464644    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 20:03:39.465287 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:39.465274    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 24 20:03:39.471572 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:39.471549    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-cff930-6f9fcdcf4b-6nnpk"]
Jul 24 20:03:39.577376 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:39.577332    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65b64f59-1d65-4e73-878d-1a7db238d28b-maas-api-tls\") pod \"maas-api-e2e-api-a-cff930-6f9fcdcf4b-6nnpk\" (UID: \"65b64f59-1d65-4e73-878d-1a7db238d28b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cff930-6f9fcdcf4b-6nnpk"
Jul 24 20:03:39.577555 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:39.577480    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq7q8\" (UniqueName: \"kubernetes.io/projected/65b64f59-1d65-4e73-878d-1a7db238d28b-kube-api-access-pq7q8\") pod \"maas-api-e2e-api-a-cff930-6f9fcdcf4b-6nnpk\" (UID: \"65b64f59-1d65-4e73-878d-1a7db238d28b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cff930-6f9fcdcf4b-6nnpk"
Jul 24 20:03:39.577555 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:39.577516    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65b64f59-1d65-4e73-878d-1a7db238d28b-openshift-service-ca\") pod \"maas-api-e2e-api-a-cff930-6f9fcdcf4b-6nnpk\" (UID: \"65b64f59-1d65-4e73-878d-1a7db238d28b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cff930-6f9fcdcf4b-6nnpk"
Jul 24 20:03:39.678490 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:39.678446    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65b64f59-1d65-4e73-878d-1a7db238d28b-openshift-service-ca\") pod \"maas-api-e2e-api-a-cff930-6f9fcdcf4b-6nnpk\" (UID: \"65b64f59-1d65-4e73-878d-1a7db238d28b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cff930-6f9fcdcf4b-6nnpk"
Jul 24 20:03:39.678697 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:39.678537    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65b64f59-1d65-4e73-878d-1a7db238d28b-maas-api-tls\") pod \"maas-api-e2e-api-a-cff930-6f9fcdcf4b-6nnpk\" (UID: \"65b64f59-1d65-4e73-878d-1a7db238d28b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cff930-6f9fcdcf4b-6nnpk"
Jul 24 20:03:39.678697 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:39.678602    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq7q8\" (UniqueName: \"kubernetes.io/projected/65b64f59-1d65-4e73-878d-1a7db238d28b-kube-api-access-pq7q8\") pod \"maas-api-e2e-api-a-cff930-6f9fcdcf4b-6nnpk\" (UID: \"65b64f59-1d65-4e73-878d-1a7db238d28b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cff930-6f9fcdcf4b-6nnpk"
Jul 24 20:03:39.678868 ip-10-0-131-150 kubenswrapper[2579]: E0724 20:03:39.678715    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-cff930-serving-cert: secret "maas-api-e2e-api-a-cff930-serving-cert" not found
Jul 24 20:03:39.678868 ip-10-0-131-150 kubenswrapper[2579]: E0724 20:03:39.678811    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65b64f59-1d65-4e73-878d-1a7db238d28b-maas-api-tls podName:65b64f59-1d65-4e73-878d-1a7db238d28b nodeName:}" failed. No retries permitted until 2026-07-24 20:03:40.17879562 +0000 UTC m=+2218.367869914 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/65b64f59-1d65-4e73-878d-1a7db238d28b-maas-api-tls") pod "maas-api-e2e-api-a-cff930-6f9fcdcf4b-6nnpk" (UID: "65b64f59-1d65-4e73-878d-1a7db238d28b") : secret "maas-api-e2e-api-a-cff930-serving-cert" not found
Jul 24 20:03:39.679179 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:39.679160    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65b64f59-1d65-4e73-878d-1a7db238d28b-openshift-service-ca\") pod \"maas-api-e2e-api-a-cff930-6f9fcdcf4b-6nnpk\" (UID: \"65b64f59-1d65-4e73-878d-1a7db238d28b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cff930-6f9fcdcf4b-6nnpk"
Jul 24 20:03:39.690327 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:39.690295    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq7q8\" (UniqueName: \"kubernetes.io/projected/65b64f59-1d65-4e73-878d-1a7db238d28b-kube-api-access-pq7q8\") pod \"maas-api-e2e-api-a-cff930-6f9fcdcf4b-6nnpk\" (UID: \"65b64f59-1d65-4e73-878d-1a7db238d28b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cff930-6f9fcdcf4b-6nnpk"
Jul 24 20:03:40.183426 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:40.183388    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65b64f59-1d65-4e73-878d-1a7db238d28b-maas-api-tls\") pod \"maas-api-e2e-api-a-cff930-6f9fcdcf4b-6nnpk\" (UID: \"65b64f59-1d65-4e73-878d-1a7db238d28b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cff930-6f9fcdcf4b-6nnpk"
Jul 24 20:03:40.186041 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:40.186013    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65b64f59-1d65-4e73-878d-1a7db238d28b-maas-api-tls\") pod \"maas-api-e2e-api-a-cff930-6f9fcdcf4b-6nnpk\" (UID: \"65b64f59-1d65-4e73-878d-1a7db238d28b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cff930-6f9fcdcf4b-6nnpk"
Jul 24 20:03:40.373280 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:40.373248    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cff930-6f9fcdcf4b-6nnpk"
Jul 24 20:03:40.511427 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:40.511402    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-cff930-6f9fcdcf4b-6nnpk"]
Jul 24 20:03:40.513661 ip-10-0-131-150 kubenswrapper[2579]: W0724 20:03:40.513632    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65b64f59_1d65_4e73_878d_1a7db238d28b.slice/crio-c1eb1bc6961c6abe3b1d51f361ca56f3ad4a6df572914aefe92e06acaa37c0c0 WatchSource:0}: Error finding container c1eb1bc6961c6abe3b1d51f361ca56f3ad4a6df572914aefe92e06acaa37c0c0: Status 404 returned error can't find the container with id c1eb1bc6961c6abe3b1d51f361ca56f3ad4a6df572914aefe92e06acaa37c0c0
Jul 24 20:03:40.515002 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:40.514983    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 20:03:41.263679 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:41.263640    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cff930-6f9fcdcf4b-6nnpk" event={"ID":"65b64f59-1d65-4e73-878d-1a7db238d28b","Type":"ContainerStarted","Data":"739b5e2c8e3e21ded86979a7778e40839f068be520f812099ccaa0a90ed7bd38"}
Jul 24 20:03:41.263903 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:41.263701    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cff930-6f9fcdcf4b-6nnpk" event={"ID":"65b64f59-1d65-4e73-878d-1a7db238d28b","Type":"ContainerStarted","Data":"c1eb1bc6961c6abe3b1d51f361ca56f3ad4a6df572914aefe92e06acaa37c0c0"}
Jul 24 20:03:41.263903 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:41.263767    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cff930-6f9fcdcf4b-6nnpk"
Jul 24 20:03:41.279825 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:41.279775    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cff930-6f9fcdcf4b-6nnpk" podStartSLOduration=1.8178889329999999 podStartE2EDuration="2.279758104s" totalImagesPullingTime="461.869171ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:03:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:03:41.278417069 +0000 UTC m=+2219.467491383" watchObservedRunningTime="2026-07-24 20:03:41.279758104 +0000 UTC m=+2219.468832418"
Jul 24 20:03:46.786164 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:46.786126    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 20:03:47.279516 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:47.279486    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cff930-6f9fcdcf4b-6nnpk"
Jul 24 20:03:47.618302 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:47.618219    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e316a0-76b7f89484-cs977"]
Jul 24 20:03:47.622038 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:47.622014    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e316a0-76b7f89484-cs977"
Jul 24 20:03:47.624419 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:47.624393    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-e316a0-serving-cert\""
Jul 24 20:03:47.631259 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:47.631235    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e316a0-76b7f89484-cs977"]
Jul 24 20:03:47.750313 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:47.750271    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be4f0a7b-ca23-4dda-a086-2ebdf22d7046-openshift-service-ca\") pod \"maas-api-e2e-api-b-e316a0-76b7f89484-cs977\" (UID: \"be4f0a7b-ca23-4dda-a086-2ebdf22d7046\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e316a0-76b7f89484-cs977"
Jul 24 20:03:47.750499 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:47.750389    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be4f0a7b-ca23-4dda-a086-2ebdf22d7046-maas-api-tls\") pod \"maas-api-e2e-api-b-e316a0-76b7f89484-cs977\" (UID: \"be4f0a7b-ca23-4dda-a086-2ebdf22d7046\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e316a0-76b7f89484-cs977"
Jul 24 20:03:47.750499 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:47.750427    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv7nr\" (UniqueName: \"kubernetes.io/projected/be4f0a7b-ca23-4dda-a086-2ebdf22d7046-kube-api-access-rv7nr\") pod \"maas-api-e2e-api-b-e316a0-76b7f89484-cs977\" (UID: \"be4f0a7b-ca23-4dda-a086-2ebdf22d7046\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e316a0-76b7f89484-cs977"
Jul 24 20:03:47.851441 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:47.851403    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be4f0a7b-ca23-4dda-a086-2ebdf22d7046-openshift-service-ca\") pod \"maas-api-e2e-api-b-e316a0-76b7f89484-cs977\" (UID: \"be4f0a7b-ca23-4dda-a086-2ebdf22d7046\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e316a0-76b7f89484-cs977"
Jul 24 20:03:47.851900 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:47.851470    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be4f0a7b-ca23-4dda-a086-2ebdf22d7046-maas-api-tls\") pod \"maas-api-e2e-api-b-e316a0-76b7f89484-cs977\" (UID: \"be4f0a7b-ca23-4dda-a086-2ebdf22d7046\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e316a0-76b7f89484-cs977"
Jul 24 20:03:47.851900 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:47.851492    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rv7nr\" (UniqueName: \"kubernetes.io/projected/be4f0a7b-ca23-4dda-a086-2ebdf22d7046-kube-api-access-rv7nr\") pod \"maas-api-e2e-api-b-e316a0-76b7f89484-cs977\" (UID: \"be4f0a7b-ca23-4dda-a086-2ebdf22d7046\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e316a0-76b7f89484-cs977"
Jul 24 20:03:47.851900 ip-10-0-131-150 kubenswrapper[2579]: E0724 20:03:47.851614    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-e316a0-serving-cert: secret "maas-api-e2e-api-b-e316a0-serving-cert" not found
Jul 24 20:03:47.851900 ip-10-0-131-150 kubenswrapper[2579]: E0724 20:03:47.851687    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be4f0a7b-ca23-4dda-a086-2ebdf22d7046-maas-api-tls podName:be4f0a7b-ca23-4dda-a086-2ebdf22d7046 nodeName:}" failed. No retries permitted until 2026-07-24 20:03:48.35166934 +0000 UTC m=+2226.540743635 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/be4f0a7b-ca23-4dda-a086-2ebdf22d7046-maas-api-tls") pod "maas-api-e2e-api-b-e316a0-76b7f89484-cs977" (UID: "be4f0a7b-ca23-4dda-a086-2ebdf22d7046") : secret "maas-api-e2e-api-b-e316a0-serving-cert" not found
Jul 24 20:03:47.852107 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:47.852082    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be4f0a7b-ca23-4dda-a086-2ebdf22d7046-openshift-service-ca\") pod \"maas-api-e2e-api-b-e316a0-76b7f89484-cs977\" (UID: \"be4f0a7b-ca23-4dda-a086-2ebdf22d7046\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e316a0-76b7f89484-cs977"
Jul 24 20:03:47.864026 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:47.864001    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv7nr\" (UniqueName: \"kubernetes.io/projected/be4f0a7b-ca23-4dda-a086-2ebdf22d7046-kube-api-access-rv7nr\") pod \"maas-api-e2e-api-b-e316a0-76b7f89484-cs977\" (UID: \"be4f0a7b-ca23-4dda-a086-2ebdf22d7046\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e316a0-76b7f89484-cs977"
Jul 24 20:03:48.356657 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:48.356615    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be4f0a7b-ca23-4dda-a086-2ebdf22d7046-maas-api-tls\") pod \"maas-api-e2e-api-b-e316a0-76b7f89484-cs977\" (UID: \"be4f0a7b-ca23-4dda-a086-2ebdf22d7046\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e316a0-76b7f89484-cs977"
Jul 24 20:03:48.359331 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:48.359303    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be4f0a7b-ca23-4dda-a086-2ebdf22d7046-maas-api-tls\") pod \"maas-api-e2e-api-b-e316a0-76b7f89484-cs977\" (UID: \"be4f0a7b-ca23-4dda-a086-2ebdf22d7046\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e316a0-76b7f89484-cs977"
Jul 24 20:03:48.535637 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:48.535605    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e316a0-76b7f89484-cs977"
Jul 24 20:03:48.680617 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:48.680590    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e316a0-76b7f89484-cs977"]
Jul 24 20:03:48.682324 ip-10-0-131-150 kubenswrapper[2579]: W0724 20:03:48.682293    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe4f0a7b_ca23_4dda_a086_2ebdf22d7046.slice/crio-db7b806c05d61bed3f8c0d884519e48de82059405a418d96b8abc9d410f941b1 WatchSource:0}: Error finding container db7b806c05d61bed3f8c0d884519e48de82059405a418d96b8abc9d410f941b1: Status 404 returned error can't find the container with id db7b806c05d61bed3f8c0d884519e48de82059405a418d96b8abc9d410f941b1
Jul 24 20:03:49.309840 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:49.309738    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e316a0-76b7f89484-cs977" event={"ID":"be4f0a7b-ca23-4dda-a086-2ebdf22d7046","Type":"ContainerStarted","Data":"e6603c0507e153ab5b0e3d400f9559f706c7c59d21b218db3572c64e4fb4fd19"}
Jul 24 20:03:49.309840 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:49.309802    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e316a0-76b7f89484-cs977"
Jul 24 20:03:49.309840 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:49.309820    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e316a0-76b7f89484-cs977" event={"ID":"be4f0a7b-ca23-4dda-a086-2ebdf22d7046","Type":"ContainerStarted","Data":"db7b806c05d61bed3f8c0d884519e48de82059405a418d96b8abc9d410f941b1"}
Jul 24 20:03:49.327483 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:49.327438    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e316a0-76b7f89484-cs977" podStartSLOduration=1.981899327 podStartE2EDuration="2.327424094s" totalImagesPullingTime="345.524767ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:03:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:03:49.32482805 +0000 UTC m=+2227.513902354" watchObservedRunningTime="2026-07-24 20:03:49.327424094 +0000 UTC m=+2227.516498438"
Jul 24 20:03:55.321584 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:55.321548    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e316a0-76b7f89484-cs977"
Jul 24 20:03:59.954953 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:59.954916    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cff930-d8vsl"]
Jul 24 20:03:59.958426 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:59.958409    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cff930-d8vsl"
Jul 24 20:03:59.960590 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:59.960570    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gqw4p\""
Jul 24 20:03:59.965187 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:03:59.965158    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cff930-d8vsl"]
Jul 24 20:04:00.059164 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:00.059130    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26f79704-ca00-4663-adc8-278eb73b8c2a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-cff930-d8vsl\" (UID: \"26f79704-ca00-4663-adc8-278eb73b8c2a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cff930-d8vsl"
Jul 24 20:04:00.160166 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:00.160123    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26f79704-ca00-4663-adc8-278eb73b8c2a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-cff930-d8vsl\" (UID: \"26f79704-ca00-4663-adc8-278eb73b8c2a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cff930-d8vsl"
Jul 24 20:04:00.160797 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:00.160776    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26f79704-ca00-4663-adc8-278eb73b8c2a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-cff930-d8vsl\" (UID: \"26f79704-ca00-4663-adc8-278eb73b8c2a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cff930-d8vsl"
Jul 24 20:04:00.270871 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:00.270841    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cff930-d8vsl"
Jul 24 20:04:00.412608 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:00.412580    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cff930-d8vsl"]
Jul 24 20:04:00.414619 ip-10-0-131-150 kubenswrapper[2579]: W0724 20:04:00.414596    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26f79704_ca00_4663_adc8_278eb73b8c2a.slice/crio-af85cd73d20f9968dfd23678c23ca9c7191cbc94ddf3c4af9fed9968d8250d1f WatchSource:0}: Error finding container af85cd73d20f9968dfd23678c23ca9c7191cbc94ddf3c4af9fed9968d8250d1f: Status 404 returned error can't find the container with id af85cd73d20f9968dfd23678c23ca9c7191cbc94ddf3c4af9fed9968d8250d1f
Jul 24 20:04:01.376995 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:01.376899    2579 generic.go:356] "Generic (PLEG): container finished" podID="26f79704-ca00-4663-adc8-278eb73b8c2a" containerID="029f94def55f8ec5047b282d3ec491f692186f947e0d30887b667db4cd9b418a" exitCode=0
Jul 24 20:04:01.377380 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:01.377000    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cff930-d8vsl" event={"ID":"26f79704-ca00-4663-adc8-278eb73b8c2a","Type":"ContainerDied","Data":"029f94def55f8ec5047b282d3ec491f692186f947e0d30887b667db4cd9b418a"}
Jul 24 20:04:01.377380 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:01.377067    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cff930-d8vsl" event={"ID":"26f79704-ca00-4663-adc8-278eb73b8c2a","Type":"ContainerStarted","Data":"af85cd73d20f9968dfd23678c23ca9c7191cbc94ddf3c4af9fed9968d8250d1f"}
Jul 24 20:04:02.517063 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:02.517037    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cff930-d8vsl"
Jul 24 20:04:02.653987 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:02.653872    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 20:04:02.682551 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:02.682517    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26f79704-ca00-4663-adc8-278eb73b8c2a-maas-api-service-ca\") pod \"26f79704-ca00-4663-adc8-278eb73b8c2a\" (UID: \"26f79704-ca00-4663-adc8-278eb73b8c2a\") "
Jul 24 20:04:02.682929 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:02.682908    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26f79704-ca00-4663-adc8-278eb73b8c2a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "26f79704-ca00-4663-adc8-278eb73b8c2a" (UID: "26f79704-ca00-4663-adc8-278eb73b8c2a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:04:02.783856 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:02.783825    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26f79704-ca00-4663-adc8-278eb73b8c2a-maas-api-service-ca\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:04:03.387611 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:03.387576    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cff930-d8vsl"
Jul 24 20:04:03.387810 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:03.387610    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cff930-d8vsl" event={"ID":"26f79704-ca00-4663-adc8-278eb73b8c2a","Type":"ContainerDied","Data":"af85cd73d20f9968dfd23678c23ca9c7191cbc94ddf3c4af9fed9968d8250d1f"}
Jul 24 20:04:03.387810 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:03.387657    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="af85cd73d20f9968dfd23678c23ca9c7191cbc94ddf3c4af9fed9968d8250d1f"
Jul 24 20:04:15.615802 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:15.615770    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-cff930-6f9fcdcf4b-6nnpk"]
Jul 24 20:04:15.616338 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:15.616069    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cff930-6f9fcdcf4b-6nnpk" podUID="65b64f59-1d65-4e73-878d-1a7db238d28b" containerName="maas-api" containerID="cri-o://739b5e2c8e3e21ded86979a7778e40839f068be520f812099ccaa0a90ed7bd38" gracePeriod=30
Jul 24 20:04:15.871363 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:15.871300    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cff930-6f9fcdcf4b-6nnpk"
Jul 24 20:04:15.888342 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:15.888311    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65b64f59-1d65-4e73-878d-1a7db238d28b-maas-api-tls\") pod \"65b64f59-1d65-4e73-878d-1a7db238d28b\" (UID: \"65b64f59-1d65-4e73-878d-1a7db238d28b\") "
Jul 24 20:04:15.888537 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:15.888392    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pq7q8\" (UniqueName: \"kubernetes.io/projected/65b64f59-1d65-4e73-878d-1a7db238d28b-kube-api-access-pq7q8\") pod \"65b64f59-1d65-4e73-878d-1a7db238d28b\" (UID: \"65b64f59-1d65-4e73-878d-1a7db238d28b\") "
Jul 24 20:04:15.888537 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:15.888443    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65b64f59-1d65-4e73-878d-1a7db238d28b-openshift-service-ca\") pod \"65b64f59-1d65-4e73-878d-1a7db238d28b\" (UID: \"65b64f59-1d65-4e73-878d-1a7db238d28b\") "
Jul 24 20:04:15.889023 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:15.888982    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65b64f59-1d65-4e73-878d-1a7db238d28b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "65b64f59-1d65-4e73-878d-1a7db238d28b" (UID: "65b64f59-1d65-4e73-878d-1a7db238d28b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:04:15.891559 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:15.891525    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65b64f59-1d65-4e73-878d-1a7db238d28b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "65b64f59-1d65-4e73-878d-1a7db238d28b" (UID: "65b64f59-1d65-4e73-878d-1a7db238d28b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 20:04:15.891559 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:15.891529    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65b64f59-1d65-4e73-878d-1a7db238d28b-kube-api-access-pq7q8" (OuterVolumeSpecName: "kube-api-access-pq7q8") pod "65b64f59-1d65-4e73-878d-1a7db238d28b" (UID: "65b64f59-1d65-4e73-878d-1a7db238d28b"). InnerVolumeSpecName "kube-api-access-pq7q8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:04:15.990030 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:15.989999    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pq7q8\" (UniqueName: \"kubernetes.io/projected/65b64f59-1d65-4e73-878d-1a7db238d28b-kube-api-access-pq7q8\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:04:15.990030 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:15.990027    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65b64f59-1d65-4e73-878d-1a7db238d28b-openshift-service-ca\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:04:15.990030 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:15.990037    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65b64f59-1d65-4e73-878d-1a7db238d28b-maas-api-tls\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:04:16.460879 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:16.460846    2579 generic.go:356] "Generic (PLEG): container finished" podID="65b64f59-1d65-4e73-878d-1a7db238d28b" containerID="739b5e2c8e3e21ded86979a7778e40839f068be520f812099ccaa0a90ed7bd38" exitCode=0
Jul 24 20:04:16.461043 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:16.460889    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cff930-6f9fcdcf4b-6nnpk" event={"ID":"65b64f59-1d65-4e73-878d-1a7db238d28b","Type":"ContainerDied","Data":"739b5e2c8e3e21ded86979a7778e40839f068be520f812099ccaa0a90ed7bd38"}
Jul 24 20:04:16.461043 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:16.460893    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cff930-6f9fcdcf4b-6nnpk"
Jul 24 20:04:16.461043 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:16.460931    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cff930-6f9fcdcf4b-6nnpk" event={"ID":"65b64f59-1d65-4e73-878d-1a7db238d28b","Type":"ContainerDied","Data":"c1eb1bc6961c6abe3b1d51f361ca56f3ad4a6df572914aefe92e06acaa37c0c0"}
Jul 24 20:04:16.461043 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:16.460953    2579 scope.go:117] "RemoveContainer" containerID="739b5e2c8e3e21ded86979a7778e40839f068be520f812099ccaa0a90ed7bd38"
Jul 24 20:04:16.469934 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:16.469911    2579 scope.go:117] "RemoveContainer" containerID="739b5e2c8e3e21ded86979a7778e40839f068be520f812099ccaa0a90ed7bd38"
Jul 24 20:04:16.470190 ip-10-0-131-150 kubenswrapper[2579]: E0724 20:04:16.470174    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"739b5e2c8e3e21ded86979a7778e40839f068be520f812099ccaa0a90ed7bd38\": container with ID starting with 739b5e2c8e3e21ded86979a7778e40839f068be520f812099ccaa0a90ed7bd38 not found: ID does not exist" containerID="739b5e2c8e3e21ded86979a7778e40839f068be520f812099ccaa0a90ed7bd38"
Jul 24 20:04:16.470241 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:16.470199    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"739b5e2c8e3e21ded86979a7778e40839f068be520f812099ccaa0a90ed7bd38"} err="failed to get container status \"739b5e2c8e3e21ded86979a7778e40839f068be520f812099ccaa0a90ed7bd38\": rpc error: code = NotFound desc = could not find container \"739b5e2c8e3e21ded86979a7778e40839f068be520f812099ccaa0a90ed7bd38\": container with ID starting with 739b5e2c8e3e21ded86979a7778e40839f068be520f812099ccaa0a90ed7bd38 not found: ID does not exist"
Jul 24 20:04:16.478461 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:16.478432    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-cff930-6f9fcdcf4b-6nnpk"]
Jul 24 20:04:16.480369 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:16.480347    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-cff930-6f9fcdcf4b-6nnpk"]
Jul 24 20:04:18.278161 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:18.278126    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 20:04:18.368738 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:18.368691    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65b64f59-1d65-4e73-878d-1a7db238d28b" path="/var/lib/kubelet/pods/65b64f59-1d65-4e73-878d-1a7db238d28b/volumes"
Jul 24 20:04:20.052228 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:20.052182    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cff930-d8vsl"]
Jul 24 20:04:20.054227 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:20.054208    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cff930-d8vsl"]
Jul 24 20:04:20.367578 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:20.367496    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26f79704-ca00-4663-adc8-278eb73b8c2a" path="/var/lib/kubelet/pods/26f79704-ca00-4663-adc8-278eb73b8c2a/volumes"
Jul 24 20:04:27.114493 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:27.114456    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e316a0-cn4ck"]
Jul 24 20:04:27.114938 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:27.114807    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65b64f59-1d65-4e73-878d-1a7db238d28b" containerName="maas-api"
Jul 24 20:04:27.114938 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:27.114820    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="65b64f59-1d65-4e73-878d-1a7db238d28b" containerName="maas-api"
Jul 24 20:04:27.114938 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:27.114832    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26f79704-ca00-4663-adc8-278eb73b8c2a" containerName="revoke-keys"
Jul 24 20:04:27.114938 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:27.114837    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="26f79704-ca00-4663-adc8-278eb73b8c2a" containerName="revoke-keys"
Jul 24 20:04:27.114938 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:27.114887    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="65b64f59-1d65-4e73-878d-1a7db238d28b" containerName="maas-api"
Jul 24 20:04:27.114938 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:27.114895    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="26f79704-ca00-4663-adc8-278eb73b8c2a" containerName="revoke-keys"
Jul 24 20:04:27.118874 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:27.118856    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e316a0-cn4ck"
Jul 24 20:04:27.121136 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:27.121107    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gqw4p\""
Jul 24 20:04:27.125786 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:27.125758    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e316a0-cn4ck"]
Jul 24 20:04:27.184572 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:27.184532    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e322538d-7aa2-4a8a-8725-cc6d6d8e7b0e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-e316a0-cn4ck\" (UID: \"e322538d-7aa2-4a8a-8725-cc6d6d8e7b0e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e316a0-cn4ck"
Jul 24 20:04:27.285937 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:27.285902    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e322538d-7aa2-4a8a-8725-cc6d6d8e7b0e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-e316a0-cn4ck\" (UID: \"e322538d-7aa2-4a8a-8725-cc6d6d8e7b0e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e316a0-cn4ck"
Jul 24 20:04:27.286538 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:27.286516    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e322538d-7aa2-4a8a-8725-cc6d6d8e7b0e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-e316a0-cn4ck\" (UID: \"e322538d-7aa2-4a8a-8725-cc6d6d8e7b0e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e316a0-cn4ck"
Jul 24 20:04:27.430356 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:27.430250    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e316a0-cn4ck"
Jul 24 20:04:27.569753 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:27.569692    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e316a0-cn4ck"]
Jul 24 20:04:27.571831 ip-10-0-131-150 kubenswrapper[2579]: W0724 20:04:27.571805    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode322538d_7aa2_4a8a_8725_cc6d6d8e7b0e.slice/crio-0e745d8d403f4a041b6fdafc50161a4f7d544297407f5e6b37fc832d653a1ef7 WatchSource:0}: Error finding container 0e745d8d403f4a041b6fdafc50161a4f7d544297407f5e6b37fc832d653a1ef7: Status 404 returned error can't find the container with id 0e745d8d403f4a041b6fdafc50161a4f7d544297407f5e6b37fc832d653a1ef7
Jul 24 20:04:28.533986 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:28.533953    2579 generic.go:356] "Generic (PLEG): container finished" podID="e322538d-7aa2-4a8a-8725-cc6d6d8e7b0e" containerID="fd8690973e2a5dead48bb8ea70ef325ebfd68755097b3ad840afe2240432aeeb" exitCode=0
Jul 24 20:04:28.534439 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:28.534047    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e316a0-cn4ck" event={"ID":"e322538d-7aa2-4a8a-8725-cc6d6d8e7b0e","Type":"ContainerDied","Data":"fd8690973e2a5dead48bb8ea70ef325ebfd68755097b3ad840afe2240432aeeb"}
Jul 24 20:04:28.534439 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:28.534097    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e316a0-cn4ck" event={"ID":"e322538d-7aa2-4a8a-8725-cc6d6d8e7b0e","Type":"ContainerStarted","Data":"0e745d8d403f4a041b6fdafc50161a4f7d544297407f5e6b37fc832d653a1ef7"}
Jul 24 20:04:29.667373 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:29.667348    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e316a0-cn4ck"
Jul 24 20:04:29.709069 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:29.709031    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e322538d-7aa2-4a8a-8725-cc6d6d8e7b0e-maas-api-service-ca\") pod \"e322538d-7aa2-4a8a-8725-cc6d6d8e7b0e\" (UID: \"e322538d-7aa2-4a8a-8725-cc6d6d8e7b0e\") "
Jul 24 20:04:29.709419 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:29.709396    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e322538d-7aa2-4a8a-8725-cc6d6d8e7b0e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e322538d-7aa2-4a8a-8725-cc6d6d8e7b0e" (UID: "e322538d-7aa2-4a8a-8725-cc6d6d8e7b0e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:04:29.810616 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:29.810534    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e322538d-7aa2-4a8a-8725-cc6d6d8e7b0e-maas-api-service-ca\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:04:30.548294 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:30.548248    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e316a0-cn4ck" event={"ID":"e322538d-7aa2-4a8a-8725-cc6d6d8e7b0e","Type":"ContainerDied","Data":"0e745d8d403f4a041b6fdafc50161a4f7d544297407f5e6b37fc832d653a1ef7"}
Jul 24 20:04:30.548496 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:30.548361    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0e745d8d403f4a041b6fdafc50161a4f7d544297407f5e6b37fc832d653a1ef7"
Jul 24 20:04:30.548496 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:30.548439    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e316a0-cn4ck"
Jul 24 20:04:42.541834 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:42.541795    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e316a0-76b7f89484-cs977"]
Jul 24 20:04:42.542321 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:42.542048    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e316a0-76b7f89484-cs977" podUID="be4f0a7b-ca23-4dda-a086-2ebdf22d7046" containerName="maas-api" containerID="cri-o://e6603c0507e153ab5b0e3d400f9559f706c7c59d21b218db3572c64e4fb4fd19" gracePeriod=30
Jul 24 20:04:42.571449 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:42.571424    2579 scope.go:117] "RemoveContainer" containerID="c7b0e43a3c4ac6ecfdf09029cfa9eb58822d3132d59b90cee6f56b43fef7e68a"
Jul 24 20:04:42.794579 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:42.794513    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e316a0-76b7f89484-cs977"
Jul 24 20:04:42.929557 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:42.929531    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be4f0a7b-ca23-4dda-a086-2ebdf22d7046-maas-api-tls\") pod \"be4f0a7b-ca23-4dda-a086-2ebdf22d7046\" (UID: \"be4f0a7b-ca23-4dda-a086-2ebdf22d7046\") "
Jul 24 20:04:42.929714 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:42.929627    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rv7nr\" (UniqueName: \"kubernetes.io/projected/be4f0a7b-ca23-4dda-a086-2ebdf22d7046-kube-api-access-rv7nr\") pod \"be4f0a7b-ca23-4dda-a086-2ebdf22d7046\" (UID: \"be4f0a7b-ca23-4dda-a086-2ebdf22d7046\") "
Jul 24 20:04:42.929714 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:42.929662    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be4f0a7b-ca23-4dda-a086-2ebdf22d7046-openshift-service-ca\") pod \"be4f0a7b-ca23-4dda-a086-2ebdf22d7046\" (UID: \"be4f0a7b-ca23-4dda-a086-2ebdf22d7046\") "
Jul 24 20:04:42.930059 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:42.930036    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be4f0a7b-ca23-4dda-a086-2ebdf22d7046-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "be4f0a7b-ca23-4dda-a086-2ebdf22d7046" (UID: "be4f0a7b-ca23-4dda-a086-2ebdf22d7046"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:04:42.931836 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:42.931809    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be4f0a7b-ca23-4dda-a086-2ebdf22d7046-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "be4f0a7b-ca23-4dda-a086-2ebdf22d7046" (UID: "be4f0a7b-ca23-4dda-a086-2ebdf22d7046"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 20:04:42.931936 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:42.931872    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be4f0a7b-ca23-4dda-a086-2ebdf22d7046-kube-api-access-rv7nr" (OuterVolumeSpecName: "kube-api-access-rv7nr") pod "be4f0a7b-ca23-4dda-a086-2ebdf22d7046" (UID: "be4f0a7b-ca23-4dda-a086-2ebdf22d7046"). InnerVolumeSpecName "kube-api-access-rv7nr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:04:43.031043 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:43.031005    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be4f0a7b-ca23-4dda-a086-2ebdf22d7046-maas-api-tls\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:04:43.031043 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:43.031038    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rv7nr\" (UniqueName: \"kubernetes.io/projected/be4f0a7b-ca23-4dda-a086-2ebdf22d7046-kube-api-access-rv7nr\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:04:43.031043 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:43.031047    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be4f0a7b-ca23-4dda-a086-2ebdf22d7046-openshift-service-ca\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:04:43.618601 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:43.618568    2579 generic.go:356] "Generic (PLEG): container finished" podID="be4f0a7b-ca23-4dda-a086-2ebdf22d7046" containerID="e6603c0507e153ab5b0e3d400f9559f706c7c59d21b218db3572c64e4fb4fd19" exitCode=0
Jul 24 20:04:43.619044 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:43.618615    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e316a0-76b7f89484-cs977"
Jul 24 20:04:43.619044 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:43.618649    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e316a0-76b7f89484-cs977" event={"ID":"be4f0a7b-ca23-4dda-a086-2ebdf22d7046","Type":"ContainerDied","Data":"e6603c0507e153ab5b0e3d400f9559f706c7c59d21b218db3572c64e4fb4fd19"}
Jul 24 20:04:43.619044 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:43.618703    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e316a0-76b7f89484-cs977" event={"ID":"be4f0a7b-ca23-4dda-a086-2ebdf22d7046","Type":"ContainerDied","Data":"db7b806c05d61bed3f8c0d884519e48de82059405a418d96b8abc9d410f941b1"}
Jul 24 20:04:43.619044 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:43.618743    2579 scope.go:117] "RemoveContainer" containerID="e6603c0507e153ab5b0e3d400f9559f706c7c59d21b218db3572c64e4fb4fd19"
Jul 24 20:04:43.627893 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:43.627874    2579 scope.go:117] "RemoveContainer" containerID="e6603c0507e153ab5b0e3d400f9559f706c7c59d21b218db3572c64e4fb4fd19"
Jul 24 20:04:43.628149 ip-10-0-131-150 kubenswrapper[2579]: E0724 20:04:43.628126    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6603c0507e153ab5b0e3d400f9559f706c7c59d21b218db3572c64e4fb4fd19\": container with ID starting with e6603c0507e153ab5b0e3d400f9559f706c7c59d21b218db3572c64e4fb4fd19 not found: ID does not exist" containerID="e6603c0507e153ab5b0e3d400f9559f706c7c59d21b218db3572c64e4fb4fd19"
Jul 24 20:04:43.628202 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:43.628155    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6603c0507e153ab5b0e3d400f9559f706c7c59d21b218db3572c64e4fb4fd19"} err="failed to get container status \"e6603c0507e153ab5b0e3d400f9559f706c7c59d21b218db3572c64e4fb4fd19\": rpc error: code = NotFound desc = could not find container \"e6603c0507e153ab5b0e3d400f9559f706c7c59d21b218db3572c64e4fb4fd19\": container with ID starting with e6603c0507e153ab5b0e3d400f9559f706c7c59d21b218db3572c64e4fb4fd19 not found: ID does not exist"
Jul 24 20:04:43.639804 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:43.639772    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e316a0-76b7f89484-cs977"]
Jul 24 20:04:43.643969 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:43.643947    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e316a0-76b7f89484-cs977"]
Jul 24 20:04:44.371776 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:44.371718    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be4f0a7b-ca23-4dda-a086-2ebdf22d7046" path="/var/lib/kubelet/pods/be4f0a7b-ca23-4dda-a086-2ebdf22d7046/volumes"
Jul 24 20:04:47.201895 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:47.201847    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e316a0-cn4ck"]
Jul 24 20:04:47.204261 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:47.204240    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e316a0-cn4ck"]
Jul 24 20:04:47.688971 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:47.688938    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 20:04:48.367401 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:48.367367    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e322538d-7aa2-4a8a-8725-cc6d6d8e7b0e" path="/var/lib/kubelet/pods/e322538d-7aa2-4a8a-8725-cc6d6d8e7b0e/volumes"
Jul 24 20:04:57.864437 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:57.864397    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-8abb86-6c78cc5d99-f6bqn"]
Jul 24 20:04:57.864970 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:57.864878    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e322538d-7aa2-4a8a-8725-cc6d6d8e7b0e" containerName="revoke-keys"
Jul 24 20:04:57.864970 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:57.864895    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e322538d-7aa2-4a8a-8725-cc6d6d8e7b0e" containerName="revoke-keys"
Jul 24 20:04:57.864970 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:57.864930    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be4f0a7b-ca23-4dda-a086-2ebdf22d7046" containerName="maas-api"
Jul 24 20:04:57.864970 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:57.864940    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="be4f0a7b-ca23-4dda-a086-2ebdf22d7046" containerName="maas-api"
Jul 24 20:04:57.865181 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:57.865010    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="be4f0a7b-ca23-4dda-a086-2ebdf22d7046" containerName="maas-api"
Jul 24 20:04:57.865181 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:57.865021    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e322538d-7aa2-4a8a-8725-cc6d6d8e7b0e" containerName="revoke-keys"
Jul 24 20:04:57.868017 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:57.868003    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8abb86-6c78cc5d99-f6bqn"
Jul 24 20:04:57.871181 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:57.871151    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 24 20:04:57.871181 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:57.871167    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-8abb86-serving-cert\""
Jul 24 20:04:57.871361 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:57.871258    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-z5t42\""
Jul 24 20:04:57.872152 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:57.872132    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 20:04:57.880832 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:57.880805    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-8abb86-6c78cc5d99-f6bqn"]
Jul 24 20:04:57.966674 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:57.966640    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1579e386-ae0f-4587-ae13-b73e5e0bbdd7-maas-api-tls\") pod \"maas-api-e2e-shared-a-8abb86-6c78cc5d99-f6bqn\" (UID: \"1579e386-ae0f-4587-ae13-b73e5e0bbdd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8abb86-6c78cc5d99-f6bqn"
Jul 24 20:04:57.966887 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:57.966685    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm252\" (UniqueName: \"kubernetes.io/projected/1579e386-ae0f-4587-ae13-b73e5e0bbdd7-kube-api-access-cm252\") pod \"maas-api-e2e-shared-a-8abb86-6c78cc5d99-f6bqn\" (UID: \"1579e386-ae0f-4587-ae13-b73e5e0bbdd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8abb86-6c78cc5d99-f6bqn"
Jul 24 20:04:57.966887 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:57.966705    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1579e386-ae0f-4587-ae13-b73e5e0bbdd7-openshift-service-ca\") pod \"maas-api-e2e-shared-a-8abb86-6c78cc5d99-f6bqn\" (UID: \"1579e386-ae0f-4587-ae13-b73e5e0bbdd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8abb86-6c78cc5d99-f6bqn"
Jul 24 20:04:58.068101 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:58.068063    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1579e386-ae0f-4587-ae13-b73e5e0bbdd7-maas-api-tls\") pod \"maas-api-e2e-shared-a-8abb86-6c78cc5d99-f6bqn\" (UID: \"1579e386-ae0f-4587-ae13-b73e5e0bbdd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8abb86-6c78cc5d99-f6bqn"
Jul 24 20:04:58.068276 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:58.068109    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm252\" (UniqueName: \"kubernetes.io/projected/1579e386-ae0f-4587-ae13-b73e5e0bbdd7-kube-api-access-cm252\") pod \"maas-api-e2e-shared-a-8abb86-6c78cc5d99-f6bqn\" (UID: \"1579e386-ae0f-4587-ae13-b73e5e0bbdd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8abb86-6c78cc5d99-f6bqn"
Jul 24 20:04:58.068276 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:58.068136    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1579e386-ae0f-4587-ae13-b73e5e0bbdd7-openshift-service-ca\") pod \"maas-api-e2e-shared-a-8abb86-6c78cc5d99-f6bqn\" (UID: \"1579e386-ae0f-4587-ae13-b73e5e0bbdd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8abb86-6c78cc5d99-f6bqn"
Jul 24 20:04:58.068276 ip-10-0-131-150 kubenswrapper[2579]: E0724 20:04:58.068227    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-8abb86-serving-cert: secret "maas-api-e2e-shared-a-8abb86-serving-cert" not found
Jul 24 20:04:58.068384 ip-10-0-131-150 kubenswrapper[2579]: E0724 20:04:58.068299    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1579e386-ae0f-4587-ae13-b73e5e0bbdd7-maas-api-tls podName:1579e386-ae0f-4587-ae13-b73e5e0bbdd7 nodeName:}" failed. No retries permitted until 2026-07-24 20:04:58.568277009 +0000 UTC m=+2296.757351304 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1579e386-ae0f-4587-ae13-b73e5e0bbdd7-maas-api-tls") pod "maas-api-e2e-shared-a-8abb86-6c78cc5d99-f6bqn" (UID: "1579e386-ae0f-4587-ae13-b73e5e0bbdd7") : secret "maas-api-e2e-shared-a-8abb86-serving-cert" not found
Jul 24 20:04:58.068833 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:58.068815    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1579e386-ae0f-4587-ae13-b73e5e0bbdd7-openshift-service-ca\") pod \"maas-api-e2e-shared-a-8abb86-6c78cc5d99-f6bqn\" (UID: \"1579e386-ae0f-4587-ae13-b73e5e0bbdd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8abb86-6c78cc5d99-f6bqn"
Jul 24 20:04:58.077797 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:58.077774    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm252\" (UniqueName: \"kubernetes.io/projected/1579e386-ae0f-4587-ae13-b73e5e0bbdd7-kube-api-access-cm252\") pod \"maas-api-e2e-shared-a-8abb86-6c78cc5d99-f6bqn\" (UID: \"1579e386-ae0f-4587-ae13-b73e5e0bbdd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8abb86-6c78cc5d99-f6bqn"
Jul 24 20:04:58.572558 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:58.572523    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1579e386-ae0f-4587-ae13-b73e5e0bbdd7-maas-api-tls\") pod \"maas-api-e2e-shared-a-8abb86-6c78cc5d99-f6bqn\" (UID: \"1579e386-ae0f-4587-ae13-b73e5e0bbdd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8abb86-6c78cc5d99-f6bqn"
Jul 24 20:04:58.575090 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:58.575061    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1579e386-ae0f-4587-ae13-b73e5e0bbdd7-maas-api-tls\") pod \"maas-api-e2e-shared-a-8abb86-6c78cc5d99-f6bqn\" (UID: \"1579e386-ae0f-4587-ae13-b73e5e0bbdd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8abb86-6c78cc5d99-f6bqn"
Jul 24 20:04:58.779319 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:58.779287    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8abb86-6c78cc5d99-f6bqn"
Jul 24 20:04:58.912169 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:58.912139    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-8abb86-6c78cc5d99-f6bqn"]
Jul 24 20:04:58.913545 ip-10-0-131-150 kubenswrapper[2579]: W0724 20:04:58.913514    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1579e386_ae0f_4587_ae13_b73e5e0bbdd7.slice/crio-c5dacf85affedbe1815b55ca066188ecf0f87bd1656e99334dde1d24e1b92301 WatchSource:0}: Error finding container c5dacf85affedbe1815b55ca066188ecf0f87bd1656e99334dde1d24e1b92301: Status 404 returned error can't find the container with id c5dacf85affedbe1815b55ca066188ecf0f87bd1656e99334dde1d24e1b92301
Jul 24 20:04:59.703255 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:59.703218    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8abb86-6c78cc5d99-f6bqn" event={"ID":"1579e386-ae0f-4587-ae13-b73e5e0bbdd7","Type":"ContainerStarted","Data":"07d33cb247ff5836cb32cae79eaa6dcb13d746546bec62aac7d6936e7c0f2774"}
Jul 24 20:04:59.703418 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:59.703275    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8abb86-6c78cc5d99-f6bqn" event={"ID":"1579e386-ae0f-4587-ae13-b73e5e0bbdd7","Type":"ContainerStarted","Data":"c5dacf85affedbe1815b55ca066188ecf0f87bd1656e99334dde1d24e1b92301"}
Jul 24 20:04:59.703418 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:59.703345    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8abb86-6c78cc5d99-f6bqn"
Jul 24 20:04:59.720137 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:04:59.720042    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8abb86-6c78cc5d99-f6bqn" podStartSLOduration=2.169929305 podStartE2EDuration="2.720027279s" totalImagesPullingTime="550.097974ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:04:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:04:59.717843242 +0000 UTC m=+2297.906917555" watchObservedRunningTime="2026-07-24 20:04:59.720027279 +0000 UTC m=+2297.909101610"
Jul 24 20:05:02.787177 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:02.787144    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 20:05:05.714129 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:05.714097    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8abb86-6c78cc5d99-f6bqn"
Jul 24 20:05:06.817801 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:06.817769    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-3e15b4-cccb98ffc-2lc4v"]
Jul 24 20:05:06.821566 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:06.821547    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3e15b4-cccb98ffc-2lc4v"
Jul 24 20:05:06.824027 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:06.824000    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-3e15b4-serving-cert\""
Jul 24 20:05:06.832845 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:06.832816    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-3e15b4-cccb98ffc-2lc4v"]
Jul 24 20:05:06.845048 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:06.845024    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb0e69f5-ba51-4ed3-8d60-572b157f7bc0-openshift-service-ca\") pod \"maas-api-e2e-shared-b-3e15b4-cccb98ffc-2lc4v\" (UID: \"bb0e69f5-ba51-4ed3-8d60-572b157f7bc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3e15b4-cccb98ffc-2lc4v"
Jul 24 20:05:06.845209 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:06.845062    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb0e69f5-ba51-4ed3-8d60-572b157f7bc0-maas-api-tls\") pod \"maas-api-e2e-shared-b-3e15b4-cccb98ffc-2lc4v\" (UID: \"bb0e69f5-ba51-4ed3-8d60-572b157f7bc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3e15b4-cccb98ffc-2lc4v"
Jul 24 20:05:06.845209 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:06.845170    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpfgl\" (UniqueName: \"kubernetes.io/projected/bb0e69f5-ba51-4ed3-8d60-572b157f7bc0-kube-api-access-hpfgl\") pod \"maas-api-e2e-shared-b-3e15b4-cccb98ffc-2lc4v\" (UID: \"bb0e69f5-ba51-4ed3-8d60-572b157f7bc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3e15b4-cccb98ffc-2lc4v"
Jul 24 20:05:06.946287 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:06.946253    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpfgl\" (UniqueName: \"kubernetes.io/projected/bb0e69f5-ba51-4ed3-8d60-572b157f7bc0-kube-api-access-hpfgl\") pod \"maas-api-e2e-shared-b-3e15b4-cccb98ffc-2lc4v\" (UID: \"bb0e69f5-ba51-4ed3-8d60-572b157f7bc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3e15b4-cccb98ffc-2lc4v"
Jul 24 20:05:06.946287 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:06.946301    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb0e69f5-ba51-4ed3-8d60-572b157f7bc0-openshift-service-ca\") pod \"maas-api-e2e-shared-b-3e15b4-cccb98ffc-2lc4v\" (UID: \"bb0e69f5-ba51-4ed3-8d60-572b157f7bc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3e15b4-cccb98ffc-2lc4v"
Jul 24 20:05:06.946560 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:06.946343    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb0e69f5-ba51-4ed3-8d60-572b157f7bc0-maas-api-tls\") pod \"maas-api-e2e-shared-b-3e15b4-cccb98ffc-2lc4v\" (UID: \"bb0e69f5-ba51-4ed3-8d60-572b157f7bc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3e15b4-cccb98ffc-2lc4v"
Jul 24 20:05:06.946560 ip-10-0-131-150 kubenswrapper[2579]: E0724 20:05:06.946482    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-3e15b4-serving-cert: secret "maas-api-e2e-shared-b-3e15b4-serving-cert" not found
Jul 24 20:05:06.946679 ip-10-0-131-150 kubenswrapper[2579]: E0724 20:05:06.946562    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb0e69f5-ba51-4ed3-8d60-572b157f7bc0-maas-api-tls podName:bb0e69f5-ba51-4ed3-8d60-572b157f7bc0 nodeName:}" failed. No retries permitted until 2026-07-24 20:05:07.446540456 +0000 UTC m=+2305.635614768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bb0e69f5-ba51-4ed3-8d60-572b157f7bc0-maas-api-tls") pod "maas-api-e2e-shared-b-3e15b4-cccb98ffc-2lc4v" (UID: "bb0e69f5-ba51-4ed3-8d60-572b157f7bc0") : secret "maas-api-e2e-shared-b-3e15b4-serving-cert" not found
Jul 24 20:05:06.947039 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:06.947017    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb0e69f5-ba51-4ed3-8d60-572b157f7bc0-openshift-service-ca\") pod \"maas-api-e2e-shared-b-3e15b4-cccb98ffc-2lc4v\" (UID: \"bb0e69f5-ba51-4ed3-8d60-572b157f7bc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3e15b4-cccb98ffc-2lc4v"
Jul 24 20:05:06.954866 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:06.954843    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpfgl\" (UniqueName: \"kubernetes.io/projected/bb0e69f5-ba51-4ed3-8d60-572b157f7bc0-kube-api-access-hpfgl\") pod \"maas-api-e2e-shared-b-3e15b4-cccb98ffc-2lc4v\" (UID: \"bb0e69f5-ba51-4ed3-8d60-572b157f7bc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3e15b4-cccb98ffc-2lc4v"
Jul 24 20:05:07.451392 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:07.451354    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb0e69f5-ba51-4ed3-8d60-572b157f7bc0-maas-api-tls\") pod \"maas-api-e2e-shared-b-3e15b4-cccb98ffc-2lc4v\" (UID: \"bb0e69f5-ba51-4ed3-8d60-572b157f7bc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3e15b4-cccb98ffc-2lc4v"
Jul 24 20:05:07.453985 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:07.453953    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb0e69f5-ba51-4ed3-8d60-572b157f7bc0-maas-api-tls\") pod \"maas-api-e2e-shared-b-3e15b4-cccb98ffc-2lc4v\" (UID: \"bb0e69f5-ba51-4ed3-8d60-572b157f7bc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3e15b4-cccb98ffc-2lc4v"
Jul 24 20:05:07.734568 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:07.734484    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3e15b4-cccb98ffc-2lc4v"
Jul 24 20:05:07.878590 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:07.878562    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-3e15b4-cccb98ffc-2lc4v"]
Jul 24 20:05:07.880140 ip-10-0-131-150 kubenswrapper[2579]: W0724 20:05:07.880109    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb0e69f5_ba51_4ed3_8d60_572b157f7bc0.slice/crio-51b422490764161c98a3534d0e38cc46fdb81e59b403ef54f2ffc34e5fabaf57 WatchSource:0}: Error finding container 51b422490764161c98a3534d0e38cc46fdb81e59b403ef54f2ffc34e5fabaf57: Status 404 returned error can't find the container with id 51b422490764161c98a3534d0e38cc46fdb81e59b403ef54f2ffc34e5fabaf57
Jul 24 20:05:08.752032 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:08.752000    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3e15b4-cccb98ffc-2lc4v" event={"ID":"bb0e69f5-ba51-4ed3-8d60-572b157f7bc0","Type":"ContainerStarted","Data":"9765627aa419b42fd9cc1311d5d524ee281c793ffea5cb7772a7a94e33359046"}
Jul 24 20:05:08.752188 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:08.752069    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3e15b4-cccb98ffc-2lc4v"
Jul 24 20:05:08.752188 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:08.752092    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3e15b4-cccb98ffc-2lc4v" event={"ID":"bb0e69f5-ba51-4ed3-8d60-572b157f7bc0","Type":"ContainerStarted","Data":"51b422490764161c98a3534d0e38cc46fdb81e59b403ef54f2ffc34e5fabaf57"}
Jul 24 20:05:08.769611 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:08.769565    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3e15b4-cccb98ffc-2lc4v" podStartSLOduration=2.290283513 podStartE2EDuration="2.769551783s" totalImagesPullingTime="479.26827ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:05:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:05:08.768851971 +0000 UTC m=+2306.957926284" watchObservedRunningTime="2026-07-24 20:05:08.769551783 +0000 UTC m=+2306.958626096"
Jul 24 20:05:14.761907 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:14.761874    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3e15b4-cccb98ffc-2lc4v"
Jul 24 20:05:15.292620 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:15.292586    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 20:05:31.895696 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:31.895662    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-8abb86/auth-test-model-8abb86-kserve-7b9b4654d7-88nqg"]
Jul 24 20:05:31.898953 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:31.898938    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8abb86/auth-test-model-8abb86-kserve-7b9b4654d7-88nqg"
Jul 24 20:05:31.901270 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:31.901250    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-8abb86\"/\"kube-root-ca.crt\""
Jul 24 20:05:31.902211 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:31.902191    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8abb86\"/\"default-dockercfg-bg7jr\""
Jul 24 20:05:31.902211 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:31.902204    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-8abb86\"/\"openshift-service-ca.crt\""
Jul 24 20:05:31.902357 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:31.902199    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8abb86\"/\"auth-test-model-8abb86-kserve-self-signed-certs\""
Jul 24 20:05:31.909084 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:31.909063    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8abb86/auth-test-model-8abb86-kserve-7b9b4654d7-88nqg"]
Jul 24 20:05:31.963989 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:31.963960    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ab1b619-1bf3-429b-a889-5e5364b2d80e-tls-certs\") pod \"auth-test-model-8abb86-kserve-7b9b4654d7-88nqg\" (UID: \"4ab1b619-1bf3-429b-a889-5e5364b2d80e\") " pod="ai-tenant-e2e-shared-a-8abb86/auth-test-model-8abb86-kserve-7b9b4654d7-88nqg"
Jul 24 20:05:31.964165 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:31.964028    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksl2x\" (UniqueName: \"kubernetes.io/projected/4ab1b619-1bf3-429b-a889-5e5364b2d80e-kube-api-access-ksl2x\") pod \"auth-test-model-8abb86-kserve-7b9b4654d7-88nqg\" (UID: \"4ab1b619-1bf3-429b-a889-5e5364b2d80e\") " pod="ai-tenant-e2e-shared-a-8abb86/auth-test-model-8abb86-kserve-7b9b4654d7-88nqg"
Jul 24 20:05:31.964165 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:31.964063    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ab1b619-1bf3-429b-a889-5e5364b2d80e-model-cache\") pod \"auth-test-model-8abb86-kserve-7b9b4654d7-88nqg\" (UID: \"4ab1b619-1bf3-429b-a889-5e5364b2d80e\") " pod="ai-tenant-e2e-shared-a-8abb86/auth-test-model-8abb86-kserve-7b9b4654d7-88nqg"
Jul 24 20:05:31.964292 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:31.964172    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ab1b619-1bf3-429b-a889-5e5364b2d80e-dshm\") pod \"auth-test-model-8abb86-kserve-7b9b4654d7-88nqg\" (UID: \"4ab1b619-1bf3-429b-a889-5e5364b2d80e\") " pod="ai-tenant-e2e-shared-a-8abb86/auth-test-model-8abb86-kserve-7b9b4654d7-88nqg"
Jul 24 20:05:31.964292 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:31.964216    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ab1b619-1bf3-429b-a889-5e5364b2d80e-home\") pod \"auth-test-model-8abb86-kserve-7b9b4654d7-88nqg\" (UID: \"4ab1b619-1bf3-429b-a889-5e5364b2d80e\") " pod="ai-tenant-e2e-shared-a-8abb86/auth-test-model-8abb86-kserve-7b9b4654d7-88nqg"
Jul 24 20:05:31.964292 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:31.964249    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ab1b619-1bf3-429b-a889-5e5364b2d80e-tmp-dir\") pod \"auth-test-model-8abb86-kserve-7b9b4654d7-88nqg\" (UID: \"4ab1b619-1bf3-429b-a889-5e5364b2d80e\") " pod="ai-tenant-e2e-shared-a-8abb86/auth-test-model-8abb86-kserve-7b9b4654d7-88nqg"
Jul 24 20:05:32.065290 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:32.065251    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ab1b619-1bf3-429b-a889-5e5364b2d80e-model-cache\") pod \"auth-test-model-8abb86-kserve-7b9b4654d7-88nqg\" (UID: \"4ab1b619-1bf3-429b-a889-5e5364b2d80e\") " pod="ai-tenant-e2e-shared-a-8abb86/auth-test-model-8abb86-kserve-7b9b4654d7-88nqg"
Jul 24 20:05:32.065493 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:32.065313    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ab1b619-1bf3-429b-a889-5e5364b2d80e-dshm\") pod \"auth-test-model-8abb86-kserve-7b9b4654d7-88nqg\" (UID: \"4ab1b619-1bf3-429b-a889-5e5364b2d80e\") " pod="ai-tenant-e2e-shared-a-8abb86/auth-test-model-8abb86-kserve-7b9b4654d7-88nqg"
Jul 24 20:05:32.065493 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:32.065330    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ab1b619-1bf3-429b-a889-5e5364b2d80e-home\") pod \"auth-test-model-8abb86-kserve-7b9b4654d7-88nqg\" (UID: \"4ab1b619-1bf3-429b-a889-5e5364b2d80e\") " pod="ai-tenant-e2e-shared-a-8abb86/auth-test-model-8abb86-kserve-7b9b4654d7-88nqg"
Jul 24 20:05:32.065493 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:32.065347    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ab1b619-1bf3-429b-a889-5e5364b2d80e-tmp-dir\") pod \"auth-test-model-8abb86-kserve-7b9b4654d7-88nqg\" (UID: \"4ab1b619-1bf3-429b-a889-5e5364b2d80e\") " pod="ai-tenant-e2e-shared-a-8abb86/auth-test-model-8abb86-kserve-7b9b4654d7-88nqg"
Jul 24 20:05:32.065493 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:32.065368    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ab1b619-1bf3-429b-a889-5e5364b2d80e-tls-certs\") pod \"auth-test-model-8abb86-kserve-7b9b4654d7-88nqg\" (UID: \"4ab1b619-1bf3-429b-a889-5e5364b2d80e\") " pod="ai-tenant-e2e-shared-a-8abb86/auth-test-model-8abb86-kserve-7b9b4654d7-88nqg"
Jul 24 20:05:32.065493 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:32.065407    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksl2x\" (UniqueName: \"kubernetes.io/projected/4ab1b619-1bf3-429b-a889-5e5364b2d80e-kube-api-access-ksl2x\") pod \"auth-test-model-8abb86-kserve-7b9b4654d7-88nqg\" (UID: \"4ab1b619-1bf3-429b-a889-5e5364b2d80e\") " pod="ai-tenant-e2e-shared-a-8abb86/auth-test-model-8abb86-kserve-7b9b4654d7-88nqg"
Jul 24 20:05:32.065817 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:32.065763    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ab1b619-1bf3-429b-a889-5e5364b2d80e-model-cache\") pod \"auth-test-model-8abb86-kserve-7b9b4654d7-88nqg\" (UID: \"4ab1b619-1bf3-429b-a889-5e5364b2d80e\") " pod="ai-tenant-e2e-shared-a-8abb86/auth-test-model-8abb86-kserve-7b9b4654d7-88nqg"
Jul 24 20:05:32.065817 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:32.065773    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ab1b619-1bf3-429b-a889-5e5364b2d80e-home\") pod \"auth-test-model-8abb86-kserve-7b9b4654d7-88nqg\" (UID: \"4ab1b619-1bf3-429b-a889-5e5364b2d80e\") " pod="ai-tenant-e2e-shared-a-8abb86/auth-test-model-8abb86-kserve-7b9b4654d7-88nqg"
Jul 24 20:05:32.065914 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:32.065836    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ab1b619-1bf3-429b-a889-5e5364b2d80e-tmp-dir\") pod \"auth-test-model-8abb86-kserve-7b9b4654d7-88nqg\" (UID: \"4ab1b619-1bf3-429b-a889-5e5364b2d80e\") " pod="ai-tenant-e2e-shared-a-8abb86/auth-test-model-8abb86-kserve-7b9b4654d7-88nqg"
Jul 24 20:05:32.067908 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:32.067881    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ab1b619-1bf3-429b-a889-5e5364b2d80e-dshm\") pod \"auth-test-model-8abb86-kserve-7b9b4654d7-88nqg\" (UID: \"4ab1b619-1bf3-429b-a889-5e5364b2d80e\") " pod="ai-tenant-e2e-shared-a-8abb86/auth-test-model-8abb86-kserve-7b9b4654d7-88nqg"
Jul 24 20:05:32.068118 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:32.068100    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ab1b619-1bf3-429b-a889-5e5364b2d80e-tls-certs\") pod \"auth-test-model-8abb86-kserve-7b9b4654d7-88nqg\" (UID: \"4ab1b619-1bf3-429b-a889-5e5364b2d80e\") " pod="ai-tenant-e2e-shared-a-8abb86/auth-test-model-8abb86-kserve-7b9b4654d7-88nqg"
Jul 24 20:05:32.073367 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:32.073347    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksl2x\" (UniqueName: \"kubernetes.io/projected/4ab1b619-1bf3-429b-a889-5e5364b2d80e-kube-api-access-ksl2x\") pod \"auth-test-model-8abb86-kserve-7b9b4654d7-88nqg\" (UID: \"4ab1b619-1bf3-429b-a889-5e5364b2d80e\") " pod="ai-tenant-e2e-shared-a-8abb86/auth-test-model-8abb86-kserve-7b9b4654d7-88nqg"
Jul 24 20:05:32.209977 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:32.209885    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8abb86/auth-test-model-8abb86-kserve-7b9b4654d7-88nqg"
Jul 24 20:05:32.372967 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:32.372941    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8abb86/auth-test-model-8abb86-kserve-7b9b4654d7-88nqg"]
Jul 24 20:05:32.375394 ip-10-0-131-150 kubenswrapper[2579]: W0724 20:05:32.375361    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4ab1b619_1bf3_429b_a889_5e5364b2d80e.slice/crio-82788afbdd05a97b1616857c6801e2d2a8fcdb9a42da1e7596bfd0ddeed2e533 WatchSource:0}: Error finding container 82788afbdd05a97b1616857c6801e2d2a8fcdb9a42da1e7596bfd0ddeed2e533: Status 404 returned error can't find the container with id 82788afbdd05a97b1616857c6801e2d2a8fcdb9a42da1e7596bfd0ddeed2e533
Jul 24 20:05:32.878203 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:32.878105    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8abb86/auth-test-model-8abb86-kserve-7b9b4654d7-88nqg" event={"ID":"4ab1b619-1bf3-429b-a889-5e5364b2d80e","Type":"ContainerStarted","Data":"270fe8429e538c7266d8345d7a3d47b298d2f3b83e31fb2082fee0a33d5ba559"}
Jul 24 20:05:32.878203 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:32.878158    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8abb86/auth-test-model-8abb86-kserve-7b9b4654d7-88nqg" event={"ID":"4ab1b619-1bf3-429b-a889-5e5364b2d80e","Type":"ContainerStarted","Data":"82788afbdd05a97b1616857c6801e2d2a8fcdb9a42da1e7596bfd0ddeed2e533"}
Jul 24 20:05:32.893603 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:32.893548    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-8abb86/auth-test-model-8abb86-kserve-7b9b4654d7-88nqg" podStartSLOduration=1.8935313360000001 podStartE2EDuration="1.893531336s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:05:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:05:32.892744466 +0000 UTC m=+2331.081818780" watchObservedRunningTime="2026-07-24 20:05:32.893531336 +0000 UTC m=+2331.082605648"
Jul 24 20:05:35.199912 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:35.199874    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 20:05:42.210329 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:42.210239    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-8abb86/auth-test-model-8abb86-kserve-7b9b4654d7-88nqg"
Jul 24 20:05:42.210778 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:42.210351    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-8abb86/auth-test-model-8abb86-kserve-7b9b4654d7-88nqg"
Jul 24 20:05:42.223003 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:42.222978    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-8abb86/auth-test-model-8abb86-kserve-7b9b4654d7-88nqg"
Jul 24 20:05:42.674137 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:42.674106    2579 scope.go:117] "RemoveContainer" containerID="b0dcdbc705a83e347106a6749e0b17946a66fe4661ef75d8708fd00166702c8f"
Jul 24 20:05:42.943112 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:42.943023    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-8abb86/auth-test-model-8abb86-kserve-7b9b4654d7-88nqg"
Jul 24 20:05:55.222125 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:55.222080    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-3e15b4/auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs"]
Jul 24 20:05:55.225660 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:55.225637    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3e15b4/auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs"
Jul 24 20:05:55.229969 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:55.229945    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-3e15b4\"/\"auth-test-model-3e15b4-kserve-self-signed-certs\""
Jul 24 20:05:55.231044 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:55.231022    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-3e15b4\"/\"kube-root-ca.crt\""
Jul 24 20:05:55.231144 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:55.231093    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-3e15b4\"/\"openshift-service-ca.crt\""
Jul 24 20:05:55.231230 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:55.231203    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-3e15b4\"/\"default-dockercfg-dk8z4\""
Jul 24 20:05:55.243318 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:55.243291    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-3e15b4/auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs"]
Jul 24 20:05:55.267241 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:55.267211    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d119da40-8fa5-48c0-ba06-267ce08a61f6-tmp-dir\") pod \"auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs\" (UID: \"d119da40-8fa5-48c0-ba06-267ce08a61f6\") " pod="ai-tenant-e2e-shared-b-3e15b4/auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs"
Jul 24 20:05:55.267522 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:55.267494    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d119da40-8fa5-48c0-ba06-267ce08a61f6-dshm\") pod \"auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs\" (UID: \"d119da40-8fa5-48c0-ba06-267ce08a61f6\") " pod="ai-tenant-e2e-shared-b-3e15b4/auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs"
Jul 24 20:05:55.267623 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:55.267530    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d119da40-8fa5-48c0-ba06-267ce08a61f6-model-cache\") pod \"auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs\" (UID: \"d119da40-8fa5-48c0-ba06-267ce08a61f6\") " pod="ai-tenant-e2e-shared-b-3e15b4/auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs"
Jul 24 20:05:55.267623 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:55.267561    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d119da40-8fa5-48c0-ba06-267ce08a61f6-tls-certs\") pod \"auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs\" (UID: \"d119da40-8fa5-48c0-ba06-267ce08a61f6\") " pod="ai-tenant-e2e-shared-b-3e15b4/auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs"
Jul 24 20:05:55.267804 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:55.267612    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncckw\" (UniqueName: \"kubernetes.io/projected/d119da40-8fa5-48c0-ba06-267ce08a61f6-kube-api-access-ncckw\") pod \"auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs\" (UID: \"d119da40-8fa5-48c0-ba06-267ce08a61f6\") " pod="ai-tenant-e2e-shared-b-3e15b4/auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs"
Jul 24 20:05:55.267804 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:55.267664    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d119da40-8fa5-48c0-ba06-267ce08a61f6-home\") pod \"auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs\" (UID: \"d119da40-8fa5-48c0-ba06-267ce08a61f6\") " pod="ai-tenant-e2e-shared-b-3e15b4/auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs"
Jul 24 20:05:55.369004 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:55.368966    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d119da40-8fa5-48c0-ba06-267ce08a61f6-dshm\") pod \"auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs\" (UID: \"d119da40-8fa5-48c0-ba06-267ce08a61f6\") " pod="ai-tenant-e2e-shared-b-3e15b4/auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs"
Jul 24 20:05:55.369004 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:55.369002    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d119da40-8fa5-48c0-ba06-267ce08a61f6-model-cache\") pod \"auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs\" (UID: \"d119da40-8fa5-48c0-ba06-267ce08a61f6\") " pod="ai-tenant-e2e-shared-b-3e15b4/auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs"
Jul 24 20:05:55.369265 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:55.369023    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d119da40-8fa5-48c0-ba06-267ce08a61f6-tls-certs\") pod \"auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs\" (UID: \"d119da40-8fa5-48c0-ba06-267ce08a61f6\") " pod="ai-tenant-e2e-shared-b-3e15b4/auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs"
Jul 24 20:05:55.369265 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:55.369042    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncckw\" (UniqueName: \"kubernetes.io/projected/d119da40-8fa5-48c0-ba06-267ce08a61f6-kube-api-access-ncckw\") pod \"auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs\" (UID: \"d119da40-8fa5-48c0-ba06-267ce08a61f6\") " pod="ai-tenant-e2e-shared-b-3e15b4/auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs"
Jul 24 20:05:55.369265 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:55.369072    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d119da40-8fa5-48c0-ba06-267ce08a61f6-home\") pod \"auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs\" (UID: \"d119da40-8fa5-48c0-ba06-267ce08a61f6\") " pod="ai-tenant-e2e-shared-b-3e15b4/auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs"
Jul 24 20:05:55.369265 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:55.369129    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d119da40-8fa5-48c0-ba06-267ce08a61f6-tmp-dir\") pod \"auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs\" (UID: \"d119da40-8fa5-48c0-ba06-267ce08a61f6\") " pod="ai-tenant-e2e-shared-b-3e15b4/auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs"
Jul 24 20:05:55.369495 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:55.369463    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d119da40-8fa5-48c0-ba06-267ce08a61f6-model-cache\") pod \"auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs\" (UID: \"d119da40-8fa5-48c0-ba06-267ce08a61f6\") " pod="ai-tenant-e2e-shared-b-3e15b4/auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs"
Jul 24 20:05:55.369553 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:55.369480    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d119da40-8fa5-48c0-ba06-267ce08a61f6-tmp-dir\") pod \"auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs\" (UID: \"d119da40-8fa5-48c0-ba06-267ce08a61f6\") " pod="ai-tenant-e2e-shared-b-3e15b4/auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs"
Jul 24 20:05:55.369553 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:55.369529    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d119da40-8fa5-48c0-ba06-267ce08a61f6-home\") pod \"auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs\" (UID: \"d119da40-8fa5-48c0-ba06-267ce08a61f6\") " pod="ai-tenant-e2e-shared-b-3e15b4/auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs"
Jul 24 20:05:55.371431 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:55.371406    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d119da40-8fa5-48c0-ba06-267ce08a61f6-dshm\") pod \"auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs\" (UID: \"d119da40-8fa5-48c0-ba06-267ce08a61f6\") " pod="ai-tenant-e2e-shared-b-3e15b4/auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs"
Jul 24 20:05:55.371677 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:55.371660    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d119da40-8fa5-48c0-ba06-267ce08a61f6-tls-certs\") pod \"auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs\" (UID: \"d119da40-8fa5-48c0-ba06-267ce08a61f6\") " pod="ai-tenant-e2e-shared-b-3e15b4/auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs"
Jul 24 20:05:55.388295 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:55.388262    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncckw\" (UniqueName: \"kubernetes.io/projected/d119da40-8fa5-48c0-ba06-267ce08a61f6-kube-api-access-ncckw\") pod \"auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs\" (UID: \"d119da40-8fa5-48c0-ba06-267ce08a61f6\") " pod="ai-tenant-e2e-shared-b-3e15b4/auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs"
Jul 24 20:05:55.534501 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:55.534462    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3e15b4/auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs"
Jul 24 20:05:55.675374 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:55.675345    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-3e15b4/auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs"]
Jul 24 20:05:55.676833 ip-10-0-131-150 kubenswrapper[2579]: W0724 20:05:55.676808    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd119da40_8fa5_48c0_ba06_267ce08a61f6.slice/crio-7d81480550ffe18a93b09b21fe66abd749113375457814dc91deea1f124ed2af WatchSource:0}: Error finding container 7d81480550ffe18a93b09b21fe66abd749113375457814dc91deea1f124ed2af: Status 404 returned error can't find the container with id 7d81480550ffe18a93b09b21fe66abd749113375457814dc91deea1f124ed2af
Jul 24 20:05:55.998027 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:55.997932    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3e15b4/auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs" event={"ID":"d119da40-8fa5-48c0-ba06-267ce08a61f6","Type":"ContainerStarted","Data":"1f4a0bf29ac3e051ef77ee09d4268934bbac5d7eaacab0448e3a068a9c110654"}
Jul 24 20:05:55.998027 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:55.997989    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3e15b4/auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs" event={"ID":"d119da40-8fa5-48c0-ba06-267ce08a61f6","Type":"ContainerStarted","Data":"7d81480550ffe18a93b09b21fe66abd749113375457814dc91deea1f124ed2af"}
Jul 24 20:05:56.027840 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:56.027789    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-3e15b4/auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs" podStartSLOduration=1.027771865 podStartE2EDuration="1.027771865s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:05:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:05:56.026153693 +0000 UTC m=+2354.215228006" watchObservedRunningTime="2026-07-24 20:05:56.027771865 +0000 UTC m=+2354.216846178"
Jul 24 20:05:58.903093 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:05:58.903058    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 20:06:05.535568 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:06:05.535519    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-3e15b4/auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs"
Jul 24 20:06:05.536054 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:06:05.535606    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-3e15b4/auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs"
Jul 24 20:06:05.548436 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:06:05.548412    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-3e15b4/auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs"
Jul 24 20:06:06.062684 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:06:06.062652    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-3e15b4/auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs"
Jul 24 20:06:12.908535 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:06:12.908491    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 20:06:29.588528 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:06:29.588491    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 20:06:42.488317 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:06:42.488283    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vclnd_fa8789c9-6c39-46cd-a540-657dea710eb8/ovn-acl-logging/0.log"
Jul 24 20:06:42.498003 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:06:42.497978    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vclnd_fa8789c9-6c39-46cd-a540-657dea710eb8/ovn-acl-logging/0.log"
Jul 24 20:06:49.593018 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:06:49.592980    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 20:07:07.595906 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:07:07.595823    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 20:07:24.388613 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:07:24.388577    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 20:07:44.185684 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:07:44.185650    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 20:07:58.975558 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:07:58.975523    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8abb86/auth-test-model-8abb86-kserve-7b9b4654d7-88nqg"]
Jul 24 20:08:00.004959 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:00.004926    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-3e15b4/auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs"]
Jul 24 20:08:01.224046 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:01.224005    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 20:08:11.386856 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:11.386823    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 20:08:13.994857 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:13.994819    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-8abb86/auth-test-model-8abb86-kserve-7b9b4654d7-88nqg" podUID="4ab1b619-1bf3-429b-a889-5e5364b2d80e" containerName="main" containerID="cri-o://270fe8429e538c7266d8345d7a3d47b298d2f3b83e31fb2082fee0a33d5ba559" gracePeriod=45
Jul 24 20:08:14.265921 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:14.265890    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8abb86/auth-test-model-8abb86-kserve-7b9b4654d7-88nqg"
Jul 24 20:08:14.407608 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:14.407573    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ab1b619-1bf3-429b-a889-5e5364b2d80e-dshm\") pod \"4ab1b619-1bf3-429b-a889-5e5364b2d80e\" (UID: \"4ab1b619-1bf3-429b-a889-5e5364b2d80e\") "
Jul 24 20:08:14.407838 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:14.407620    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ab1b619-1bf3-429b-a889-5e5364b2d80e-home\") pod \"4ab1b619-1bf3-429b-a889-5e5364b2d80e\" (UID: \"4ab1b619-1bf3-429b-a889-5e5364b2d80e\") "
Jul 24 20:08:14.407838 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:14.407669    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ab1b619-1bf3-429b-a889-5e5364b2d80e-model-cache\") pod \"4ab1b619-1bf3-429b-a889-5e5364b2d80e\" (UID: \"4ab1b619-1bf3-429b-a889-5e5364b2d80e\") "
Jul 24 20:08:14.407838 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:14.407744    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ab1b619-1bf3-429b-a889-5e5364b2d80e-tls-certs\") pod \"4ab1b619-1bf3-429b-a889-5e5364b2d80e\" (UID: \"4ab1b619-1bf3-429b-a889-5e5364b2d80e\") "
Jul 24 20:08:14.407838 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:14.407797    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ab1b619-1bf3-429b-a889-5e5364b2d80e-tmp-dir\") pod \"4ab1b619-1bf3-429b-a889-5e5364b2d80e\" (UID: \"4ab1b619-1bf3-429b-a889-5e5364b2d80e\") "
Jul 24 20:08:14.407838 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:14.407835    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ksl2x\" (UniqueName: \"kubernetes.io/projected/4ab1b619-1bf3-429b-a889-5e5364b2d80e-kube-api-access-ksl2x\") pod \"4ab1b619-1bf3-429b-a889-5e5364b2d80e\" (UID: \"4ab1b619-1bf3-429b-a889-5e5364b2d80e\") "
Jul 24 20:08:14.408093 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:14.407973    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ab1b619-1bf3-429b-a889-5e5364b2d80e-model-cache" (OuterVolumeSpecName: "model-cache") pod "4ab1b619-1bf3-429b-a889-5e5364b2d80e" (UID: "4ab1b619-1bf3-429b-a889-5e5364b2d80e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:08:14.408093 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:14.407991    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ab1b619-1bf3-429b-a889-5e5364b2d80e-home" (OuterVolumeSpecName: "home") pod "4ab1b619-1bf3-429b-a889-5e5364b2d80e" (UID: "4ab1b619-1bf3-429b-a889-5e5364b2d80e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:08:14.408163 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:14.408083    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ab1b619-1bf3-429b-a889-5e5364b2d80e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4ab1b619-1bf3-429b-a889-5e5364b2d80e" (UID: "4ab1b619-1bf3-429b-a889-5e5364b2d80e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:08:14.408223 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:14.408166    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ab1b619-1bf3-429b-a889-5e5364b2d80e-home\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:08:14.408223 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:14.408182    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ab1b619-1bf3-429b-a889-5e5364b2d80e-model-cache\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:08:14.408223 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:14.408219    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ab1b619-1bf3-429b-a889-5e5364b2d80e-tmp-dir\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:08:14.410001 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:14.409980    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ab1b619-1bf3-429b-a889-5e5364b2d80e-dshm" (OuterVolumeSpecName: "dshm") pod "4ab1b619-1bf3-429b-a889-5e5364b2d80e" (UID: "4ab1b619-1bf3-429b-a889-5e5364b2d80e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:08:14.410157 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:14.410123    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ab1b619-1bf3-429b-a889-5e5364b2d80e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4ab1b619-1bf3-429b-a889-5e5364b2d80e" (UID: "4ab1b619-1bf3-429b-a889-5e5364b2d80e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 20:08:14.410260 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:14.410157    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ab1b619-1bf3-429b-a889-5e5364b2d80e-kube-api-access-ksl2x" (OuterVolumeSpecName: "kube-api-access-ksl2x") pod "4ab1b619-1bf3-429b-a889-5e5364b2d80e" (UID: "4ab1b619-1bf3-429b-a889-5e5364b2d80e"). InnerVolumeSpecName "kube-api-access-ksl2x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:08:14.508875 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:14.508834    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ab1b619-1bf3-429b-a889-5e5364b2d80e-tls-certs\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:08:14.508875 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:14.508867    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ksl2x\" (UniqueName: \"kubernetes.io/projected/4ab1b619-1bf3-429b-a889-5e5364b2d80e-kube-api-access-ksl2x\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:08:14.508875 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:14.508876    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ab1b619-1bf3-429b-a889-5e5364b2d80e-dshm\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:08:14.736479 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:14.736393    2579 generic.go:356] "Generic (PLEG): container finished" podID="4ab1b619-1bf3-429b-a889-5e5364b2d80e" containerID="270fe8429e538c7266d8345d7a3d47b298d2f3b83e31fb2082fee0a33d5ba559" exitCode=0
Jul 24 20:08:14.736479 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:14.736440    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8abb86/auth-test-model-8abb86-kserve-7b9b4654d7-88nqg"
Jul 24 20:08:14.736683 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:14.736485    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8abb86/auth-test-model-8abb86-kserve-7b9b4654d7-88nqg" event={"ID":"4ab1b619-1bf3-429b-a889-5e5364b2d80e","Type":"ContainerDied","Data":"270fe8429e538c7266d8345d7a3d47b298d2f3b83e31fb2082fee0a33d5ba559"}
Jul 24 20:08:14.736683 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:14.736532    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8abb86/auth-test-model-8abb86-kserve-7b9b4654d7-88nqg" event={"ID":"4ab1b619-1bf3-429b-a889-5e5364b2d80e","Type":"ContainerDied","Data":"82788afbdd05a97b1616857c6801e2d2a8fcdb9a42da1e7596bfd0ddeed2e533"}
Jul 24 20:08:14.736683 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:14.736553    2579 scope.go:117] "RemoveContainer" containerID="270fe8429e538c7266d8345d7a3d47b298d2f3b83e31fb2082fee0a33d5ba559"
Jul 24 20:08:14.746277 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:14.746260    2579 scope.go:117] "RemoveContainer" containerID="270fe8429e538c7266d8345d7a3d47b298d2f3b83e31fb2082fee0a33d5ba559"
Jul 24 20:08:14.746536 ip-10-0-131-150 kubenswrapper[2579]: E0724 20:08:14.746517    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"270fe8429e538c7266d8345d7a3d47b298d2f3b83e31fb2082fee0a33d5ba559\": container with ID starting with 270fe8429e538c7266d8345d7a3d47b298d2f3b83e31fb2082fee0a33d5ba559 not found: ID does not exist" containerID="270fe8429e538c7266d8345d7a3d47b298d2f3b83e31fb2082fee0a33d5ba559"
Jul 24 20:08:14.746575 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:14.746546    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"270fe8429e538c7266d8345d7a3d47b298d2f3b83e31fb2082fee0a33d5ba559"} err="failed to get container status \"270fe8429e538c7266d8345d7a3d47b298d2f3b83e31fb2082fee0a33d5ba559\": rpc error: code = NotFound desc = could not find container \"270fe8429e538c7266d8345d7a3d47b298d2f3b83e31fb2082fee0a33d5ba559\": container with ID starting with 270fe8429e538c7266d8345d7a3d47b298d2f3b83e31fb2082fee0a33d5ba559 not found: ID does not exist"
Jul 24 20:08:14.758930 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:14.758904    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8abb86/auth-test-model-8abb86-kserve-7b9b4654d7-88nqg"]
Jul 24 20:08:14.762014 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:14.761991    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-8abb86/auth-test-model-8abb86-kserve-7b9b4654d7-88nqg"]
Jul 24 20:08:15.024747 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:15.024676    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-3e15b4/auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs" podUID="d119da40-8fa5-48c0-ba06-267ce08a61f6" containerName="main" containerID="cri-o://1f4a0bf29ac3e051ef77ee09d4268934bbac5d7eaacab0448e3a068a9c110654" gracePeriod=45
Jul 24 20:08:15.273567 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:15.273543    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3e15b4/auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs"
Jul 24 20:08:15.418663 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:15.418542    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d119da40-8fa5-48c0-ba06-267ce08a61f6-tls-certs\") pod \"d119da40-8fa5-48c0-ba06-267ce08a61f6\" (UID: \"d119da40-8fa5-48c0-ba06-267ce08a61f6\") "
Jul 24 20:08:15.418663 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:15.418590    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d119da40-8fa5-48c0-ba06-267ce08a61f6-model-cache\") pod \"d119da40-8fa5-48c0-ba06-267ce08a61f6\" (UID: \"d119da40-8fa5-48c0-ba06-267ce08a61f6\") "
Jul 24 20:08:15.418663 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:15.418616    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d119da40-8fa5-48c0-ba06-267ce08a61f6-home\") pod \"d119da40-8fa5-48c0-ba06-267ce08a61f6\" (UID: \"d119da40-8fa5-48c0-ba06-267ce08a61f6\") "
Jul 24 20:08:15.418663 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:15.418649    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d119da40-8fa5-48c0-ba06-267ce08a61f6-dshm\") pod \"d119da40-8fa5-48c0-ba06-267ce08a61f6\" (UID: \"d119da40-8fa5-48c0-ba06-267ce08a61f6\") "
Jul 24 20:08:15.419151 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:15.418678    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d119da40-8fa5-48c0-ba06-267ce08a61f6-tmp-dir\") pod \"d119da40-8fa5-48c0-ba06-267ce08a61f6\" (UID: \"d119da40-8fa5-48c0-ba06-267ce08a61f6\") "
Jul 24 20:08:15.419151 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:15.418794    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ncckw\" (UniqueName: \"kubernetes.io/projected/d119da40-8fa5-48c0-ba06-267ce08a61f6-kube-api-access-ncckw\") pod \"d119da40-8fa5-48c0-ba06-267ce08a61f6\" (UID: \"d119da40-8fa5-48c0-ba06-267ce08a61f6\") "
Jul 24 20:08:15.419151 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:15.418888    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d119da40-8fa5-48c0-ba06-267ce08a61f6-model-cache" (OuterVolumeSpecName: "model-cache") pod "d119da40-8fa5-48c0-ba06-267ce08a61f6" (UID: "d119da40-8fa5-48c0-ba06-267ce08a61f6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:08:15.419151 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:15.418972    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d119da40-8fa5-48c0-ba06-267ce08a61f6-home" (OuterVolumeSpecName: "home") pod "d119da40-8fa5-48c0-ba06-267ce08a61f6" (UID: "d119da40-8fa5-48c0-ba06-267ce08a61f6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:08:15.419151 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:15.419000    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d119da40-8fa5-48c0-ba06-267ce08a61f6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d119da40-8fa5-48c0-ba06-267ce08a61f6" (UID: "d119da40-8fa5-48c0-ba06-267ce08a61f6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:08:15.419151 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:15.419097    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d119da40-8fa5-48c0-ba06-267ce08a61f6-model-cache\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:08:15.419151 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:15.419115    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d119da40-8fa5-48c0-ba06-267ce08a61f6-home\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:08:15.419151 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:15.419130    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d119da40-8fa5-48c0-ba06-267ce08a61f6-tmp-dir\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:08:15.421189 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:15.421161    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d119da40-8fa5-48c0-ba06-267ce08a61f6-kube-api-access-ncckw" (OuterVolumeSpecName: "kube-api-access-ncckw") pod "d119da40-8fa5-48c0-ba06-267ce08a61f6" (UID: "d119da40-8fa5-48c0-ba06-267ce08a61f6"). InnerVolumeSpecName "kube-api-access-ncckw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:08:15.421189 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:15.421158    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d119da40-8fa5-48c0-ba06-267ce08a61f6-dshm" (OuterVolumeSpecName: "dshm") pod "d119da40-8fa5-48c0-ba06-267ce08a61f6" (UID: "d119da40-8fa5-48c0-ba06-267ce08a61f6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:08:15.421189 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:15.421182    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d119da40-8fa5-48c0-ba06-267ce08a61f6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d119da40-8fa5-48c0-ba06-267ce08a61f6" (UID: "d119da40-8fa5-48c0-ba06-267ce08a61f6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 20:08:15.519931 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:15.519890    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncckw\" (UniqueName: \"kubernetes.io/projected/d119da40-8fa5-48c0-ba06-267ce08a61f6-kube-api-access-ncckw\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:08:15.519931 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:15.519926    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d119da40-8fa5-48c0-ba06-267ce08a61f6-tls-certs\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:08:15.519931 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:15.519938    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d119da40-8fa5-48c0-ba06-267ce08a61f6-dshm\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:08:15.743237 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:15.743141    2579 generic.go:356] "Generic (PLEG): container finished" podID="d119da40-8fa5-48c0-ba06-267ce08a61f6" containerID="1f4a0bf29ac3e051ef77ee09d4268934bbac5d7eaacab0448e3a068a9c110654" exitCode=0
Jul 24 20:08:15.743237 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:15.743187    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3e15b4/auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs"
Jul 24 20:08:15.743470 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:15.743229    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3e15b4/auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs" event={"ID":"d119da40-8fa5-48c0-ba06-267ce08a61f6","Type":"ContainerDied","Data":"1f4a0bf29ac3e051ef77ee09d4268934bbac5d7eaacab0448e3a068a9c110654"}
Jul 24 20:08:15.743470 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:15.743269    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3e15b4/auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs" event={"ID":"d119da40-8fa5-48c0-ba06-267ce08a61f6","Type":"ContainerDied","Data":"7d81480550ffe18a93b09b21fe66abd749113375457814dc91deea1f124ed2af"}
Jul 24 20:08:15.743470 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:15.743288    2579 scope.go:117] "RemoveContainer" containerID="1f4a0bf29ac3e051ef77ee09d4268934bbac5d7eaacab0448e3a068a9c110654"
Jul 24 20:08:15.752679 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:15.752658    2579 scope.go:117] "RemoveContainer" containerID="1f4a0bf29ac3e051ef77ee09d4268934bbac5d7eaacab0448e3a068a9c110654"
Jul 24 20:08:15.752982 ip-10-0-131-150 kubenswrapper[2579]: E0724 20:08:15.752962    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f4a0bf29ac3e051ef77ee09d4268934bbac5d7eaacab0448e3a068a9c110654\": container with ID starting with 1f4a0bf29ac3e051ef77ee09d4268934bbac5d7eaacab0448e3a068a9c110654 not found: ID does not exist" containerID="1f4a0bf29ac3e051ef77ee09d4268934bbac5d7eaacab0448e3a068a9c110654"
Jul 24 20:08:15.753069 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:15.752989    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f4a0bf29ac3e051ef77ee09d4268934bbac5d7eaacab0448e3a068a9c110654"} err="failed to get container status \"1f4a0bf29ac3e051ef77ee09d4268934bbac5d7eaacab0448e3a068a9c110654\": rpc error: code = NotFound desc = could not find container \"1f4a0bf29ac3e051ef77ee09d4268934bbac5d7eaacab0448e3a068a9c110654\": container with ID starting with 1f4a0bf29ac3e051ef77ee09d4268934bbac5d7eaacab0448e3a068a9c110654 not found: ID does not exist"
Jul 24 20:08:15.763317 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:15.763293    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-3e15b4/auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs"]
Jul 24 20:08:15.769090 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:15.769067    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-3e15b4/auth-test-model-3e15b4-kserve-55cbd69f79-j9mhs"]
Jul 24 20:08:16.367717 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:16.367683    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ab1b619-1bf3-429b-a889-5e5364b2d80e" path="/var/lib/kubelet/pods/4ab1b619-1bf3-429b-a889-5e5364b2d80e/volumes"
Jul 24 20:08:16.368144 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:16.368128    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d119da40-8fa5-48c0-ba06-267ce08a61f6" path="/var/lib/kubelet/pods/d119da40-8fa5-48c0-ba06-267ce08a61f6/volumes"
Jul 24 20:08:21.495092 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:21.495053    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 20:08:29.491766 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:29.491734    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-3e15b4/sub-test-model-3e15b4-kserve-689477d447-qwvcc"]
Jul 24 20:08:29.492218 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:29.492071    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ab1b619-1bf3-429b-a889-5e5364b2d80e" containerName="main"
Jul 24 20:08:29.492218 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:29.492088    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ab1b619-1bf3-429b-a889-5e5364b2d80e" containerName="main"
Jul 24 20:08:29.492218 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:29.492108    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d119da40-8fa5-48c0-ba06-267ce08a61f6" containerName="main"
Jul 24 20:08:29.492218 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:29.492116    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d119da40-8fa5-48c0-ba06-267ce08a61f6" containerName="main"
Jul 24 20:08:29.492218 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:29.492209    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ab1b619-1bf3-429b-a889-5e5364b2d80e" containerName="main"
Jul 24 20:08:29.492497 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:29.492228    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d119da40-8fa5-48c0-ba06-267ce08a61f6" containerName="main"
Jul 24 20:08:29.495274 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:29.495255    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3e15b4/sub-test-model-3e15b4-kserve-689477d447-qwvcc"
Jul 24 20:08:29.498476 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:29.498455    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-3e15b4\"/\"openshift-service-ca.crt\""
Jul 24 20:08:29.498476 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:29.498469    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-3e15b4\"/\"default-dockercfg-dk8z4\""
Jul 24 20:08:29.498663 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:29.498454    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-3e15b4\"/\"kube-root-ca.crt\""
Jul 24 20:08:29.498663 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:29.498489    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-3e15b4\"/\"sub-test-model-3e15b4-kserve-self-signed-certs\""
Jul 24 20:08:29.506201 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:29.506176    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-3e15b4/sub-test-model-3e15b4-kserve-689477d447-qwvcc"]
Jul 24 20:08:29.548041 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:29.548004    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4dc9d342-a432-4300-a4fb-a4f1f1911c32-model-cache\") pod \"sub-test-model-3e15b4-kserve-689477d447-qwvcc\" (UID: \"4dc9d342-a432-4300-a4fb-a4f1f1911c32\") " pod="ai-tenant-e2e-shared-b-3e15b4/sub-test-model-3e15b4-kserve-689477d447-qwvcc"
Jul 24 20:08:29.548041 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:29.548045    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4dc9d342-a432-4300-a4fb-a4f1f1911c32-dshm\") pod \"sub-test-model-3e15b4-kserve-689477d447-qwvcc\" (UID: \"4dc9d342-a432-4300-a4fb-a4f1f1911c32\") " pod="ai-tenant-e2e-shared-b-3e15b4/sub-test-model-3e15b4-kserve-689477d447-qwvcc"
Jul 24 20:08:29.548314 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:29.548060    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4dc9d342-a432-4300-a4fb-a4f1f1911c32-tmp-dir\") pod \"sub-test-model-3e15b4-kserve-689477d447-qwvcc\" (UID: \"4dc9d342-a432-4300-a4fb-a4f1f1911c32\") " pod="ai-tenant-e2e-shared-b-3e15b4/sub-test-model-3e15b4-kserve-689477d447-qwvcc"
Jul 24 20:08:29.548314 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:29.548151    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctljr\" (UniqueName: \"kubernetes.io/projected/4dc9d342-a432-4300-a4fb-a4f1f1911c32-kube-api-access-ctljr\") pod \"sub-test-model-3e15b4-kserve-689477d447-qwvcc\" (UID: \"4dc9d342-a432-4300-a4fb-a4f1f1911c32\") " pod="ai-tenant-e2e-shared-b-3e15b4/sub-test-model-3e15b4-kserve-689477d447-qwvcc"
Jul 24 20:08:29.548314 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:29.548202    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4dc9d342-a432-4300-a4fb-a4f1f1911c32-tls-certs\") pod \"sub-test-model-3e15b4-kserve-689477d447-qwvcc\" (UID: \"4dc9d342-a432-4300-a4fb-a4f1f1911c32\") " pod="ai-tenant-e2e-shared-b-3e15b4/sub-test-model-3e15b4-kserve-689477d447-qwvcc"
Jul 24 20:08:29.548314 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:29.548267    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4dc9d342-a432-4300-a4fb-a4f1f1911c32-home\") pod \"sub-test-model-3e15b4-kserve-689477d447-qwvcc\" (UID: \"4dc9d342-a432-4300-a4fb-a4f1f1911c32\") " pod="ai-tenant-e2e-shared-b-3e15b4/sub-test-model-3e15b4-kserve-689477d447-qwvcc"
Jul 24 20:08:29.648824 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:29.648791    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4dc9d342-a432-4300-a4fb-a4f1f1911c32-home\") pod \"sub-test-model-3e15b4-kserve-689477d447-qwvcc\" (UID: \"4dc9d342-a432-4300-a4fb-a4f1f1911c32\") " pod="ai-tenant-e2e-shared-b-3e15b4/sub-test-model-3e15b4-kserve-689477d447-qwvcc"
Jul 24 20:08:29.649025 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:29.648886    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4dc9d342-a432-4300-a4fb-a4f1f1911c32-model-cache\") pod \"sub-test-model-3e15b4-kserve-689477d447-qwvcc\" (UID: \"4dc9d342-a432-4300-a4fb-a4f1f1911c32\") " pod="ai-tenant-e2e-shared-b-3e15b4/sub-test-model-3e15b4-kserve-689477d447-qwvcc"
Jul 24 20:08:29.649025 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:29.648920    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4dc9d342-a432-4300-a4fb-a4f1f1911c32-dshm\") pod \"sub-test-model-3e15b4-kserve-689477d447-qwvcc\" (UID: \"4dc9d342-a432-4300-a4fb-a4f1f1911c32\") " pod="ai-tenant-e2e-shared-b-3e15b4/sub-test-model-3e15b4-kserve-689477d447-qwvcc"
Jul 24 20:08:29.649025 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:29.648942    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4dc9d342-a432-4300-a4fb-a4f1f1911c32-tmp-dir\") pod \"sub-test-model-3e15b4-kserve-689477d447-qwvcc\" (UID: \"4dc9d342-a432-4300-a4fb-a4f1f1911c32\") " pod="ai-tenant-e2e-shared-b-3e15b4/sub-test-model-3e15b4-kserve-689477d447-qwvcc"
Jul 24 20:08:29.649025 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:29.648981    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctljr\" (UniqueName: \"kubernetes.io/projected/4dc9d342-a432-4300-a4fb-a4f1f1911c32-kube-api-access-ctljr\") pod \"sub-test-model-3e15b4-kserve-689477d447-qwvcc\" (UID: \"4dc9d342-a432-4300-a4fb-a4f1f1911c32\") " pod="ai-tenant-e2e-shared-b-3e15b4/sub-test-model-3e15b4-kserve-689477d447-qwvcc"
Jul 24 20:08:29.649025 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:29.649010    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4dc9d342-a432-4300-a4fb-a4f1f1911c32-tls-certs\") pod \"sub-test-model-3e15b4-kserve-689477d447-qwvcc\" (UID: \"4dc9d342-a432-4300-a4fb-a4f1f1911c32\") " pod="ai-tenant-e2e-shared-b-3e15b4/sub-test-model-3e15b4-kserve-689477d447-qwvcc"
Jul 24 20:08:29.649299 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:29.649261    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4dc9d342-a432-4300-a4fb-a4f1f1911c32-home\") pod \"sub-test-model-3e15b4-kserve-689477d447-qwvcc\" (UID: \"4dc9d342-a432-4300-a4fb-a4f1f1911c32\") " pod="ai-tenant-e2e-shared-b-3e15b4/sub-test-model-3e15b4-kserve-689477d447-qwvcc"
Jul 24 20:08:29.649299 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:29.649286    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4dc9d342-a432-4300-a4fb-a4f1f1911c32-model-cache\") pod \"sub-test-model-3e15b4-kserve-689477d447-qwvcc\" (UID: \"4dc9d342-a432-4300-a4fb-a4f1f1911c32\") " pod="ai-tenant-e2e-shared-b-3e15b4/sub-test-model-3e15b4-kserve-689477d447-qwvcc"
Jul 24 20:08:29.649404 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:29.649318    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4dc9d342-a432-4300-a4fb-a4f1f1911c32-tmp-dir\") pod \"sub-test-model-3e15b4-kserve-689477d447-qwvcc\" (UID: \"4dc9d342-a432-4300-a4fb-a4f1f1911c32\") " pod="ai-tenant-e2e-shared-b-3e15b4/sub-test-model-3e15b4-kserve-689477d447-qwvcc"
Jul 24 20:08:29.651485 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:29.651463    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4dc9d342-a432-4300-a4fb-a4f1f1911c32-dshm\") pod \"sub-test-model-3e15b4-kserve-689477d447-qwvcc\" (UID: \"4dc9d342-a432-4300-a4fb-a4f1f1911c32\") " pod="ai-tenant-e2e-shared-b-3e15b4/sub-test-model-3e15b4-kserve-689477d447-qwvcc"
Jul 24 20:08:29.651799 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:29.651771    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4dc9d342-a432-4300-a4fb-a4f1f1911c32-tls-certs\") pod \"sub-test-model-3e15b4-kserve-689477d447-qwvcc\" (UID: \"4dc9d342-a432-4300-a4fb-a4f1f1911c32\") " pod="ai-tenant-e2e-shared-b-3e15b4/sub-test-model-3e15b4-kserve-689477d447-qwvcc"
Jul 24 20:08:29.659952 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:29.659927    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctljr\" (UniqueName: \"kubernetes.io/projected/4dc9d342-a432-4300-a4fb-a4f1f1911c32-kube-api-access-ctljr\") pod \"sub-test-model-3e15b4-kserve-689477d447-qwvcc\" (UID: \"4dc9d342-a432-4300-a4fb-a4f1f1911c32\") " pod="ai-tenant-e2e-shared-b-3e15b4/sub-test-model-3e15b4-kserve-689477d447-qwvcc"
Jul 24 20:08:29.805218 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:29.805177    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3e15b4/sub-test-model-3e15b4-kserve-689477d447-qwvcc"
Jul 24 20:08:29.942838 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:29.942806    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-3e15b4/sub-test-model-3e15b4-kserve-689477d447-qwvcc"]
Jul 24 20:08:29.944884 ip-10-0-131-150 kubenswrapper[2579]: W0724 20:08:29.944853    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4dc9d342_a432_4300_a4fb_a4f1f1911c32.slice/crio-8ed76887f284228207cba3b16340fefec8bbda02af96b7c657dc33cac323254b WatchSource:0}: Error finding container 8ed76887f284228207cba3b16340fefec8bbda02af96b7c657dc33cac323254b: Status 404 returned error can't find the container with id 8ed76887f284228207cba3b16340fefec8bbda02af96b7c657dc33cac323254b
Jul 24 20:08:30.823627 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:30.823593    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3e15b4/sub-test-model-3e15b4-kserve-689477d447-qwvcc" event={"ID":"4dc9d342-a432-4300-a4fb-a4f1f1911c32","Type":"ContainerStarted","Data":"584ce4cbb57be56ec89e6bc02f363fe43f03823ac67ea9041deafdcfafc493f7"}
Jul 24 20:08:30.823627 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:30.823632    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3e15b4/sub-test-model-3e15b4-kserve-689477d447-qwvcc" event={"ID":"4dc9d342-a432-4300-a4fb-a4f1f1911c32","Type":"ContainerStarted","Data":"8ed76887f284228207cba3b16340fefec8bbda02af96b7c657dc33cac323254b"}
Jul 24 20:08:30.841279 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:30.841231    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-3e15b4/sub-test-model-3e15b4-kserve-689477d447-qwvcc" podStartSLOduration=1.84121546 podStartE2EDuration="1.84121546s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:08:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:08:30.839783496 +0000 UTC m=+2509.028858007" watchObservedRunningTime="2026-07-24 20:08:30.84121546 +0000 UTC m=+2509.030289774"
Jul 24 20:08:33.487357 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:33.487278    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 20:08:39.805987 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:39.805950    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-3e15b4/sub-test-model-3e15b4-kserve-689477d447-qwvcc"
Jul 24 20:08:39.806384 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:39.805996    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-3e15b4/sub-test-model-3e15b4-kserve-689477d447-qwvcc"
Jul 24 20:08:39.818401 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:39.818377    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-3e15b4/sub-test-model-3e15b4-kserve-689477d447-qwvcc"
Jul 24 20:08:39.881438 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:39.881408    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-3e15b4/sub-test-model-3e15b4-kserve-689477d447-qwvcc"
Jul 24 20:08:54.084135 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:08:54.084097    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 20:09:11.701000 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:11.700965    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-3e15b4/sub-test-model-3e15b4-kserve-689477d447-qwvcc"]
Jul 24 20:09:15.585039 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:15.584999    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 20:09:26.705668 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:26.705625    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-8abb86/rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq"]
Jul 24 20:09:26.709472 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:26.709440    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8abb86/rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq"
Jul 24 20:09:26.712194 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:26.712169    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-8abb86\"/\"openshift-service-ca.crt\""
Jul 24 20:09:26.713079 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:26.713055    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8abb86\"/\"rate-test-model-8abb86-kserve-self-signed-certs\""
Jul 24 20:09:26.713079 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:26.713071    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8abb86\"/\"default-dockercfg-bg7jr\""
Jul 24 20:09:26.713079 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:26.713074    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-8abb86\"/\"kube-root-ca.crt\""
Jul 24 20:09:26.718228 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:26.718203    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8abb86/rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq"]
Jul 24 20:09:26.720033 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:26.719983    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-3e15b4/sub-test-model-3e15b4-kserve-689477d447-qwvcc" podUID="4dc9d342-a432-4300-a4fb-a4f1f1911c32" containerName="main" containerID="cri-o://584ce4cbb57be56ec89e6bc02f363fe43f03823ac67ea9041deafdcfafc493f7" gracePeriod=45
Jul 24 20:09:26.744609 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:26.744574    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67551ddb-86be-4cae-a2d3-d79e8c68d93c-tls-certs\") pod \"rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq\" (UID: \"67551ddb-86be-4cae-a2d3-d79e8c68d93c\") " pod="ai-tenant-e2e-shared-a-8abb86/rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq"
Jul 24 20:09:26.744773 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:26.744737    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67551ddb-86be-4cae-a2d3-d79e8c68d93c-home\") pod \"rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq\" (UID: \"67551ddb-86be-4cae-a2d3-d79e8c68d93c\") " pod="ai-tenant-e2e-shared-a-8abb86/rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq"
Jul 24 20:09:26.744839 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:26.744767    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67551ddb-86be-4cae-a2d3-d79e8c68d93c-model-cache\") pod \"rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq\" (UID: \"67551ddb-86be-4cae-a2d3-d79e8c68d93c\") " pod="ai-tenant-e2e-shared-a-8abb86/rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq"
Jul 24 20:09:26.744839 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:26.744795    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5m7r\" (UniqueName: \"kubernetes.io/projected/67551ddb-86be-4cae-a2d3-d79e8c68d93c-kube-api-access-k5m7r\") pod \"rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq\" (UID: \"67551ddb-86be-4cae-a2d3-d79e8c68d93c\") " pod="ai-tenant-e2e-shared-a-8abb86/rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq"
Jul 24 20:09:26.744912 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:26.744864    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67551ddb-86be-4cae-a2d3-d79e8c68d93c-dshm\") pod \"rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq\" (UID: \"67551ddb-86be-4cae-a2d3-d79e8c68d93c\") " pod="ai-tenant-e2e-shared-a-8abb86/rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq"
Jul 24 20:09:26.744966 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:26.744946    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67551ddb-86be-4cae-a2d3-d79e8c68d93c-tmp-dir\") pod \"rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq\" (UID: \"67551ddb-86be-4cae-a2d3-d79e8c68d93c\") " pod="ai-tenant-e2e-shared-a-8abb86/rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq"
Jul 24 20:09:26.845470 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:26.845429    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67551ddb-86be-4cae-a2d3-d79e8c68d93c-tmp-dir\") pod \"rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq\" (UID: \"67551ddb-86be-4cae-a2d3-d79e8c68d93c\") " pod="ai-tenant-e2e-shared-a-8abb86/rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq"
Jul 24 20:09:26.845637 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:26.845501    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67551ddb-86be-4cae-a2d3-d79e8c68d93c-tls-certs\") pod \"rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq\" (UID: \"67551ddb-86be-4cae-a2d3-d79e8c68d93c\") " pod="ai-tenant-e2e-shared-a-8abb86/rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq"
Jul 24 20:09:26.845637 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:26.845565    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67551ddb-86be-4cae-a2d3-d79e8c68d93c-home\") pod \"rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq\" (UID: \"67551ddb-86be-4cae-a2d3-d79e8c68d93c\") " pod="ai-tenant-e2e-shared-a-8abb86/rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq"
Jul 24 20:09:26.845637 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:26.845594    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67551ddb-86be-4cae-a2d3-d79e8c68d93c-model-cache\") pod \"rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq\" (UID: \"67551ddb-86be-4cae-a2d3-d79e8c68d93c\") " pod="ai-tenant-e2e-shared-a-8abb86/rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq"
Jul 24 20:09:26.845855 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:26.845768    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5m7r\" (UniqueName: \"kubernetes.io/projected/67551ddb-86be-4cae-a2d3-d79e8c68d93c-kube-api-access-k5m7r\") pod \"rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq\" (UID: \"67551ddb-86be-4cae-a2d3-d79e8c68d93c\") " pod="ai-tenant-e2e-shared-a-8abb86/rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq"
Jul 24 20:09:26.846230 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:26.845915    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67551ddb-86be-4cae-a2d3-d79e8c68d93c-dshm\") pod \"rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq\" (UID: \"67551ddb-86be-4cae-a2d3-d79e8c68d93c\") " pod="ai-tenant-e2e-shared-a-8abb86/rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq"
Jul 24 20:09:26.846230 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:26.846057    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67551ddb-86be-4cae-a2d3-d79e8c68d93c-tmp-dir\") pod \"rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq\" (UID: \"67551ddb-86be-4cae-a2d3-d79e8c68d93c\") " pod="ai-tenant-e2e-shared-a-8abb86/rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq"
Jul 24 20:09:26.846230 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:26.846190    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67551ddb-86be-4cae-a2d3-d79e8c68d93c-model-cache\") pod \"rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq\" (UID: \"67551ddb-86be-4cae-a2d3-d79e8c68d93c\") " pod="ai-tenant-e2e-shared-a-8abb86/rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq"
Jul 24 20:09:26.846466 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:26.846440    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67551ddb-86be-4cae-a2d3-d79e8c68d93c-home\") pod \"rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq\" (UID: \"67551ddb-86be-4cae-a2d3-d79e8c68d93c\") " pod="ai-tenant-e2e-shared-a-8abb86/rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq"
Jul 24 20:09:26.848248 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:26.848226    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67551ddb-86be-4cae-a2d3-d79e8c68d93c-dshm\") pod \"rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq\" (UID: \"67551ddb-86be-4cae-a2d3-d79e8c68d93c\") " pod="ai-tenant-e2e-shared-a-8abb86/rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq"
Jul 24 20:09:26.848430 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:26.848410    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67551ddb-86be-4cae-a2d3-d79e8c68d93c-tls-certs\") pod \"rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq\" (UID: \"67551ddb-86be-4cae-a2d3-d79e8c68d93c\") " pod="ai-tenant-e2e-shared-a-8abb86/rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq"
Jul 24 20:09:26.853638 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:26.853616    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5m7r\" (UniqueName: \"kubernetes.io/projected/67551ddb-86be-4cae-a2d3-d79e8c68d93c-kube-api-access-k5m7r\") pod \"rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq\" (UID: \"67551ddb-86be-4cae-a2d3-d79e8c68d93c\") " pod="ai-tenant-e2e-shared-a-8abb86/rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq"
Jul 24 20:09:26.972199 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:26.972101    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3e15b4/sub-test-model-3e15b4-kserve-689477d447-qwvcc"
Jul 24 20:09:27.019780 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:27.019747    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8abb86/rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq"
Jul 24 20:09:27.047050 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:27.047017    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4dc9d342-a432-4300-a4fb-a4f1f1911c32-tls-certs\") pod \"4dc9d342-a432-4300-a4fb-a4f1f1911c32\" (UID: \"4dc9d342-a432-4300-a4fb-a4f1f1911c32\") "
Jul 24 20:09:27.047050 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:27.047057    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4dc9d342-a432-4300-a4fb-a4f1f1911c32-tmp-dir\") pod \"4dc9d342-a432-4300-a4fb-a4f1f1911c32\" (UID: \"4dc9d342-a432-4300-a4fb-a4f1f1911c32\") "
Jul 24 20:09:27.047279 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:27.047077    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4dc9d342-a432-4300-a4fb-a4f1f1911c32-home\") pod \"4dc9d342-a432-4300-a4fb-a4f1f1911c32\" (UID: \"4dc9d342-a432-4300-a4fb-a4f1f1911c32\") "
Jul 24 20:09:27.047279 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:27.047129    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctljr\" (UniqueName: \"kubernetes.io/projected/4dc9d342-a432-4300-a4fb-a4f1f1911c32-kube-api-access-ctljr\") pod \"4dc9d342-a432-4300-a4fb-a4f1f1911c32\" (UID: \"4dc9d342-a432-4300-a4fb-a4f1f1911c32\") "
Jul 24 20:09:27.047279 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:27.047189    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4dc9d342-a432-4300-a4fb-a4f1f1911c32-dshm\") pod \"4dc9d342-a432-4300-a4fb-a4f1f1911c32\" (UID: \"4dc9d342-a432-4300-a4fb-a4f1f1911c32\") "
Jul 24 20:09:27.047279 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:27.047213    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4dc9d342-a432-4300-a4fb-a4f1f1911c32-model-cache\") pod \"4dc9d342-a432-4300-a4fb-a4f1f1911c32\" (UID: \"4dc9d342-a432-4300-a4fb-a4f1f1911c32\") "
Jul 24 20:09:27.047689 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:27.047323    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dc9d342-a432-4300-a4fb-a4f1f1911c32-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4dc9d342-a432-4300-a4fb-a4f1f1911c32" (UID: "4dc9d342-a432-4300-a4fb-a4f1f1911c32"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:09:27.047689 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:27.047409    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dc9d342-a432-4300-a4fb-a4f1f1911c32-home" (OuterVolumeSpecName: "home") pod "4dc9d342-a432-4300-a4fb-a4f1f1911c32" (UID: "4dc9d342-a432-4300-a4fb-a4f1f1911c32"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:09:27.047689 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:27.047534    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dc9d342-a432-4300-a4fb-a4f1f1911c32-model-cache" (OuterVolumeSpecName: "model-cache") pod "4dc9d342-a432-4300-a4fb-a4f1f1911c32" (UID: "4dc9d342-a432-4300-a4fb-a4f1f1911c32"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:09:27.047689 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:27.047549    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4dc9d342-a432-4300-a4fb-a4f1f1911c32-tmp-dir\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:09:27.047689 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:27.047571    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4dc9d342-a432-4300-a4fb-a4f1f1911c32-home\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:09:27.049594 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:27.049566    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dc9d342-a432-4300-a4fb-a4f1f1911c32-dshm" (OuterVolumeSpecName: "dshm") pod "4dc9d342-a432-4300-a4fb-a4f1f1911c32" (UID: "4dc9d342-a432-4300-a4fb-a4f1f1911c32"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:09:27.049907 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:27.049887    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4dc9d342-a432-4300-a4fb-a4f1f1911c32-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4dc9d342-a432-4300-a4fb-a4f1f1911c32" (UID: "4dc9d342-a432-4300-a4fb-a4f1f1911c32"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 20:09:27.049985 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:27.049899    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4dc9d342-a432-4300-a4fb-a4f1f1911c32-kube-api-access-ctljr" (OuterVolumeSpecName: "kube-api-access-ctljr") pod "4dc9d342-a432-4300-a4fb-a4f1f1911c32" (UID: "4dc9d342-a432-4300-a4fb-a4f1f1911c32"). InnerVolumeSpecName "kube-api-access-ctljr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:09:27.114857 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:27.114810    2579 generic.go:356] "Generic (PLEG): container finished" podID="4dc9d342-a432-4300-a4fb-a4f1f1911c32" containerID="584ce4cbb57be56ec89e6bc02f363fe43f03823ac67ea9041deafdcfafc493f7" exitCode=0
Jul 24 20:09:27.115026 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:27.114863    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3e15b4/sub-test-model-3e15b4-kserve-689477d447-qwvcc"
Jul 24 20:09:27.115026 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:27.114855    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3e15b4/sub-test-model-3e15b4-kserve-689477d447-qwvcc" event={"ID":"4dc9d342-a432-4300-a4fb-a4f1f1911c32","Type":"ContainerDied","Data":"584ce4cbb57be56ec89e6bc02f363fe43f03823ac67ea9041deafdcfafc493f7"}
Jul 24 20:09:27.115026 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:27.114983    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3e15b4/sub-test-model-3e15b4-kserve-689477d447-qwvcc" event={"ID":"4dc9d342-a432-4300-a4fb-a4f1f1911c32","Type":"ContainerDied","Data":"8ed76887f284228207cba3b16340fefec8bbda02af96b7c657dc33cac323254b"}
Jul 24 20:09:27.115026 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:27.115012    2579 scope.go:117] "RemoveContainer" containerID="584ce4cbb57be56ec89e6bc02f363fe43f03823ac67ea9041deafdcfafc493f7"
Jul 24 20:09:27.127188 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:27.127165    2579 scope.go:117] "RemoveContainer" containerID="584ce4cbb57be56ec89e6bc02f363fe43f03823ac67ea9041deafdcfafc493f7"
Jul 24 20:09:27.127504 ip-10-0-131-150 kubenswrapper[2579]: E0724 20:09:27.127480    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"584ce4cbb57be56ec89e6bc02f363fe43f03823ac67ea9041deafdcfafc493f7\": container with ID starting with 584ce4cbb57be56ec89e6bc02f363fe43f03823ac67ea9041deafdcfafc493f7 not found: ID does not exist" containerID="584ce4cbb57be56ec89e6bc02f363fe43f03823ac67ea9041deafdcfafc493f7"
Jul 24 20:09:27.127573 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:27.127511    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"584ce4cbb57be56ec89e6bc02f363fe43f03823ac67ea9041deafdcfafc493f7"} err="failed to get container status \"584ce4cbb57be56ec89e6bc02f363fe43f03823ac67ea9041deafdcfafc493f7\": rpc error: code = NotFound desc = could not find container \"584ce4cbb57be56ec89e6bc02f363fe43f03823ac67ea9041deafdcfafc493f7\": container with ID starting with 584ce4cbb57be56ec89e6bc02f363fe43f03823ac67ea9041deafdcfafc493f7 not found: ID does not exist"
Jul 24 20:09:27.137731 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:27.137696    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-3e15b4/sub-test-model-3e15b4-kserve-689477d447-qwvcc"]
Jul 24 20:09:27.143673 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:27.143649    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-3e15b4/sub-test-model-3e15b4-kserve-689477d447-qwvcc"]
Jul 24 20:09:27.148485 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:27.148456    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctljr\" (UniqueName: \"kubernetes.io/projected/4dc9d342-a432-4300-a4fb-a4f1f1911c32-kube-api-access-ctljr\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:09:27.148485 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:27.148484    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4dc9d342-a432-4300-a4fb-a4f1f1911c32-dshm\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:09:27.148616 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:27.148500    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4dc9d342-a432-4300-a4fb-a4f1f1911c32-model-cache\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:09:27.148616 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:27.148511    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4dc9d342-a432-4300-a4fb-a4f1f1911c32-tls-certs\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:09:27.159573 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:27.159550    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8abb86/rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq"]
Jul 24 20:09:27.160787 ip-10-0-131-150 kubenswrapper[2579]: W0724 20:09:27.160762    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod67551ddb_86be_4cae_a2d3_d79e8c68d93c.slice/crio-6966efbfaf474d9a7b30c2ab621786daeed29e2400f924cbe0bfad6079350b1f WatchSource:0}: Error finding container 6966efbfaf474d9a7b30c2ab621786daeed29e2400f924cbe0bfad6079350b1f: Status 404 returned error can't find the container with id 6966efbfaf474d9a7b30c2ab621786daeed29e2400f924cbe0bfad6079350b1f
Jul 24 20:09:28.126788 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:28.126742    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8abb86/rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq" event={"ID":"67551ddb-86be-4cae-a2d3-d79e8c68d93c","Type":"ContainerStarted","Data":"9deec24894faa2db0144682338780ae0ab9ddf48f5ef4fcb59932f47d3b3592c"}
Jul 24 20:09:28.127190 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:28.126800    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8abb86/rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq" event={"ID":"67551ddb-86be-4cae-a2d3-d79e8c68d93c","Type":"ContainerStarted","Data":"6966efbfaf474d9a7b30c2ab621786daeed29e2400f924cbe0bfad6079350b1f"}
Jul 24 20:09:28.149505 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:28.149445    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-8abb86/rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq" podStartSLOduration=2.149429698 podStartE2EDuration="2.149429698s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:09:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:09:28.148846278 +0000 UTC m=+2566.337920591" watchObservedRunningTime="2026-07-24 20:09:28.149429698 +0000 UTC m=+2566.338504022"
Jul 24 20:09:28.367768 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:28.367717    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4dc9d342-a432-4300-a4fb-a4f1f1911c32" path="/var/lib/kubelet/pods/4dc9d342-a432-4300-a4fb-a4f1f1911c32/volumes"
Jul 24 20:09:30.202878 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:30.202838    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 20:09:37.020858 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:37.020801    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-8abb86/rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq"
Jul 24 20:09:37.020858 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:37.020867    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-8abb86/rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq"
Jul 24 20:09:37.033640 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:37.033607    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-8abb86/rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq"
Jul 24 20:09:37.184349 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:37.184318    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-8abb86/rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq"
Jul 24 20:09:42.738507 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:42.738475    2579 scope.go:117] "RemoveContainer" containerID="1176bdd136e34b47dc081e597742745c5369a9003d7ec22130763fa9c7440334"
Jul 24 20:09:42.746962 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:42.746935    2579 scope.go:117] "RemoveContainer" containerID="b178a6aafdb03dd7955ed637494bf8cf736bd7580e472137f24c48e9e43211b0"
Jul 24 20:09:51.288367 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:51.288334    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-3e15b4/rate-test-model-3e15b4-kserve-597c896ff-j74rp"]
Jul 24 20:09:51.288794 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:51.288692    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4dc9d342-a432-4300-a4fb-a4f1f1911c32" containerName="main"
Jul 24 20:09:51.288794 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:51.288705    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dc9d342-a432-4300-a4fb-a4f1f1911c32" containerName="main"
Jul 24 20:09:51.288886 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:51.288818    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4dc9d342-a432-4300-a4fb-a4f1f1911c32" containerName="main"
Jul 24 20:09:51.291858 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:51.291834    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3e15b4/rate-test-model-3e15b4-kserve-597c896ff-j74rp"
Jul 24 20:09:51.294524 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:51.294500    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-3e15b4\"/\"openshift-service-ca.crt\""
Jul 24 20:09:51.295567 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:51.295543    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-3e15b4\"/\"kube-root-ca.crt\""
Jul 24 20:09:51.295797 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:51.295775    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-3e15b4\"/\"rate-test-model-3e15b4-kserve-self-signed-certs\""
Jul 24 20:09:51.295908 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:51.295552    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-3e15b4\"/\"default-dockercfg-dk8z4\""
Jul 24 20:09:51.302790 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:51.302765    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-3e15b4/rate-test-model-3e15b4-kserve-597c896ff-j74rp"]
Jul 24 20:09:51.477322 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:51.477288    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn46j\" (UniqueName: \"kubernetes.io/projected/d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7-kube-api-access-bn46j\") pod \"rate-test-model-3e15b4-kserve-597c896ff-j74rp\" (UID: \"d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7\") " pod="ai-tenant-e2e-shared-b-3e15b4/rate-test-model-3e15b4-kserve-597c896ff-j74rp"
Jul 24 20:09:51.477485 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:51.477338    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7-dshm\") pod \"rate-test-model-3e15b4-kserve-597c896ff-j74rp\" (UID: \"d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7\") " pod="ai-tenant-e2e-shared-b-3e15b4/rate-test-model-3e15b4-kserve-597c896ff-j74rp"
Jul 24 20:09:51.477485 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:51.477360    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7-model-cache\") pod \"rate-test-model-3e15b4-kserve-597c896ff-j74rp\" (UID: \"d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7\") " pod="ai-tenant-e2e-shared-b-3e15b4/rate-test-model-3e15b4-kserve-597c896ff-j74rp"
Jul 24 20:09:51.477485 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:51.477382    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7-home\") pod \"rate-test-model-3e15b4-kserve-597c896ff-j74rp\" (UID: \"d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7\") " pod="ai-tenant-e2e-shared-b-3e15b4/rate-test-model-3e15b4-kserve-597c896ff-j74rp"
Jul 24 20:09:51.477485 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:51.477410    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7-tmp-dir\") pod \"rate-test-model-3e15b4-kserve-597c896ff-j74rp\" (UID: \"d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7\") " pod="ai-tenant-e2e-shared-b-3e15b4/rate-test-model-3e15b4-kserve-597c896ff-j74rp"
Jul 24 20:09:51.477485 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:51.477464    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7-tls-certs\") pod \"rate-test-model-3e15b4-kserve-597c896ff-j74rp\" (UID: \"d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7\") " pod="ai-tenant-e2e-shared-b-3e15b4/rate-test-model-3e15b4-kserve-597c896ff-j74rp"
Jul 24 20:09:51.578627 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:51.578541    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7-tls-certs\") pod \"rate-test-model-3e15b4-kserve-597c896ff-j74rp\" (UID: \"d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7\") " pod="ai-tenant-e2e-shared-b-3e15b4/rate-test-model-3e15b4-kserve-597c896ff-j74rp"
Jul 24 20:09:51.578627 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:51.578594    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn46j\" (UniqueName: \"kubernetes.io/projected/d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7-kube-api-access-bn46j\") pod \"rate-test-model-3e15b4-kserve-597c896ff-j74rp\" (UID: \"d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7\") " pod="ai-tenant-e2e-shared-b-3e15b4/rate-test-model-3e15b4-kserve-597c896ff-j74rp"
Jul 24 20:09:51.578929 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:51.578630    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7-dshm\") pod \"rate-test-model-3e15b4-kserve-597c896ff-j74rp\" (UID: \"d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7\") " pod="ai-tenant-e2e-shared-b-3e15b4/rate-test-model-3e15b4-kserve-597c896ff-j74rp"
Jul 24 20:09:51.578929 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:51.578648    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7-model-cache\") pod \"rate-test-model-3e15b4-kserve-597c896ff-j74rp\" (UID: \"d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7\") " pod="ai-tenant-e2e-shared-b-3e15b4/rate-test-model-3e15b4-kserve-597c896ff-j74rp"
Jul 24 20:09:51.578929 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:51.578670    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7-home\") pod \"rate-test-model-3e15b4-kserve-597c896ff-j74rp\" (UID: \"d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7\") " pod="ai-tenant-e2e-shared-b-3e15b4/rate-test-model-3e15b4-kserve-597c896ff-j74rp"
Jul 24 20:09:51.578929 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:51.578698    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7-tmp-dir\") pod \"rate-test-model-3e15b4-kserve-597c896ff-j74rp\" (UID: \"d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7\") " pod="ai-tenant-e2e-shared-b-3e15b4/rate-test-model-3e15b4-kserve-597c896ff-j74rp"
Jul 24 20:09:51.579151 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:51.579125    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7-model-cache\") pod \"rate-test-model-3e15b4-kserve-597c896ff-j74rp\" (UID: \"d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7\") " pod="ai-tenant-e2e-shared-b-3e15b4/rate-test-model-3e15b4-kserve-597c896ff-j74rp"
Jul 24 20:09:51.579192 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:51.579169    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7-home\") pod \"rate-test-model-3e15b4-kserve-597c896ff-j74rp\" (UID: \"d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7\") " pod="ai-tenant-e2e-shared-b-3e15b4/rate-test-model-3e15b4-kserve-597c896ff-j74rp"
Jul 24 20:09:51.579234 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:51.579186    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7-tmp-dir\") pod \"rate-test-model-3e15b4-kserve-597c896ff-j74rp\" (UID: \"d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7\") " pod="ai-tenant-e2e-shared-b-3e15b4/rate-test-model-3e15b4-kserve-597c896ff-j74rp"
Jul 24 20:09:51.581097 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:51.581075    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7-dshm\") pod \"rate-test-model-3e15b4-kserve-597c896ff-j74rp\" (UID: \"d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7\") " pod="ai-tenant-e2e-shared-b-3e15b4/rate-test-model-3e15b4-kserve-597c896ff-j74rp"
Jul 24 20:09:51.581252 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:51.581237    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7-tls-certs\") pod \"rate-test-model-3e15b4-kserve-597c896ff-j74rp\" (UID: \"d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7\") " pod="ai-tenant-e2e-shared-b-3e15b4/rate-test-model-3e15b4-kserve-597c896ff-j74rp"
Jul 24 20:09:51.586362 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:51.586338    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn46j\" (UniqueName: \"kubernetes.io/projected/d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7-kube-api-access-bn46j\") pod \"rate-test-model-3e15b4-kserve-597c896ff-j74rp\" (UID: \"d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7\") " pod="ai-tenant-e2e-shared-b-3e15b4/rate-test-model-3e15b4-kserve-597c896ff-j74rp"
Jul 24 20:09:51.603858 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:51.603831    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3e15b4/rate-test-model-3e15b4-kserve-597c896ff-j74rp"
Jul 24 20:09:51.737456 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:51.737425    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-3e15b4/rate-test-model-3e15b4-kserve-597c896ff-j74rp"]
Jul 24 20:09:51.739242 ip-10-0-131-150 kubenswrapper[2579]: W0724 20:09:51.739203    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd38b2d77_3ced_47d8_9dde_d7fbc2b7b2c7.slice/crio-39c44cde4ba00d8ce710e1524b1c88bf0f405e6d1bd002f8662da075ca710daa WatchSource:0}: Error finding container 39c44cde4ba00d8ce710e1524b1c88bf0f405e6d1bd002f8662da075ca710daa: Status 404 returned error can't find the container with id 39c44cde4ba00d8ce710e1524b1c88bf0f405e6d1bd002f8662da075ca710daa
Jul 24 20:09:52.249985 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:52.249952    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3e15b4/rate-test-model-3e15b4-kserve-597c896ff-j74rp" event={"ID":"d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7","Type":"ContainerStarted","Data":"2a7eab9d8479f61180f7dcc61bc3972dbbf892eb542c1d13968d591f9ad95bed"}
Jul 24 20:09:52.250207 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:52.249995    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3e15b4/rate-test-model-3e15b4-kserve-597c896ff-j74rp" event={"ID":"d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7","Type":"ContainerStarted","Data":"39c44cde4ba00d8ce710e1524b1c88bf0f405e6d1bd002f8662da075ca710daa"}
Jul 24 20:09:52.268453 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:52.268389    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-3e15b4/rate-test-model-3e15b4-kserve-597c896ff-j74rp" podStartSLOduration=1.268370221 podStartE2EDuration="1.268370221s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:09:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:09:52.265803882 +0000 UTC m=+2590.454878195" watchObservedRunningTime="2026-07-24 20:09:52.268370221 +0000 UTC m=+2590.457444533"
Jul 24 20:09:54.787183 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:09:54.787149    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 20:10:01.604964 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:01.604931    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-3e15b4/rate-test-model-3e15b4-kserve-597c896ff-j74rp"
Jul 24 20:10:01.605400 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:01.604990    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-3e15b4/rate-test-model-3e15b4-kserve-597c896ff-j74rp"
Jul 24 20:10:01.618015 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:01.617989    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-3e15b4/rate-test-model-3e15b4-kserve-597c896ff-j74rp"
Jul 24 20:10:02.314512 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:02.314484    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-3e15b4/rate-test-model-3e15b4-kserve-597c896ff-j74rp"
Jul 24 20:10:08.969391 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:08.969356    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 20:10:24.890267 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:24.890228    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 20:10:30.867233 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:30.867194    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8abb86/rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq"]
Jul 24 20:10:31.666586 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:31.666543    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-3e15b4/rate-test-model-3e15b4-kserve-597c896ff-j74rp"]
Jul 24 20:10:42.493997 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:42.493963    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 20:10:42.774132 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:42.774099    2579 scope.go:117] "RemoveContainer" containerID="029f94def55f8ec5047b282d3ec491f692186f947e0d30887b667db4cd9b418a"
Jul 24 20:10:42.782826 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:42.782806    2579 scope.go:117] "RemoveContainer" containerID="fd8690973e2a5dead48bb8ea70ef325ebfd68755097b3ad840afe2240432aeeb"
Jul 24 20:10:45.886463 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:45.886395    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-8abb86/rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq" podUID="67551ddb-86be-4cae-a2d3-d79e8c68d93c" containerName="main" containerID="cri-o://9deec24894faa2db0144682338780ae0ab9ddf48f5ef4fcb59932f47d3b3592c" gracePeriod=45
Jul 24 20:10:46.134432 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:46.134404    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8abb86/rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq"
Jul 24 20:10:46.270018 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:46.269989    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67551ddb-86be-4cae-a2d3-d79e8c68d93c-home\") pod \"67551ddb-86be-4cae-a2d3-d79e8c68d93c\" (UID: \"67551ddb-86be-4cae-a2d3-d79e8c68d93c\") "
Jul 24 20:10:46.270214 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:46.270087    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67551ddb-86be-4cae-a2d3-d79e8c68d93c-tls-certs\") pod \"67551ddb-86be-4cae-a2d3-d79e8c68d93c\" (UID: \"67551ddb-86be-4cae-a2d3-d79e8c68d93c\") "
Jul 24 20:10:46.270214 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:46.270117    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67551ddb-86be-4cae-a2d3-d79e8c68d93c-model-cache\") pod \"67551ddb-86be-4cae-a2d3-d79e8c68d93c\" (UID: \"67551ddb-86be-4cae-a2d3-d79e8c68d93c\") "
Jul 24 20:10:46.270214 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:46.270143    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5m7r\" (UniqueName: \"kubernetes.io/projected/67551ddb-86be-4cae-a2d3-d79e8c68d93c-kube-api-access-k5m7r\") pod \"67551ddb-86be-4cae-a2d3-d79e8c68d93c\" (UID: \"67551ddb-86be-4cae-a2d3-d79e8c68d93c\") "
Jul 24 20:10:46.270214 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:46.270171    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67551ddb-86be-4cae-a2d3-d79e8c68d93c-tmp-dir\") pod \"67551ddb-86be-4cae-a2d3-d79e8c68d93c\" (UID: \"67551ddb-86be-4cae-a2d3-d79e8c68d93c\") "
Jul 24 20:10:46.270214 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:46.270214    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67551ddb-86be-4cae-a2d3-d79e8c68d93c-dshm\") pod \"67551ddb-86be-4cae-a2d3-d79e8c68d93c\" (UID: \"67551ddb-86be-4cae-a2d3-d79e8c68d93c\") "
Jul 24 20:10:46.270492 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:46.270289    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67551ddb-86be-4cae-a2d3-d79e8c68d93c-home" (OuterVolumeSpecName: "home") pod "67551ddb-86be-4cae-a2d3-d79e8c68d93c" (UID: "67551ddb-86be-4cae-a2d3-d79e8c68d93c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:10:46.270492 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:46.270419    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67551ddb-86be-4cae-a2d3-d79e8c68d93c-model-cache" (OuterVolumeSpecName: "model-cache") pod "67551ddb-86be-4cae-a2d3-d79e8c68d93c" (UID: "67551ddb-86be-4cae-a2d3-d79e8c68d93c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:10:46.270492 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:46.270433    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67551ddb-86be-4cae-a2d3-d79e8c68d93c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "67551ddb-86be-4cae-a2d3-d79e8c68d93c" (UID: "67551ddb-86be-4cae-a2d3-d79e8c68d93c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:10:46.270625 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:46.270562    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67551ddb-86be-4cae-a2d3-d79e8c68d93c-model-cache\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:10:46.270625 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:46.270580    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67551ddb-86be-4cae-a2d3-d79e8c68d93c-tmp-dir\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:10:46.270625 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:46.270589    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67551ddb-86be-4cae-a2d3-d79e8c68d93c-home\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:10:46.272547 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:46.272518    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67551ddb-86be-4cae-a2d3-d79e8c68d93c-kube-api-access-k5m7r" (OuterVolumeSpecName: "kube-api-access-k5m7r") pod "67551ddb-86be-4cae-a2d3-d79e8c68d93c" (UID: "67551ddb-86be-4cae-a2d3-d79e8c68d93c"). InnerVolumeSpecName "kube-api-access-k5m7r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:10:46.272678 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:46.272546    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67551ddb-86be-4cae-a2d3-d79e8c68d93c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "67551ddb-86be-4cae-a2d3-d79e8c68d93c" (UID: "67551ddb-86be-4cae-a2d3-d79e8c68d93c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 20:10:46.272678 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:46.272622    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67551ddb-86be-4cae-a2d3-d79e8c68d93c-dshm" (OuterVolumeSpecName: "dshm") pod "67551ddb-86be-4cae-a2d3-d79e8c68d93c" (UID: "67551ddb-86be-4cae-a2d3-d79e8c68d93c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:10:46.371444 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:46.371408    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67551ddb-86be-4cae-a2d3-d79e8c68d93c-tls-certs\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:10:46.371444 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:46.371446    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5m7r\" (UniqueName: \"kubernetes.io/projected/67551ddb-86be-4cae-a2d3-d79e8c68d93c-kube-api-access-k5m7r\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:10:46.371663 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:46.371462    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67551ddb-86be-4cae-a2d3-d79e8c68d93c-dshm\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:10:46.535090 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:46.534994    2579 generic.go:356] "Generic (PLEG): container finished" podID="67551ddb-86be-4cae-a2d3-d79e8c68d93c" containerID="9deec24894faa2db0144682338780ae0ab9ddf48f5ef4fcb59932f47d3b3592c" exitCode=0
Jul 24 20:10:46.535090 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:46.535046    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8abb86/rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq"
Jul 24 20:10:46.535272 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:46.535086    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8abb86/rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq" event={"ID":"67551ddb-86be-4cae-a2d3-d79e8c68d93c","Type":"ContainerDied","Data":"9deec24894faa2db0144682338780ae0ab9ddf48f5ef4fcb59932f47d3b3592c"}
Jul 24 20:10:46.535272 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:46.535128    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8abb86/rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq" event={"ID":"67551ddb-86be-4cae-a2d3-d79e8c68d93c","Type":"ContainerDied","Data":"6966efbfaf474d9a7b30c2ab621786daeed29e2400f924cbe0bfad6079350b1f"}
Jul 24 20:10:46.535272 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:46.535145    2579 scope.go:117] "RemoveContainer" containerID="9deec24894faa2db0144682338780ae0ab9ddf48f5ef4fcb59932f47d3b3592c"
Jul 24 20:10:46.543564 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:46.543542    2579 scope.go:117] "RemoveContainer" containerID="9deec24894faa2db0144682338780ae0ab9ddf48f5ef4fcb59932f47d3b3592c"
Jul 24 20:10:46.543846 ip-10-0-131-150 kubenswrapper[2579]: E0724 20:10:46.543826    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9deec24894faa2db0144682338780ae0ab9ddf48f5ef4fcb59932f47d3b3592c\": container with ID starting with 9deec24894faa2db0144682338780ae0ab9ddf48f5ef4fcb59932f47d3b3592c not found: ID does not exist" containerID="9deec24894faa2db0144682338780ae0ab9ddf48f5ef4fcb59932f47d3b3592c"
Jul 24 20:10:46.543935 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:46.543855    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9deec24894faa2db0144682338780ae0ab9ddf48f5ef4fcb59932f47d3b3592c"} err="failed to get container status \"9deec24894faa2db0144682338780ae0ab9ddf48f5ef4fcb59932f47d3b3592c\": rpc error: code = NotFound desc = could not find container \"9deec24894faa2db0144682338780ae0ab9ddf48f5ef4fcb59932f47d3b3592c\": container with ID starting with 9deec24894faa2db0144682338780ae0ab9ddf48f5ef4fcb59932f47d3b3592c not found: ID does not exist"
Jul 24 20:10:46.550705 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:46.550679    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8abb86/rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq"]
Jul 24 20:10:46.554790 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:46.554769    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-8abb86/rate-test-model-8abb86-kserve-75bb8ff7f9-pfkcq"]
Jul 24 20:10:46.687173 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:46.687127    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-3e15b4/rate-test-model-3e15b4-kserve-597c896ff-j74rp" podUID="d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7" containerName="main" containerID="cri-o://2a7eab9d8479f61180f7dcc61bc3972dbbf892eb542c1d13968d591f9ad95bed" gracePeriod=45
Jul 24 20:10:46.939331 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:46.939307    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3e15b4/rate-test-model-3e15b4-kserve-597c896ff-j74rp"
Jul 24 20:10:47.077753 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:47.077633    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bn46j\" (UniqueName: \"kubernetes.io/projected/d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7-kube-api-access-bn46j\") pod \"d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7\" (UID: \"d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7\") "
Jul 24 20:10:47.077753 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:47.077678    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7-model-cache\") pod \"d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7\" (UID: \"d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7\") "
Jul 24 20:10:47.077753 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:47.077699    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7-home\") pod \"d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7\" (UID: \"d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7\") "
Jul 24 20:10:47.078060 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:47.077788    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7-tmp-dir\") pod \"d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7\" (UID: \"d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7\") "
Jul 24 20:10:47.078060 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:47.077807    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7-tls-certs\") pod \"d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7\" (UID: \"d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7\") "
Jul 24 20:10:47.078060 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:47.077831    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7-dshm\") pod \"d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7\" (UID: \"d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7\") "
Jul 24 20:10:47.078060 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:47.077966    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7-home" (OuterVolumeSpecName: "home") pod "d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7" (UID: "d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:10:47.078060 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:47.078012    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7-model-cache" (OuterVolumeSpecName: "model-cache") pod "d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7" (UID: "d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:10:47.078060 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:47.078044    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7" (UID: "d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:10:47.078322 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:47.078099    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7-model-cache\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:10:47.078322 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:47.078111    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7-home\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:10:47.080052 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:47.080020    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7-dshm" (OuterVolumeSpecName: "dshm") pod "d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7" (UID: "d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:10:47.080052 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:47.080030    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7" (UID: "d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 20:10:47.080052 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:47.080038    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7-kube-api-access-bn46j" (OuterVolumeSpecName: "kube-api-access-bn46j") pod "d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7" (UID: "d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7"). InnerVolumeSpecName "kube-api-access-bn46j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:10:47.179419 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:47.179378    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7-dshm\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:10:47.179419 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:47.179410    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bn46j\" (UniqueName: \"kubernetes.io/projected/d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7-kube-api-access-bn46j\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:10:47.179419 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:47.179421    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7-tmp-dir\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:10:47.179419 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:47.179431    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7-tls-certs\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:10:47.542195 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:47.542160    2579 generic.go:356] "Generic (PLEG): container finished" podID="d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7" containerID="2a7eab9d8479f61180f7dcc61bc3972dbbf892eb542c1d13968d591f9ad95bed" exitCode=0
Jul 24 20:10:47.542386 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:47.542205    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3e15b4/rate-test-model-3e15b4-kserve-597c896ff-j74rp"
Jul 24 20:10:47.542386 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:47.542244    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3e15b4/rate-test-model-3e15b4-kserve-597c896ff-j74rp" event={"ID":"d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7","Type":"ContainerDied","Data":"2a7eab9d8479f61180f7dcc61bc3972dbbf892eb542c1d13968d591f9ad95bed"}
Jul 24 20:10:47.542386 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:47.542287    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3e15b4/rate-test-model-3e15b4-kserve-597c896ff-j74rp" event={"ID":"d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7","Type":"ContainerDied","Data":"39c44cde4ba00d8ce710e1524b1c88bf0f405e6d1bd002f8662da075ca710daa"}
Jul 24 20:10:47.542386 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:47.542310    2579 scope.go:117] "RemoveContainer" containerID="2a7eab9d8479f61180f7dcc61bc3972dbbf892eb542c1d13968d591f9ad95bed"
Jul 24 20:10:47.552349 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:47.552331    2579 scope.go:117] "RemoveContainer" containerID="2a7eab9d8479f61180f7dcc61bc3972dbbf892eb542c1d13968d591f9ad95bed"
Jul 24 20:10:47.552667 ip-10-0-131-150 kubenswrapper[2579]: E0724 20:10:47.552648    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a7eab9d8479f61180f7dcc61bc3972dbbf892eb542c1d13968d591f9ad95bed\": container with ID starting with 2a7eab9d8479f61180f7dcc61bc3972dbbf892eb542c1d13968d591f9ad95bed not found: ID does not exist" containerID="2a7eab9d8479f61180f7dcc61bc3972dbbf892eb542c1d13968d591f9ad95bed"
Jul 24 20:10:47.552758 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:47.552675    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a7eab9d8479f61180f7dcc61bc3972dbbf892eb542c1d13968d591f9ad95bed"} err="failed to get container status \"2a7eab9d8479f61180f7dcc61bc3972dbbf892eb542c1d13968d591f9ad95bed\": rpc error: code = NotFound desc = could not find container \"2a7eab9d8479f61180f7dcc61bc3972dbbf892eb542c1d13968d591f9ad95bed\": container with ID starting with 2a7eab9d8479f61180f7dcc61bc3972dbbf892eb542c1d13968d591f9ad95bed not found: ID does not exist"
Jul 24 20:10:47.563802 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:47.563775    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-3e15b4/rate-test-model-3e15b4-kserve-597c896ff-j74rp"]
Jul 24 20:10:47.568027 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:47.568002    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-3e15b4/rate-test-model-3e15b4-kserve-597c896ff-j74rp"]
Jul 24 20:10:48.368120 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:48.368084    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67551ddb-86be-4cae-a2d3-d79e8c68d93c" path="/var/lib/kubelet/pods/67551ddb-86be-4cae-a2d3-d79e8c68d93c/volumes"
Jul 24 20:10:48.368573 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:48.368460    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7" path="/var/lib/kubelet/pods/d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7/volumes"
Jul 24 20:10:55.896746 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:55.896684    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-11ccc9-745465fb5b-lqrdb"]
Jul 24 20:10:55.897141 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:55.897075    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67551ddb-86be-4cae-a2d3-d79e8c68d93c" containerName="main"
Jul 24 20:10:55.897141 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:55.897087    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="67551ddb-86be-4cae-a2d3-d79e8c68d93c" containerName="main"
Jul 24 20:10:55.897141 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:55.897103    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7" containerName="main"
Jul 24 20:10:55.897141 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:55.897109    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7" containerName="main"
Jul 24 20:10:55.897281 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:55.897171    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="67551ddb-86be-4cae-a2d3-d79e8c68d93c" containerName="main"
Jul 24 20:10:55.897281 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:55.897181    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d38b2d77-3ced-47d8-9dde-d7fbc2b7b2c7" containerName="main"
Jul 24 20:10:55.900112 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:55.900093    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-11ccc9-745465fb5b-lqrdb"
Jul 24 20:10:55.902693 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:55.902673    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-11ccc9-serving-cert\""
Jul 24 20:10:55.911472 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:55.911445    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-11ccc9-745465fb5b-lqrdb"]
Jul 24 20:10:55.959881 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:55.959846    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f754280-894e-401d-a550-2f8cfa56d884-maas-api-tls\") pod \"maas-api-e2e-ipp-a-11ccc9-745465fb5b-lqrdb\" (UID: \"9f754280-894e-401d-a550-2f8cfa56d884\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-11ccc9-745465fb5b-lqrdb"
Jul 24 20:10:55.960060 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:55.959899    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2554\" (UniqueName: \"kubernetes.io/projected/9f754280-894e-401d-a550-2f8cfa56d884-kube-api-access-g2554\") pod \"maas-api-e2e-ipp-a-11ccc9-745465fb5b-lqrdb\" (UID: \"9f754280-894e-401d-a550-2f8cfa56d884\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-11ccc9-745465fb5b-lqrdb"
Jul 24 20:10:55.960060 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:55.959916    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f754280-894e-401d-a550-2f8cfa56d884-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-11ccc9-745465fb5b-lqrdb\" (UID: \"9f754280-894e-401d-a550-2f8cfa56d884\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-11ccc9-745465fb5b-lqrdb"
Jul 24 20:10:56.061148 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:56.061117    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f754280-894e-401d-a550-2f8cfa56d884-maas-api-tls\") pod \"maas-api-e2e-ipp-a-11ccc9-745465fb5b-lqrdb\" (UID: \"9f754280-894e-401d-a550-2f8cfa56d884\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-11ccc9-745465fb5b-lqrdb"
Jul 24 20:10:56.061518 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:56.061164    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2554\" (UniqueName: \"kubernetes.io/projected/9f754280-894e-401d-a550-2f8cfa56d884-kube-api-access-g2554\") pod \"maas-api-e2e-ipp-a-11ccc9-745465fb5b-lqrdb\" (UID: \"9f754280-894e-401d-a550-2f8cfa56d884\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-11ccc9-745465fb5b-lqrdb"
Jul 24 20:10:56.061518 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:56.061184    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f754280-894e-401d-a550-2f8cfa56d884-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-11ccc9-745465fb5b-lqrdb\" (UID: \"9f754280-894e-401d-a550-2f8cfa56d884\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-11ccc9-745465fb5b-lqrdb"
Jul 24 20:10:56.062051 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:56.062025    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f754280-894e-401d-a550-2f8cfa56d884-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-11ccc9-745465fb5b-lqrdb\" (UID: \"9f754280-894e-401d-a550-2f8cfa56d884\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-11ccc9-745465fb5b-lqrdb"
Jul 24 20:10:56.063790 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:56.063773    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f754280-894e-401d-a550-2f8cfa56d884-maas-api-tls\") pod \"maas-api-e2e-ipp-a-11ccc9-745465fb5b-lqrdb\" (UID: \"9f754280-894e-401d-a550-2f8cfa56d884\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-11ccc9-745465fb5b-lqrdb"
Jul 24 20:10:56.068682 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:56.068665    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2554\" (UniqueName: \"kubernetes.io/projected/9f754280-894e-401d-a550-2f8cfa56d884-kube-api-access-g2554\") pod \"maas-api-e2e-ipp-a-11ccc9-745465fb5b-lqrdb\" (UID: \"9f754280-894e-401d-a550-2f8cfa56d884\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-11ccc9-745465fb5b-lqrdb"
Jul 24 20:10:56.211147 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:56.211061    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-11ccc9-745465fb5b-lqrdb"
Jul 24 20:10:56.348304 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:56.348273    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-11ccc9-745465fb5b-lqrdb"]
Jul 24 20:10:56.349976 ip-10-0-131-150 kubenswrapper[2579]: W0724 20:10:56.349952    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f754280_894e_401d_a550_2f8cfa56d884.slice/crio-45b60c2e9eda57304079c0a871f736c40676b047e559306da0d01d5ff81ce65f WatchSource:0}: Error finding container 45b60c2e9eda57304079c0a871f736c40676b047e559306da0d01d5ff81ce65f: Status 404 returned error can't find the container with id 45b60c2e9eda57304079c0a871f736c40676b047e559306da0d01d5ff81ce65f
Jul 24 20:10:56.351328 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:56.351312    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 20:10:56.593480 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:56.593441    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-11ccc9-745465fb5b-lqrdb" event={"ID":"9f754280-894e-401d-a550-2f8cfa56d884","Type":"ContainerStarted","Data":"45b60c2e9eda57304079c0a871f736c40676b047e559306da0d01d5ff81ce65f"}
Jul 24 20:10:57.600263 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:57.600228    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-11ccc9-745465fb5b-lqrdb" event={"ID":"9f754280-894e-401d-a550-2f8cfa56d884","Type":"ContainerStarted","Data":"a759e66d28c1aacf5e01342e19c1d0a783d55915758c603650c227fa6dd44725"}
Jul 24 20:10:57.600695 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:57.600345    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-11ccc9-745465fb5b-lqrdb"
Jul 24 20:10:57.619664 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:10:57.619612    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-11ccc9-745465fb5b-lqrdb" podStartSLOduration=2.090639465 podStartE2EDuration="2.619597366s" totalImagesPullingTime="528.957901ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:10:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:10:57.617148629 +0000 UTC m=+2655.806222956" watchObservedRunningTime="2026-07-24 20:10:57.619597366 +0000 UTC m=+2655.808671679"
Jul 24 20:11:03.610521 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:03.610486    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-11ccc9-745465fb5b-lqrdb"
Jul 24 20:11:04.185549 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:04.185510    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 20:11:10.485887 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:10.485848    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w"]
Jul 24 20:11:10.493676 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:10.493650    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w"
Jul 24 20:11:10.496073 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:10.496049    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-75b982-openshift-default-dockercfg-q226p\""
Jul 24 20:11:10.500048 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:10.500023    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w"]
Jul 24 20:11:10.591385 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:10.591351    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-credential-socket\") pod \"e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w\" (UID: \"a6907d32-9ab2-44cd-8d8d-0c350dd755a7\") " pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w"
Jul 24 20:11:10.591385 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:10.591385    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-istio-podinfo\") pod \"e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w\" (UID: \"a6907d32-9ab2-44cd-8d8d-0c350dd755a7\") " pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w"
Jul 24 20:11:10.591600 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:10.591416    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-workload-certs\") pod \"e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w\" (UID: \"a6907d32-9ab2-44cd-8d8d-0c350dd755a7\") " pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w"
Jul 24 20:11:10.591600 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:10.591434    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-istiod-ca-cert\") pod \"e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w\" (UID: \"a6907d32-9ab2-44cd-8d8d-0c350dd755a7\") " pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w"
Jul 24 20:11:10.591600 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:10.591466    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-istio-data\") pod \"e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w\" (UID: \"a6907d32-9ab2-44cd-8d8d-0c350dd755a7\") " pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w"
Jul 24 20:11:10.591600 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:10.591487    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-istio-envoy\") pod \"e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w\" (UID: \"a6907d32-9ab2-44cd-8d8d-0c350dd755a7\") " pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w"
Jul 24 20:11:10.591600 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:10.591506    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-workload-socket\") pod \"e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w\" (UID: \"a6907d32-9ab2-44cd-8d8d-0c350dd755a7\") " pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w"
Jul 24 20:11:10.591600 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:10.591522    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-istio-token\") pod \"e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w\" (UID: \"a6907d32-9ab2-44cd-8d8d-0c350dd755a7\") " pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w"
Jul 24 20:11:10.591600 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:10.591540    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x56vl\" (UniqueName: \"kubernetes.io/projected/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-kube-api-access-x56vl\") pod \"e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w\" (UID: \"a6907d32-9ab2-44cd-8d8d-0c350dd755a7\") " pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w"
Jul 24 20:11:10.692307 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:10.692263    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-credential-socket\") pod \"e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w\" (UID: \"a6907d32-9ab2-44cd-8d8d-0c350dd755a7\") " pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w"
Jul 24 20:11:10.692307 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:10.692301    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-istio-podinfo\") pod \"e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w\" (UID: \"a6907d32-9ab2-44cd-8d8d-0c350dd755a7\") " pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w"
Jul 24 20:11:10.692571 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:10.692325    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-workload-certs\") pod \"e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w\" (UID: \"a6907d32-9ab2-44cd-8d8d-0c350dd755a7\") " pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w"
Jul 24 20:11:10.692571 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:10.692352    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-istiod-ca-cert\") pod \"e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w\" (UID: \"a6907d32-9ab2-44cd-8d8d-0c350dd755a7\") " pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w"
Jul 24 20:11:10.692571 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:10.692376    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-istio-data\") pod \"e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w\" (UID: \"a6907d32-9ab2-44cd-8d8d-0c350dd755a7\") " pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w"
Jul 24 20:11:10.692571 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:10.692507    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-istio-envoy\") pod \"e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w\" (UID: \"a6907d32-9ab2-44cd-8d8d-0c350dd755a7\") " pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w"
Jul 24 20:11:10.692571 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:10.692544    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-workload-socket\") pod \"e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w\" (UID: \"a6907d32-9ab2-44cd-8d8d-0c350dd755a7\") " pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w"
Jul 24 20:11:10.692571 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:10.692564    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-istio-token\") pod \"e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w\" (UID: \"a6907d32-9ab2-44cd-8d8d-0c350dd755a7\") " pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w"
Jul 24 20:11:10.693133 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:10.692589    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x56vl\" (UniqueName: \"kubernetes.io/projected/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-kube-api-access-x56vl\") pod \"e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w\" (UID: \"a6907d32-9ab2-44cd-8d8d-0c350dd755a7\") " pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w"
Jul 24 20:11:10.693133 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:10.692787    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-workload-certs\") pod \"e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w\" (UID: \"a6907d32-9ab2-44cd-8d8d-0c350dd755a7\") " pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w"
Jul 24 20:11:10.693133 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:10.693015    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-workload-socket\") pod \"e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w\" (UID: \"a6907d32-9ab2-44cd-8d8d-0c350dd755a7\") " pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w"
Jul 24 20:11:10.693326 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:10.693191    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-credential-socket\") pod \"e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w\" (UID: \"a6907d32-9ab2-44cd-8d8d-0c350dd755a7\") " pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w"
Jul 24 20:11:10.693326 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:10.693267    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-istio-data\") pod \"e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w\" (UID: \"a6907d32-9ab2-44cd-8d8d-0c350dd755a7\") " pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w"
Jul 24 20:11:10.693424 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:10.693322    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-istiod-ca-cert\") pod \"e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w\" (UID: \"a6907d32-9ab2-44cd-8d8d-0c350dd755a7\") " pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w"
Jul 24 20:11:10.695303 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:10.695280    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-istio-envoy\") pod \"e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w\" (UID: \"a6907d32-9ab2-44cd-8d8d-0c350dd755a7\") " pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w"
Jul 24 20:11:10.695412 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:10.695332    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-istio-podinfo\") pod \"e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w\" (UID: \"a6907d32-9ab2-44cd-8d8d-0c350dd755a7\") " pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w"
Jul 24 20:11:10.704434 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:10.704406    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-istio-token\") pod \"e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w\" (UID: \"a6907d32-9ab2-44cd-8d8d-0c350dd755a7\") " pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w"
Jul 24 20:11:10.704569 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:10.704511    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x56vl\" (UniqueName: \"kubernetes.io/projected/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-kube-api-access-x56vl\") pod \"e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w\" (UID: \"a6907d32-9ab2-44cd-8d8d-0c350dd755a7\") " pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w"
Jul 24 20:11:10.806304 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:10.806265    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w"
Jul 24 20:11:10.980089 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:10.980064    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w"]
Jul 24 20:11:10.981463 ip-10-0-131-150 kubenswrapper[2579]: W0724 20:11:10.981439    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6907d32_9ab2_44cd_8d8d_0c350dd755a7.slice/crio-3cfe001948a88e3b18efe4a9f39c9cee9f9fe1cf43e492d57dcdf246140151fe WatchSource:0}: Error finding container 3cfe001948a88e3b18efe4a9f39c9cee9f9fe1cf43e492d57dcdf246140151fe: Status 404 returned error can't find the container with id 3cfe001948a88e3b18efe4a9f39c9cee9f9fe1cf43e492d57dcdf246140151fe
Jul 24 20:11:11.668339 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:11.668304    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w" event={"ID":"a6907d32-9ab2-44cd-8d8d-0c350dd755a7","Type":"ContainerStarted","Data":"3cfe001948a88e3b18efe4a9f39c9cee9f9fe1cf43e492d57dcdf246140151fe"}
Jul 24 20:11:14.454701 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:14.454665    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 20:11:14.455003 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:14.454767    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 20:11:14.455003 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:14.454804    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 20:11:14.688662 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:14.688621    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w" event={"ID":"a6907d32-9ab2-44cd-8d8d-0c350dd755a7","Type":"ContainerStarted","Data":"0358c3081d5c2080ace6adeb3dbe3bc279bf6358d6512650357c55cd1ef4d311"}
Jul 24 20:11:14.708757 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:14.708573    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w" podStartSLOduration=1.237587541 podStartE2EDuration="4.708554156s" totalImagesPullingTime="3.470966615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:11:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:11:14.707841803 +0000 UTC m=+2672.896916140" watchObservedRunningTime="2026-07-24 20:11:14.708554156 +0000 UTC m=+2672.897628470"
Jul 24 20:11:14.806988 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:14.806953    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w"
Jul 24 20:11:15.812758 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:15.812700    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w"
Jul 24 20:11:16.698869 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:16.698840    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w"
Jul 24 20:11:16.699750 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:16.699716    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w"
Jul 24 20:11:18.549125 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:18.549085    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-75b982-5df486bfd8-mm9sj"]
Jul 24 20:11:18.553416 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:18.553393    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-75b982-5df486bfd8-mm9sj"
Jul 24 20:11:18.556314 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:18.556291    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-75b982-serving-cert\""
Jul 24 20:11:18.564039 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:18.564014    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-75b982-5df486bfd8-mm9sj"]
Jul 24 20:11:18.665925 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:18.665885    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c403be60-25ed-4f3f-824f-a84bdc3a90bd-maas-api-tls\") pod \"maas-api-e2e-ipp-b-75b982-5df486bfd8-mm9sj\" (UID: \"c403be60-25ed-4f3f-824f-a84bdc3a90bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-75b982-5df486bfd8-mm9sj"
Jul 24 20:11:18.665925 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:18.665925    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c403be60-25ed-4f3f-824f-a84bdc3a90bd-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-75b982-5df486bfd8-mm9sj\" (UID: \"c403be60-25ed-4f3f-824f-a84bdc3a90bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-75b982-5df486bfd8-mm9sj"
Jul 24 20:11:18.666135 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:18.666032    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrrpt\" (UniqueName: \"kubernetes.io/projected/c403be60-25ed-4f3f-824f-a84bdc3a90bd-kube-api-access-hrrpt\") pod \"maas-api-e2e-ipp-b-75b982-5df486bfd8-mm9sj\" (UID: \"c403be60-25ed-4f3f-824f-a84bdc3a90bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-75b982-5df486bfd8-mm9sj"
Jul 24 20:11:18.766801 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:18.766763    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrrpt\" (UniqueName: \"kubernetes.io/projected/c403be60-25ed-4f3f-824f-a84bdc3a90bd-kube-api-access-hrrpt\") pod \"maas-api-e2e-ipp-b-75b982-5df486bfd8-mm9sj\" (UID: \"c403be60-25ed-4f3f-824f-a84bdc3a90bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-75b982-5df486bfd8-mm9sj"
Jul 24 20:11:18.766976 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:18.766841    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c403be60-25ed-4f3f-824f-a84bdc3a90bd-maas-api-tls\") pod \"maas-api-e2e-ipp-b-75b982-5df486bfd8-mm9sj\" (UID: \"c403be60-25ed-4f3f-824f-a84bdc3a90bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-75b982-5df486bfd8-mm9sj"
Jul 24 20:11:18.766976 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:18.766862    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c403be60-25ed-4f3f-824f-a84bdc3a90bd-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-75b982-5df486bfd8-mm9sj\" (UID: \"c403be60-25ed-4f3f-824f-a84bdc3a90bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-75b982-5df486bfd8-mm9sj"
Jul 24 20:11:18.767053 ip-10-0-131-150 kubenswrapper[2579]: E0724 20:11:18.766997    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-75b982-serving-cert: secret "maas-api-e2e-ipp-b-75b982-serving-cert" not found
Jul 24 20:11:18.767089 ip-10-0-131-150 kubenswrapper[2579]: E0724 20:11:18.767083    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c403be60-25ed-4f3f-824f-a84bdc3a90bd-maas-api-tls podName:c403be60-25ed-4f3f-824f-a84bdc3a90bd nodeName:}" failed. No retries permitted until 2026-07-24 20:11:19.267062995 +0000 UTC m=+2677.456137295 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c403be60-25ed-4f3f-824f-a84bdc3a90bd-maas-api-tls") pod "maas-api-e2e-ipp-b-75b982-5df486bfd8-mm9sj" (UID: "c403be60-25ed-4f3f-824f-a84bdc3a90bd") : secret "maas-api-e2e-ipp-b-75b982-serving-cert" not found
Jul 24 20:11:18.767423 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:18.767406    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c403be60-25ed-4f3f-824f-a84bdc3a90bd-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-75b982-5df486bfd8-mm9sj\" (UID: \"c403be60-25ed-4f3f-824f-a84bdc3a90bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-75b982-5df486bfd8-mm9sj"
Jul 24 20:11:18.776513 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:18.776490    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrrpt\" (UniqueName: \"kubernetes.io/projected/c403be60-25ed-4f3f-824f-a84bdc3a90bd-kube-api-access-hrrpt\") pod \"maas-api-e2e-ipp-b-75b982-5df486bfd8-mm9sj\" (UID: \"c403be60-25ed-4f3f-824f-a84bdc3a90bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-75b982-5df486bfd8-mm9sj"
Jul 24 20:11:19.271645 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:19.271614    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c403be60-25ed-4f3f-824f-a84bdc3a90bd-maas-api-tls\") pod \"maas-api-e2e-ipp-b-75b982-5df486bfd8-mm9sj\" (UID: \"c403be60-25ed-4f3f-824f-a84bdc3a90bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-75b982-5df486bfd8-mm9sj"
Jul 24 20:11:19.274424 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:19.274382    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c403be60-25ed-4f3f-824f-a84bdc3a90bd-maas-api-tls\") pod \"maas-api-e2e-ipp-b-75b982-5df486bfd8-mm9sj\" (UID: \"c403be60-25ed-4f3f-824f-a84bdc3a90bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-75b982-5df486bfd8-mm9sj"
Jul 24 20:11:19.464812 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:19.464781    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-75b982-5df486bfd8-mm9sj"
Jul 24 20:11:19.604169 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:19.603940    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-75b982-5df486bfd8-mm9sj"]
Jul 24 20:11:19.606596 ip-10-0-131-150 kubenswrapper[2579]: W0724 20:11:19.606563    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc403be60_25ed_4f3f_824f_a84bdc3a90bd.slice/crio-7ccd47643685a27a18de9d369cbbc30647e52180d22daf68534684ceee928805 WatchSource:0}: Error finding container 7ccd47643685a27a18de9d369cbbc30647e52180d22daf68534684ceee928805: Status 404 returned error can't find the container with id 7ccd47643685a27a18de9d369cbbc30647e52180d22daf68534684ceee928805
Jul 24 20:11:19.721286 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:19.721256    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-75b982-5df486bfd8-mm9sj" event={"ID":"c403be60-25ed-4f3f-824f-a84bdc3a90bd","Type":"ContainerStarted","Data":"7ccd47643685a27a18de9d369cbbc30647e52180d22daf68534684ceee928805"}
Jul 24 20:11:20.728042 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:20.728003    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-75b982-5df486bfd8-mm9sj" event={"ID":"c403be60-25ed-4f3f-824f-a84bdc3a90bd","Type":"ContainerStarted","Data":"097afc10b4598efc93d33d1eabae459bff807bb2596c4f071a32f3423c0f767d"}
Jul 24 20:11:20.728442 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:20.728119    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-75b982-5df486bfd8-mm9sj"
Jul 24 20:11:20.748236 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:20.748186    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-75b982-5df486bfd8-mm9sj" podStartSLOduration=2.409651379 podStartE2EDuration="2.748171825s" totalImagesPullingTime="338.520446ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:11:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:11:20.745187386 +0000 UTC m=+2678.934261699" watchObservedRunningTime="2026-07-24 20:11:20.748171825 +0000 UTC m=+2678.937246138"
Jul 24 20:11:25.993404 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:25.989885    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 20:11:26.738260 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:26.738234    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-75b982-5df486bfd8-mm9sj"
Jul 24 20:11:32.739958 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:32.739875    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 24 20:11:32.740343 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:32.739966    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w" podUID="a6907d32-9ab2-44cd-8d8d-0c350dd755a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 24 20:11:34.822569 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:34.822535    2579 generic.go:356] "Generic (PLEG): container finished" podID="a6907d32-9ab2-44cd-8d8d-0c350dd755a7" containerID="0358c3081d5c2080ace6adeb3dbe3bc279bf6358d6512650357c55cd1ef4d311" exitCode=0
Jul 24 20:11:34.822569 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:34.822574    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w" event={"ID":"a6907d32-9ab2-44cd-8d8d-0c350dd755a7","Type":"ContainerDied","Data":"0358c3081d5c2080ace6adeb3dbe3bc279bf6358d6512650357c55cd1ef4d311"}
Jul 24 20:11:34.823056 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:34.823004    2579 scope.go:117] "RemoveContainer" containerID="0358c3081d5c2080ace6adeb3dbe3bc279bf6358d6512650357c55cd1ef4d311"
Jul 24 20:11:34.824996 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:34.824958    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 20:11:34.825086 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:34.825033    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 20:11:34.825086 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:34.825065    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 20:11:35.829767 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:35.829703    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w" event={"ID":"a6907d32-9ab2-44cd-8d8d-0c350dd755a7","Type":"ContainerStarted","Data":"30dfa61ef74f9ff538e90ffd6c524a1c826b09c9012c69970be25bf6636fbabb"}
Jul 24 20:11:36.806514 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:36.806473    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w"
Jul 24 20:11:36.806812 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:36.806786    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 24 20:11:36.806910 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:36.806844    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w" podUID="a6907d32-9ab2-44cd-8d8d-0c350dd755a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 24 20:11:37.807211 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:37.807178    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 24 20:11:37.807606 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:37.807242    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w" podUID="a6907d32-9ab2-44cd-8d8d-0c350dd755a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 24 20:11:38.806948 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:38.806909    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 24 20:11:38.807140 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:38.806979    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w" podUID="a6907d32-9ab2-44cd-8d8d-0c350dd755a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 24 20:11:39.810892 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:39.810864    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w"
Jul 24 20:11:39.811338 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:39.811204    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w"
Jul 24 20:11:39.811965 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:39.811945    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w"
Jul 24 20:11:42.525276 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:42.525245    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vclnd_fa8789c9-6c39-46cd-a540-657dea710eb8/ovn-acl-logging/0.log"
Jul 24 20:11:42.533753 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:11:42.533712    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vclnd_fa8789c9-6c39-46cd-a540-657dea710eb8/ovn-acl-logging/0.log"
Jul 24 20:12:02.214712 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:02.214678    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-11ccc9/ipp-route-11ccc9-kserve-58bbf89f79-7fs7z"]
Jul 24 20:12:02.218519 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:02.218489    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-11ccc9/ipp-route-11ccc9-kserve-58bbf89f79-7fs7z"
Jul 24 20:12:02.222147 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:02.222119    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-11ccc9\"/\"openshift-service-ca.crt\""
Jul 24 20:12:02.222294 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:02.222183    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-11ccc9\"/\"default-dockercfg-jsqjf\""
Jul 24 20:12:02.222294 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:02.222271    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-11ccc9\"/\"ipp-route-11ccc9-kserve-self-signed-certs\""
Jul 24 20:12:02.222389 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:02.222306    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-11ccc9\"/\"kube-root-ca.crt\""
Jul 24 20:12:02.228752 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:02.228694    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-11ccc9/ipp-route-11ccc9-kserve-58bbf89f79-7fs7z"]
Jul 24 20:12:02.388654 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:02.388612    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cabb70a4-f405-4438-9115-7c0cea27a023-tmp-dir\") pod \"ipp-route-11ccc9-kserve-58bbf89f79-7fs7z\" (UID: \"cabb70a4-f405-4438-9115-7c0cea27a023\") " pod="ai-tenant-e2e-ipp-a-11ccc9/ipp-route-11ccc9-kserve-58bbf89f79-7fs7z"
Jul 24 20:12:02.388654 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:02.388652    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cabb70a4-f405-4438-9115-7c0cea27a023-dshm\") pod \"ipp-route-11ccc9-kserve-58bbf89f79-7fs7z\" (UID: \"cabb70a4-f405-4438-9115-7c0cea27a023\") " pod="ai-tenant-e2e-ipp-a-11ccc9/ipp-route-11ccc9-kserve-58bbf89f79-7fs7z"
Jul 24 20:12:02.388894 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:02.388668    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cabb70a4-f405-4438-9115-7c0cea27a023-model-cache\") pod \"ipp-route-11ccc9-kserve-58bbf89f79-7fs7z\" (UID: \"cabb70a4-f405-4438-9115-7c0cea27a023\") " pod="ai-tenant-e2e-ipp-a-11ccc9/ipp-route-11ccc9-kserve-58bbf89f79-7fs7z"
Jul 24 20:12:02.388894 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:02.388821    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcg76\" (UniqueName: \"kubernetes.io/projected/cabb70a4-f405-4438-9115-7c0cea27a023-kube-api-access-rcg76\") pod \"ipp-route-11ccc9-kserve-58bbf89f79-7fs7z\" (UID: \"cabb70a4-f405-4438-9115-7c0cea27a023\") " pod="ai-tenant-e2e-ipp-a-11ccc9/ipp-route-11ccc9-kserve-58bbf89f79-7fs7z"
Jul 24 20:12:02.388894 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:02.388882    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cabb70a4-f405-4438-9115-7c0cea27a023-home\") pod \"ipp-route-11ccc9-kserve-58bbf89f79-7fs7z\" (UID: \"cabb70a4-f405-4438-9115-7c0cea27a023\") " pod="ai-tenant-e2e-ipp-a-11ccc9/ipp-route-11ccc9-kserve-58bbf89f79-7fs7z"
Jul 24 20:12:02.388996 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:02.388905    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cabb70a4-f405-4438-9115-7c0cea27a023-tls-certs\") pod \"ipp-route-11ccc9-kserve-58bbf89f79-7fs7z\" (UID: \"cabb70a4-f405-4438-9115-7c0cea27a023\") " pod="ai-tenant-e2e-ipp-a-11ccc9/ipp-route-11ccc9-kserve-58bbf89f79-7fs7z"
Jul 24 20:12:02.489607 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:02.489513    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cabb70a4-f405-4438-9115-7c0cea27a023-home\") pod \"ipp-route-11ccc9-kserve-58bbf89f79-7fs7z\" (UID: \"cabb70a4-f405-4438-9115-7c0cea27a023\") " pod="ai-tenant-e2e-ipp-a-11ccc9/ipp-route-11ccc9-kserve-58bbf89f79-7fs7z"
Jul 24 20:12:02.489607 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:02.489551    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cabb70a4-f405-4438-9115-7c0cea27a023-tls-certs\") pod \"ipp-route-11ccc9-kserve-58bbf89f79-7fs7z\" (UID: \"cabb70a4-f405-4438-9115-7c0cea27a023\") " pod="ai-tenant-e2e-ipp-a-11ccc9/ipp-route-11ccc9-kserve-58bbf89f79-7fs7z"
Jul 24 20:12:02.489904 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:02.489613    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cabb70a4-f405-4438-9115-7c0cea27a023-tmp-dir\") pod \"ipp-route-11ccc9-kserve-58bbf89f79-7fs7z\" (UID: \"cabb70a4-f405-4438-9115-7c0cea27a023\") " pod="ai-tenant-e2e-ipp-a-11ccc9/ipp-route-11ccc9-kserve-58bbf89f79-7fs7z"
Jul 24 20:12:02.489904 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:02.489636    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cabb70a4-f405-4438-9115-7c0cea27a023-dshm\") pod \"ipp-route-11ccc9-kserve-58bbf89f79-7fs7z\" (UID: \"cabb70a4-f405-4438-9115-7c0cea27a023\") " pod="ai-tenant-e2e-ipp-a-11ccc9/ipp-route-11ccc9-kserve-58bbf89f79-7fs7z"
Jul 24 20:12:02.489904 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:02.489660    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cabb70a4-f405-4438-9115-7c0cea27a023-model-cache\") pod \"ipp-route-11ccc9-kserve-58bbf89f79-7fs7z\" (UID: \"cabb70a4-f405-4438-9115-7c0cea27a023\") " pod="ai-tenant-e2e-ipp-a-11ccc9/ipp-route-11ccc9-kserve-58bbf89f79-7fs7z"
Jul 24 20:12:02.489904 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:02.489779    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcg76\" (UniqueName: \"kubernetes.io/projected/cabb70a4-f405-4438-9115-7c0cea27a023-kube-api-access-rcg76\") pod \"ipp-route-11ccc9-kserve-58bbf89f79-7fs7z\" (UID: \"cabb70a4-f405-4438-9115-7c0cea27a023\") " pod="ai-tenant-e2e-ipp-a-11ccc9/ipp-route-11ccc9-kserve-58bbf89f79-7fs7z"
Jul 24 20:12:02.490107 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:02.490044    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cabb70a4-f405-4438-9115-7c0cea27a023-tmp-dir\") pod \"ipp-route-11ccc9-kserve-58bbf89f79-7fs7z\" (UID: \"cabb70a4-f405-4438-9115-7c0cea27a023\") " pod="ai-tenant-e2e-ipp-a-11ccc9/ipp-route-11ccc9-kserve-58bbf89f79-7fs7z"
Jul 24 20:12:02.490107 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:02.490050    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cabb70a4-f405-4438-9115-7c0cea27a023-home\") pod \"ipp-route-11ccc9-kserve-58bbf89f79-7fs7z\" (UID: \"cabb70a4-f405-4438-9115-7c0cea27a023\") " pod="ai-tenant-e2e-ipp-a-11ccc9/ipp-route-11ccc9-kserve-58bbf89f79-7fs7z"
Jul 24 20:12:02.490188 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:02.490137    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cabb70a4-f405-4438-9115-7c0cea27a023-model-cache\") pod \"ipp-route-11ccc9-kserve-58bbf89f79-7fs7z\" (UID: \"cabb70a4-f405-4438-9115-7c0cea27a023\") " pod="ai-tenant-e2e-ipp-a-11ccc9/ipp-route-11ccc9-kserve-58bbf89f79-7fs7z"
Jul 24 20:12:02.492194 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:02.492171    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cabb70a4-f405-4438-9115-7c0cea27a023-dshm\") pod \"ipp-route-11ccc9-kserve-58bbf89f79-7fs7z\" (UID: \"cabb70a4-f405-4438-9115-7c0cea27a023\") " pod="ai-tenant-e2e-ipp-a-11ccc9/ipp-route-11ccc9-kserve-58bbf89f79-7fs7z"
Jul 24 20:12:02.492350 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:02.492335    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cabb70a4-f405-4438-9115-7c0cea27a023-tls-certs\") pod \"ipp-route-11ccc9-kserve-58bbf89f79-7fs7z\" (UID: \"cabb70a4-f405-4438-9115-7c0cea27a023\") " pod="ai-tenant-e2e-ipp-a-11ccc9/ipp-route-11ccc9-kserve-58bbf89f79-7fs7z"
Jul 24 20:12:02.497783 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:02.497756    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcg76\" (UniqueName: \"kubernetes.io/projected/cabb70a4-f405-4438-9115-7c0cea27a023-kube-api-access-rcg76\") pod \"ipp-route-11ccc9-kserve-58bbf89f79-7fs7z\" (UID: \"cabb70a4-f405-4438-9115-7c0cea27a023\") " pod="ai-tenant-e2e-ipp-a-11ccc9/ipp-route-11ccc9-kserve-58bbf89f79-7fs7z"
Jul 24 20:12:02.528747 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:02.528699    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-11ccc9/ipp-route-11ccc9-kserve-58bbf89f79-7fs7z"
Jul 24 20:12:02.666206 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:02.666176    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-11ccc9/ipp-route-11ccc9-kserve-58bbf89f79-7fs7z"]
Jul 24 20:12:02.668957 ip-10-0-131-150 kubenswrapper[2579]: W0724 20:12:02.668923    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcabb70a4_f405_4438_9115_7c0cea27a023.slice/crio-f5cf20c7301dd003355821b458124d25438c7c632303514e41f5c0605a8d4c87 WatchSource:0}: Error finding container f5cf20c7301dd003355821b458124d25438c7c632303514e41f5c0605a8d4c87: Status 404 returned error can't find the container with id f5cf20c7301dd003355821b458124d25438c7c632303514e41f5c0605a8d4c87
Jul 24 20:12:02.972081 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:02.972049    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-11ccc9/ipp-route-11ccc9-kserve-58bbf89f79-7fs7z" event={"ID":"cabb70a4-f405-4438-9115-7c0cea27a023","Type":"ContainerStarted","Data":"6968265797bc703c4d4052163fa01f929625504d000edefb189949eabaca32c8"}
Jul 24 20:12:02.972266 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:02.972091    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-11ccc9/ipp-route-11ccc9-kserve-58bbf89f79-7fs7z" event={"ID":"cabb70a4-f405-4438-9115-7c0cea27a023","Type":"ContainerStarted","Data":"f5cf20c7301dd003355821b458124d25438c7c632303514e41f5c0605a8d4c87"}
Jul 24 20:12:02.990402 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:02.990353    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-11ccc9/ipp-route-11ccc9-kserve-58bbf89f79-7fs7z" podStartSLOduration=0.99033721 podStartE2EDuration="990.33721ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:12:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:12:02.987646213 +0000 UTC m=+2721.176720526" watchObservedRunningTime="2026-07-24 20:12:02.99033721 +0000 UTC m=+2721.179411522"
Jul 24 20:12:06.084100 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:06.084066    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 20:12:12.529674 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:12.529617    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-11ccc9/ipp-route-11ccc9-kserve-58bbf89f79-7fs7z"
Jul 24 20:12:12.530120 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:12.529690    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-11ccc9/ipp-route-11ccc9-kserve-58bbf89f79-7fs7z"
Jul 24 20:12:12.542196 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:12.542170    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-11ccc9/ipp-route-11ccc9-kserve-58bbf89f79-7fs7z"
Jul 24 20:12:13.035026 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:13.035000    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-11ccc9/ipp-route-11ccc9-kserve-58bbf89f79-7fs7z"
Jul 24 20:12:44.492759 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:44.492704    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 20:12:56.782954 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:56.782922    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc"]
Jul 24 20:12:56.786705 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:56.786683    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc"
Jul 24 20:12:56.789189 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:56.789167    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-67ff20-openshift-default-dockercfg-hgfxs\""
Jul 24 20:12:56.800480 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:56.800456    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc"]
Jul 24 20:12:56.887039 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:56.887001    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a8aba72-a878-4480-b5e7-5f576770b5e1-istio-data\") pod \"e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc\" (UID: \"7a8aba72-a878-4480-b5e7-5f576770b5e1\") " pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc"
Jul 24 20:12:56.887238 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:56.887049    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a8aba72-a878-4480-b5e7-5f576770b5e1-istio-podinfo\") pod \"e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc\" (UID: \"7a8aba72-a878-4480-b5e7-5f576770b5e1\") " pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc"
Jul 24 20:12:56.887238 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:56.887122    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a8aba72-a878-4480-b5e7-5f576770b5e1-istio-envoy\") pod \"e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc\" (UID: \"7a8aba72-a878-4480-b5e7-5f576770b5e1\") " pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc"
Jul 24 20:12:56.887238 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:56.887155    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a8aba72-a878-4480-b5e7-5f576770b5e1-istio-token\") pod \"e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc\" (UID: \"7a8aba72-a878-4480-b5e7-5f576770b5e1\") " pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc"
Jul 24 20:12:56.887238 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:56.887220    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a8aba72-a878-4480-b5e7-5f576770b5e1-workload-socket\") pod \"e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc\" (UID: \"7a8aba72-a878-4480-b5e7-5f576770b5e1\") " pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc"
Jul 24 20:12:56.887439 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:56.887268    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a8aba72-a878-4480-b5e7-5f576770b5e1-istiod-ca-cert\") pod \"e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc\" (UID: \"7a8aba72-a878-4480-b5e7-5f576770b5e1\") " pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc"
Jul 24 20:12:56.887439 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:56.887340    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kqbw\" (UniqueName: \"kubernetes.io/projected/7a8aba72-a878-4480-b5e7-5f576770b5e1-kube-api-access-4kqbw\") pod \"e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc\" (UID: \"7a8aba72-a878-4480-b5e7-5f576770b5e1\") " pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc"
Jul 24 20:12:56.887439 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:56.887369    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a8aba72-a878-4480-b5e7-5f576770b5e1-workload-certs\") pod \"e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc\" (UID: \"7a8aba72-a878-4480-b5e7-5f576770b5e1\") " pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc"
Jul 24 20:12:56.887439 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:56.887395    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a8aba72-a878-4480-b5e7-5f576770b5e1-credential-socket\") pod \"e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc\" (UID: \"7a8aba72-a878-4480-b5e7-5f576770b5e1\") " pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc"
Jul 24 20:12:56.987891 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:56.987852    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a8aba72-a878-4480-b5e7-5f576770b5e1-istio-token\") pod \"e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc\" (UID: \"7a8aba72-a878-4480-b5e7-5f576770b5e1\") " pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc"
Jul 24 20:12:56.987891 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:56.987890    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a8aba72-a878-4480-b5e7-5f576770b5e1-workload-socket\") pod \"e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc\" (UID: \"7a8aba72-a878-4480-b5e7-5f576770b5e1\") " pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc"
Jul 24 20:12:56.988106 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:56.988019    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a8aba72-a878-4480-b5e7-5f576770b5e1-istiod-ca-cert\") pod \"e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc\" (UID: \"7a8aba72-a878-4480-b5e7-5f576770b5e1\") " pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc"
Jul 24 20:12:56.988147 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:56.988107    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kqbw\" (UniqueName: \"kubernetes.io/projected/7a8aba72-a878-4480-b5e7-5f576770b5e1-kube-api-access-4kqbw\") pod \"e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc\" (UID: \"7a8aba72-a878-4480-b5e7-5f576770b5e1\") " pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc"
Jul 24 20:12:56.988147 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:56.988139    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a8aba72-a878-4480-b5e7-5f576770b5e1-workload-certs\") pod \"e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc\" (UID: \"7a8aba72-a878-4480-b5e7-5f576770b5e1\") " pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc"
Jul 24 20:12:56.988212 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:56.988175    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a8aba72-a878-4480-b5e7-5f576770b5e1-credential-socket\") pod \"e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc\" (UID: \"7a8aba72-a878-4480-b5e7-5f576770b5e1\") " pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc"
Jul 24 20:12:56.988256 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:56.988214    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a8aba72-a878-4480-b5e7-5f576770b5e1-workload-socket\") pod \"e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc\" (UID: \"7a8aba72-a878-4480-b5e7-5f576770b5e1\") " pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc"
Jul 24 20:12:56.988256 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:56.988228    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a8aba72-a878-4480-b5e7-5f576770b5e1-istio-data\") pod \"e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc\" (UID: \"7a8aba72-a878-4480-b5e7-5f576770b5e1\") " pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc"
Jul 24 20:12:56.988346 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:56.988253    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a8aba72-a878-4480-b5e7-5f576770b5e1-istio-podinfo\") pod \"e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc\" (UID: \"7a8aba72-a878-4480-b5e7-5f576770b5e1\") " pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc"
Jul 24 20:12:56.988346 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:56.988294    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a8aba72-a878-4480-b5e7-5f576770b5e1-istio-envoy\") pod \"e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc\" (UID: \"7a8aba72-a878-4480-b5e7-5f576770b5e1\") " pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc"
Jul 24 20:12:56.988584 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:56.988562    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a8aba72-a878-4480-b5e7-5f576770b5e1-credential-socket\") pod \"e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc\" (UID: \"7a8aba72-a878-4480-b5e7-5f576770b5e1\") " pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc"
Jul 24 20:12:56.988665 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:56.988568    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a8aba72-a878-4480-b5e7-5f576770b5e1-workload-certs\") pod \"e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc\" (UID: \"7a8aba72-a878-4480-b5e7-5f576770b5e1\") " pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc"
Jul 24 20:12:56.988665 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:56.988611    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a8aba72-a878-4480-b5e7-5f576770b5e1-istio-data\") pod \"e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc\" (UID: \"7a8aba72-a878-4480-b5e7-5f576770b5e1\") " pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc"
Jul 24 20:12:56.988813 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:56.988779    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a8aba72-a878-4480-b5e7-5f576770b5e1-istiod-ca-cert\") pod \"e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc\" (UID: \"7a8aba72-a878-4480-b5e7-5f576770b5e1\") " pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc"
Jul 24 20:12:56.990625 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:56.990606    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a8aba72-a878-4480-b5e7-5f576770b5e1-istio-envoy\") pod \"e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc\" (UID: \"7a8aba72-a878-4480-b5e7-5f576770b5e1\") " pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc"
Jul 24 20:12:56.990972 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:56.990950    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a8aba72-a878-4480-b5e7-5f576770b5e1-istio-podinfo\") pod \"e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc\" (UID: \"7a8aba72-a878-4480-b5e7-5f576770b5e1\") " pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc"
Jul 24 20:12:56.996422 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:56.996400    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a8aba72-a878-4480-b5e7-5f576770b5e1-istio-token\") pod \"e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc\" (UID: \"7a8aba72-a878-4480-b5e7-5f576770b5e1\") " pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc"
Jul 24 20:12:56.996991 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:56.996969    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kqbw\" (UniqueName: \"kubernetes.io/projected/7a8aba72-a878-4480-b5e7-5f576770b5e1-kube-api-access-4kqbw\") pod \"e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc\" (UID: \"7a8aba72-a878-4480-b5e7-5f576770b5e1\") " pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc"
Jul 24 20:12:57.096851 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:57.096761    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc"
Jul 24 20:12:57.239275 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:57.239244    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc"]
Jul 24 20:12:57.240618 ip-10-0-131-150 kubenswrapper[2579]: W0724 20:12:57.240591    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a8aba72_a878_4480_b5e7_5f576770b5e1.slice/crio-81166a6b270ca0b7679607e7b1dc956635eaf45be4797b8e134976baf726ece4 WatchSource:0}: Error finding container 81166a6b270ca0b7679607e7b1dc956635eaf45be4797b8e134976baf726ece4: Status 404 returned error can't find the container with id 81166a6b270ca0b7679607e7b1dc956635eaf45be4797b8e134976baf726ece4
Jul 24 20:12:57.242923 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:57.242887    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 20:12:57.243039 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:57.242970    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 20:12:57.243039 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:57.243012    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 20:12:57.265413 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:57.265381    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc" event={"ID":"7a8aba72-a878-4480-b5e7-5f576770b5e1","Type":"ContainerStarted","Data":"81166a6b270ca0b7679607e7b1dc956635eaf45be4797b8e134976baf726ece4"}
Jul 24 20:12:58.271738 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:58.271692    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc" event={"ID":"7a8aba72-a878-4480-b5e7-5f576770b5e1","Type":"ContainerStarted","Data":"071f4a07d58989ab237d3014a75a7e1bddd09625462f06042ef9c788f48b00ce"}
Jul 24 20:12:58.290479 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:58.290430    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc" podStartSLOduration=2.29041416 podStartE2EDuration="2.29041416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:12:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:12:58.289614996 +0000 UTC m=+2776.478689310" watchObservedRunningTime="2026-07-24 20:12:58.29041416 +0000 UTC m=+2776.479488540"
Jul 24 20:12:59.097826 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:59.097787    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc"
Jul 24 20:12:59.103327 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:59.103298    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc"
Jul 24 20:12:59.277519 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:59.277479    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc"
Jul 24 20:12:59.278448 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:12:59.278426    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc"
Jul 24 20:13:02.606431 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:02.606352    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-67ff20-585595454d-sgxbm"]
Jul 24 20:13:02.610440 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:02.610421    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-67ff20-585595454d-sgxbm"
Jul 24 20:13:02.612893 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:02.612870    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-67ff20-serving-cert\""
Jul 24 20:13:02.622346 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:02.622316    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-67ff20-585595454d-sgxbm"]
Jul 24 20:13:02.633539 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:02.633509    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7083c676-c54b-4af9-a812-a7b2123cdede-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-67ff20-585595454d-sgxbm\" (UID: \"7083c676-c54b-4af9-a812-a7b2123cdede\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-67ff20-585595454d-sgxbm"
Jul 24 20:13:02.633670 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:02.633578    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7083c676-c54b-4af9-a812-a7b2123cdede-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-67ff20-585595454d-sgxbm\" (UID: \"7083c676-c54b-4af9-a812-a7b2123cdede\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-67ff20-585595454d-sgxbm"
Jul 24 20:13:02.633670 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:02.633608    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x4xj\" (UniqueName: \"kubernetes.io/projected/7083c676-c54b-4af9-a812-a7b2123cdede-kube-api-access-7x4xj\") pod \"maas-api-e2e-ipp-cleanup-67ff20-585595454d-sgxbm\" (UID: \"7083c676-c54b-4af9-a812-a7b2123cdede\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-67ff20-585595454d-sgxbm"
Jul 24 20:13:02.734819 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:02.734787    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7083c676-c54b-4af9-a812-a7b2123cdede-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-67ff20-585595454d-sgxbm\" (UID: \"7083c676-c54b-4af9-a812-a7b2123cdede\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-67ff20-585595454d-sgxbm"
Jul 24 20:13:02.735030 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:02.734859    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7083c676-c54b-4af9-a812-a7b2123cdede-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-67ff20-585595454d-sgxbm\" (UID: \"7083c676-c54b-4af9-a812-a7b2123cdede\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-67ff20-585595454d-sgxbm"
Jul 24 20:13:02.735030 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:02.734893    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x4xj\" (UniqueName: \"kubernetes.io/projected/7083c676-c54b-4af9-a812-a7b2123cdede-kube-api-access-7x4xj\") pod \"maas-api-e2e-ipp-cleanup-67ff20-585595454d-sgxbm\" (UID: \"7083c676-c54b-4af9-a812-a7b2123cdede\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-67ff20-585595454d-sgxbm"
Jul 24 20:13:02.735505 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:02.735478    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7083c676-c54b-4af9-a812-a7b2123cdede-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-67ff20-585595454d-sgxbm\" (UID: \"7083c676-c54b-4af9-a812-a7b2123cdede\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-67ff20-585595454d-sgxbm"
Jul 24 20:13:02.737458 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:02.737440    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7083c676-c54b-4af9-a812-a7b2123cdede-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-67ff20-585595454d-sgxbm\" (UID: \"7083c676-c54b-4af9-a812-a7b2123cdede\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-67ff20-585595454d-sgxbm"
Jul 24 20:13:02.743687 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:02.743661    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x4xj\" (UniqueName: \"kubernetes.io/projected/7083c676-c54b-4af9-a812-a7b2123cdede-kube-api-access-7x4xj\") pod \"maas-api-e2e-ipp-cleanup-67ff20-585595454d-sgxbm\" (UID: \"7083c676-c54b-4af9-a812-a7b2123cdede\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-67ff20-585595454d-sgxbm"
Jul 24 20:13:02.922884 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:02.922792    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-67ff20-585595454d-sgxbm"
Jul 24 20:13:03.069023 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:03.068984    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-67ff20-585595454d-sgxbm"]
Jul 24 20:13:03.077199 ip-10-0-131-150 kubenswrapper[2579]: W0724 20:13:03.077161    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7083c676_c54b_4af9_a812_a7b2123cdede.slice/crio-5660ae19b48e1acb5cc1f0bf8f6f0d638d5f7e331df90c7e7d97eec0013dbe8b WatchSource:0}: Error finding container 5660ae19b48e1acb5cc1f0bf8f6f0d638d5f7e331df90c7e7d97eec0013dbe8b: Status 404 returned error can't find the container with id 5660ae19b48e1acb5cc1f0bf8f6f0d638d5f7e331df90c7e7d97eec0013dbe8b
Jul 24 20:13:03.305085 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:03.305041    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-67ff20-585595454d-sgxbm" event={"ID":"7083c676-c54b-4af9-a812-a7b2123cdede","Type":"ContainerStarted","Data":"5660ae19b48e1acb5cc1f0bf8f6f0d638d5f7e331df90c7e7d97eec0013dbe8b"}
Jul 24 20:13:04.312657 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:04.312616    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-67ff20-585595454d-sgxbm" event={"ID":"7083c676-c54b-4af9-a812-a7b2123cdede","Type":"ContainerStarted","Data":"d3ccf74c366921ebd6f321b95fffbaac79484aa13456f2453a9107a76d3255f4"}
Jul 24 20:13:04.313076 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:04.312751    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-67ff20-585595454d-sgxbm"
Jul 24 20:13:04.332785 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:04.332716    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-67ff20-585595454d-sgxbm" podStartSLOduration=1.950494435 podStartE2EDuration="2.33270066s" totalImagesPullingTime="382.206225ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:13:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:13:04.330574308 +0000 UTC m=+2782.519648632" watchObservedRunningTime="2026-07-24 20:13:04.33270066 +0000 UTC m=+2782.521774973"
Jul 24 20:13:10.324516 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:10.324482    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-67ff20-585595454d-sgxbm"
Jul 24 20:13:11.487557 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:11.487527    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 20:13:20.405043 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:20.405010    2579 generic.go:356] "Generic (PLEG): container finished" podID="7a8aba72-a878-4480-b5e7-5f576770b5e1" containerID="071f4a07d58989ab237d3014a75a7e1bddd09625462f06042ef9c788f48b00ce" exitCode=0
Jul 24 20:13:20.405541 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:20.405080    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc" event={"ID":"7a8aba72-a878-4480-b5e7-5f576770b5e1","Type":"ContainerDied","Data":"071f4a07d58989ab237d3014a75a7e1bddd09625462f06042ef9c788f48b00ce"}
Jul 24 20:13:20.405541 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:20.405461    2579 scope.go:117] "RemoveContainer" containerID="071f4a07d58989ab237d3014a75a7e1bddd09625462f06042ef9c788f48b00ce"
Jul 24 20:13:20.406516 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:20.406489    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 20:13:20.406583 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:20.406568    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 20:13:20.406640 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:20.406627    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 24 20:13:21.412668 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:21.412628    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc" event={"ID":"7a8aba72-a878-4480-b5e7-5f576770b5e1","Type":"ContainerStarted","Data":"8b7eec476af503061a0a7900fa66a7ff5c73992de416fb3c5b147e83c6a243a8"}
Jul 24 20:13:22.097260 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:22.097212    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc"
Jul 24 20:13:22.097490 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:22.097453    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 24 20:13:22.097573 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:22.097511    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc" podUID="7a8aba72-a878-4480-b5e7-5f576770b5e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 24 20:13:23.097277 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:23.097236    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 24 20:13:23.097675 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:23.097325    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc" podUID="7a8aba72-a878-4480-b5e7-5f576770b5e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 24 20:13:24.097501 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:24.097455    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 24 20:13:24.097936 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:24.097525    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc" podUID="7a8aba72-a878-4480-b5e7-5f576770b5e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 24 20:13:25.097958 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:25.097921    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 24 20:13:25.098453 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:25.097997    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc" podUID="7a8aba72-a878-4480-b5e7-5f576770b5e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 24 20:13:26.101868 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:26.101838    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc"
Jul 24 20:13:26.102266 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:26.102192    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc"
Jul 24 20:13:26.102961 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:26.102942    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc"
Jul 24 20:13:31.951576 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:31.951534    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-67ff20-585595454d-sgxbm"]
Jul 24 20:13:31.952083 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:31.951808    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-67ff20-585595454d-sgxbm" podUID="7083c676-c54b-4af9-a812-a7b2123cdede" containerName="maas-api" containerID="cri-o://d3ccf74c366921ebd6f321b95fffbaac79484aa13456f2453a9107a76d3255f4" gracePeriod=30
Jul 24 20:13:32.207453 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:32.207375    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-67ff20-585595454d-sgxbm"
Jul 24 20:13:32.311814 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:32.311771    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7x4xj\" (UniqueName: \"kubernetes.io/projected/7083c676-c54b-4af9-a812-a7b2123cdede-kube-api-access-7x4xj\") pod \"7083c676-c54b-4af9-a812-a7b2123cdede\" (UID: \"7083c676-c54b-4af9-a812-a7b2123cdede\") "
Jul 24 20:13:32.312016 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:32.311840    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7083c676-c54b-4af9-a812-a7b2123cdede-openshift-service-ca\") pod \"7083c676-c54b-4af9-a812-a7b2123cdede\" (UID: \"7083c676-c54b-4af9-a812-a7b2123cdede\") "
Jul 24 20:13:32.312016 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:32.311934    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7083c676-c54b-4af9-a812-a7b2123cdede-maas-api-tls\") pod \"7083c676-c54b-4af9-a812-a7b2123cdede\" (UID: \"7083c676-c54b-4af9-a812-a7b2123cdede\") "
Jul 24 20:13:32.312198 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:32.312175    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7083c676-c54b-4af9-a812-a7b2123cdede-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7083c676-c54b-4af9-a812-a7b2123cdede" (UID: "7083c676-c54b-4af9-a812-a7b2123cdede"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:13:32.312295 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:32.312281    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7083c676-c54b-4af9-a812-a7b2123cdede-openshift-service-ca\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:13:32.314220 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:32.314187    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7083c676-c54b-4af9-a812-a7b2123cdede-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7083c676-c54b-4af9-a812-a7b2123cdede" (UID: "7083c676-c54b-4af9-a812-a7b2123cdede"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 20:13:32.314331 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:32.314259    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7083c676-c54b-4af9-a812-a7b2123cdede-kube-api-access-7x4xj" (OuterVolumeSpecName: "kube-api-access-7x4xj") pod "7083c676-c54b-4af9-a812-a7b2123cdede" (UID: "7083c676-c54b-4af9-a812-a7b2123cdede"). InnerVolumeSpecName "kube-api-access-7x4xj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:13:32.413213 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:32.413184    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7083c676-c54b-4af9-a812-a7b2123cdede-maas-api-tls\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:13:32.413213 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:32.413209    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7x4xj\" (UniqueName: \"kubernetes.io/projected/7083c676-c54b-4af9-a812-a7b2123cdede-kube-api-access-7x4xj\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:13:32.474979 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:32.474894    2579 generic.go:356] "Generic (PLEG): container finished" podID="7083c676-c54b-4af9-a812-a7b2123cdede" containerID="d3ccf74c366921ebd6f321b95fffbaac79484aa13456f2453a9107a76d3255f4" exitCode=0
Jul 24 20:13:32.474979 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:32.474939    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-67ff20-585595454d-sgxbm" event={"ID":"7083c676-c54b-4af9-a812-a7b2123cdede","Type":"ContainerDied","Data":"d3ccf74c366921ebd6f321b95fffbaac79484aa13456f2453a9107a76d3255f4"}
Jul 24 20:13:32.474979 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:32.474946    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-67ff20-585595454d-sgxbm"
Jul 24 20:13:32.475216 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:32.474992    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-67ff20-585595454d-sgxbm" event={"ID":"7083c676-c54b-4af9-a812-a7b2123cdede","Type":"ContainerDied","Data":"5660ae19b48e1acb5cc1f0bf8f6f0d638d5f7e331df90c7e7d97eec0013dbe8b"}
Jul 24 20:13:32.475216 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:32.475024    2579 scope.go:117] "RemoveContainer" containerID="d3ccf74c366921ebd6f321b95fffbaac79484aa13456f2453a9107a76d3255f4"
Jul 24 20:13:32.484076 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:32.484050    2579 scope.go:117] "RemoveContainer" containerID="d3ccf74c366921ebd6f321b95fffbaac79484aa13456f2453a9107a76d3255f4"
Jul 24 20:13:32.484318 ip-10-0-131-150 kubenswrapper[2579]: E0724 20:13:32.484300    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3ccf74c366921ebd6f321b95fffbaac79484aa13456f2453a9107a76d3255f4\": container with ID starting with d3ccf74c366921ebd6f321b95fffbaac79484aa13456f2453a9107a76d3255f4 not found: ID does not exist" containerID="d3ccf74c366921ebd6f321b95fffbaac79484aa13456f2453a9107a76d3255f4"
Jul 24 20:13:32.484400 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:32.484326    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3ccf74c366921ebd6f321b95fffbaac79484aa13456f2453a9107a76d3255f4"} err="failed to get container status \"d3ccf74c366921ebd6f321b95fffbaac79484aa13456f2453a9107a76d3255f4\": rpc error: code = NotFound desc = could not find container \"d3ccf74c366921ebd6f321b95fffbaac79484aa13456f2453a9107a76d3255f4\": container with ID starting with d3ccf74c366921ebd6f321b95fffbaac79484aa13456f2453a9107a76d3255f4 not found: ID does not exist"
Jul 24 20:13:32.495842 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:32.495815    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-67ff20-585595454d-sgxbm"]
Jul 24 20:13:32.497918 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:32.497901    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-67ff20-585595454d-sgxbm"]
Jul 24 20:13:34.368449 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:34.368416    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7083c676-c54b-4af9-a812-a7b2123cdede" path="/var/lib/kubelet/pods/7083c676-c54b-4af9-a812-a7b2123cdede/volumes"
Jul 24 20:13:36.287001 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:36.286963    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 20:13:42.556769 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:42.556711    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc"]
Jul 24 20:13:42.557170 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:42.556993    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc" podUID="7a8aba72-a878-4480-b5e7-5f576770b5e1" containerName="istio-proxy" containerID="cri-o://8b7eec476af503061a0a7900fa66a7ff5c73992de416fb3c5b147e83c6a243a8" gracePeriod=30
Jul 24 20:13:47.815056 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:47.815030    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc"
Jul 24 20:13:47.859408 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:47.859327    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4kqbw\" (UniqueName: \"kubernetes.io/projected/7a8aba72-a878-4480-b5e7-5f576770b5e1-kube-api-access-4kqbw\") pod \"7a8aba72-a878-4480-b5e7-5f576770b5e1\" (UID: \"7a8aba72-a878-4480-b5e7-5f576770b5e1\") "
Jul 24 20:13:47.859408 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:47.859374    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a8aba72-a878-4480-b5e7-5f576770b5e1-istio-podinfo\") pod \"7a8aba72-a878-4480-b5e7-5f576770b5e1\" (UID: \"7a8aba72-a878-4480-b5e7-5f576770b5e1\") "
Jul 24 20:13:47.859408 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:47.859400    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a8aba72-a878-4480-b5e7-5f576770b5e1-istiod-ca-cert\") pod \"7a8aba72-a878-4480-b5e7-5f576770b5e1\" (UID: \"7a8aba72-a878-4480-b5e7-5f576770b5e1\") "
Jul 24 20:13:47.859697 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:47.859511    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a8aba72-a878-4480-b5e7-5f576770b5e1-credential-socket\") pod \"7a8aba72-a878-4480-b5e7-5f576770b5e1\" (UID: \"7a8aba72-a878-4480-b5e7-5f576770b5e1\") "
Jul 24 20:13:47.859697 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:47.859562    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a8aba72-a878-4480-b5e7-5f576770b5e1-istio-data\") pod \"7a8aba72-a878-4480-b5e7-5f576770b5e1\" (UID: \"7a8aba72-a878-4480-b5e7-5f576770b5e1\") "
Jul 24 20:13:47.859697 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:47.859597    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a8aba72-a878-4480-b5e7-5f576770b5e1-istio-envoy\") pod \"7a8aba72-a878-4480-b5e7-5f576770b5e1\" (UID: \"7a8aba72-a878-4480-b5e7-5f576770b5e1\") "
Jul 24 20:13:47.859697 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:47.859619    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a8aba72-a878-4480-b5e7-5f576770b5e1-workload-socket\") pod \"7a8aba72-a878-4480-b5e7-5f576770b5e1\" (UID: \"7a8aba72-a878-4480-b5e7-5f576770b5e1\") "
Jul 24 20:13:47.859971 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:47.859736    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a8aba72-a878-4480-b5e7-5f576770b5e1-istio-token\") pod \"7a8aba72-a878-4480-b5e7-5f576770b5e1\" (UID: \"7a8aba72-a878-4480-b5e7-5f576770b5e1\") "
Jul 24 20:13:47.859971 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:47.859775    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a8aba72-a878-4480-b5e7-5f576770b5e1-workload-certs\") pod \"7a8aba72-a878-4480-b5e7-5f576770b5e1\" (UID: \"7a8aba72-a878-4480-b5e7-5f576770b5e1\") "
Jul 24 20:13:47.860101 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:47.859767    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a8aba72-a878-4480-b5e7-5f576770b5e1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7a8aba72-a878-4480-b5e7-5f576770b5e1" (UID: "7a8aba72-a878-4480-b5e7-5f576770b5e1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:13:47.860164 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:47.859787    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a8aba72-a878-4480-b5e7-5f576770b5e1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7a8aba72-a878-4480-b5e7-5f576770b5e1" (UID: "7a8aba72-a878-4480-b5e7-5f576770b5e1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:13:47.860164 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:47.860103    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a8aba72-a878-4480-b5e7-5f576770b5e1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7a8aba72-a878-4480-b5e7-5f576770b5e1" (UID: "7a8aba72-a878-4480-b5e7-5f576770b5e1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:13:47.860164 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:47.859950    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a8aba72-a878-4480-b5e7-5f576770b5e1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7a8aba72-a878-4480-b5e7-5f576770b5e1" (UID: "7a8aba72-a878-4480-b5e7-5f576770b5e1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:13:47.861081 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:47.861051    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a8aba72-a878-4480-b5e7-5f576770b5e1-istio-data" (OuterVolumeSpecName: "istio-data") pod "7a8aba72-a878-4480-b5e7-5f576770b5e1" (UID: "7a8aba72-a878-4480-b5e7-5f576770b5e1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:13:47.861951 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:47.861923    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a8aba72-a878-4480-b5e7-5f576770b5e1-kube-api-access-4kqbw" (OuterVolumeSpecName: "kube-api-access-4kqbw") pod "7a8aba72-a878-4480-b5e7-5f576770b5e1" (UID: "7a8aba72-a878-4480-b5e7-5f576770b5e1"). InnerVolumeSpecName "kube-api-access-4kqbw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:13:47.862137 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:47.862115    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a8aba72-a878-4480-b5e7-5f576770b5e1-istio-token" (OuterVolumeSpecName: "istio-token") pod "7a8aba72-a878-4480-b5e7-5f576770b5e1" (UID: "7a8aba72-a878-4480-b5e7-5f576770b5e1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:13:47.862411 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:47.862394    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a8aba72-a878-4480-b5e7-5f576770b5e1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7a8aba72-a878-4480-b5e7-5f576770b5e1" (UID: "7a8aba72-a878-4480-b5e7-5f576770b5e1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:13:47.862411 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:47.862399    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7a8aba72-a878-4480-b5e7-5f576770b5e1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7a8aba72-a878-4480-b5e7-5f576770b5e1" (UID: "7a8aba72-a878-4480-b5e7-5f576770b5e1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 20:13:47.960687 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:47.960643    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a8aba72-a878-4480-b5e7-5f576770b5e1-istio-token\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:13:47.960687 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:47.960680    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a8aba72-a878-4480-b5e7-5f576770b5e1-workload-certs\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:13:47.960687 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:47.960690    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kqbw\" (UniqueName: \"kubernetes.io/projected/7a8aba72-a878-4480-b5e7-5f576770b5e1-kube-api-access-4kqbw\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:13:47.960687 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:47.960698    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a8aba72-a878-4480-b5e7-5f576770b5e1-istio-podinfo\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:13:47.960977 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:47.960706    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a8aba72-a878-4480-b5e7-5f576770b5e1-istiod-ca-cert\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:13:47.960977 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:47.960716    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a8aba72-a878-4480-b5e7-5f576770b5e1-credential-socket\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:13:47.960977 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:47.960746    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a8aba72-a878-4480-b5e7-5f576770b5e1-istio-data\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:13:47.960977 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:47.960754    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a8aba72-a878-4480-b5e7-5f576770b5e1-istio-envoy\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:13:47.960977 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:47.960763    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a8aba72-a878-4480-b5e7-5f576770b5e1-workload-socket\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:13:48.579314 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:48.579282    2579 generic.go:356] "Generic (PLEG): container finished" podID="7a8aba72-a878-4480-b5e7-5f576770b5e1" containerID="8b7eec476af503061a0a7900fa66a7ff5c73992de416fb3c5b147e83c6a243a8" exitCode=0
Jul 24 20:13:48.579525 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:48.579339    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc"
Jul 24 20:13:48.579525 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:48.579373    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc" event={"ID":"7a8aba72-a878-4480-b5e7-5f576770b5e1","Type":"ContainerDied","Data":"8b7eec476af503061a0a7900fa66a7ff5c73992de416fb3c5b147e83c6a243a8"}
Jul 24 20:13:48.579525 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:48.579429    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc" event={"ID":"7a8aba72-a878-4480-b5e7-5f576770b5e1","Type":"ContainerDied","Data":"81166a6b270ca0b7679607e7b1dc956635eaf45be4797b8e134976baf726ece4"}
Jul 24 20:13:48.579525 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:48.579455    2579 scope.go:117] "RemoveContainer" containerID="8b7eec476af503061a0a7900fa66a7ff5c73992de416fb3c5b147e83c6a243a8"
Jul 24 20:13:48.588599 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:48.588581    2579 scope.go:117] "RemoveContainer" containerID="071f4a07d58989ab237d3014a75a7e1bddd09625462f06042ef9c788f48b00ce"
Jul 24 20:13:48.597266 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:48.597239    2579 scope.go:117] "RemoveContainer" containerID="8b7eec476af503061a0a7900fa66a7ff5c73992de416fb3c5b147e83c6a243a8"
Jul 24 20:13:48.597572 ip-10-0-131-150 kubenswrapper[2579]: E0724 20:13:48.597552    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b7eec476af503061a0a7900fa66a7ff5c73992de416fb3c5b147e83c6a243a8\": container with ID starting with 8b7eec476af503061a0a7900fa66a7ff5c73992de416fb3c5b147e83c6a243a8 not found: ID does not exist" containerID="8b7eec476af503061a0a7900fa66a7ff5c73992de416fb3c5b147e83c6a243a8"
Jul 24 20:13:48.597628 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:48.597582    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b7eec476af503061a0a7900fa66a7ff5c73992de416fb3c5b147e83c6a243a8"} err="failed to get container status \"8b7eec476af503061a0a7900fa66a7ff5c73992de416fb3c5b147e83c6a243a8\": rpc error: code = NotFound desc = could not find container \"8b7eec476af503061a0a7900fa66a7ff5c73992de416fb3c5b147e83c6a243a8\": container with ID starting with 8b7eec476af503061a0a7900fa66a7ff5c73992de416fb3c5b147e83c6a243a8 not found: ID does not exist"
Jul 24 20:13:48.597628 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:48.597603    2579 scope.go:117] "RemoveContainer" containerID="071f4a07d58989ab237d3014a75a7e1bddd09625462f06042ef9c788f48b00ce"
Jul 24 20:13:48.597848 ip-10-0-131-150 kubenswrapper[2579]: E0724 20:13:48.597829    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"071f4a07d58989ab237d3014a75a7e1bddd09625462f06042ef9c788f48b00ce\": container with ID starting with 071f4a07d58989ab237d3014a75a7e1bddd09625462f06042ef9c788f48b00ce not found: ID does not exist" containerID="071f4a07d58989ab237d3014a75a7e1bddd09625462f06042ef9c788f48b00ce"
Jul 24 20:13:48.597936 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:48.597852    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"071f4a07d58989ab237d3014a75a7e1bddd09625462f06042ef9c788f48b00ce"} err="failed to get container status \"071f4a07d58989ab237d3014a75a7e1bddd09625462f06042ef9c788f48b00ce\": rpc error: code = NotFound desc = could not find container \"071f4a07d58989ab237d3014a75a7e1bddd09625462f06042ef9c788f48b00ce\": container with ID starting with 071f4a07d58989ab237d3014a75a7e1bddd09625462f06042ef9c788f48b00ce not found: ID does not exist"
Jul 24 20:13:48.599189 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:48.599168    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc"]
Jul 24 20:13:48.603063 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:48.603040    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-67ff20-openshift-default-565ffb5574-nrxtc"]
Jul 24 20:13:50.368651 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:13:50.368618    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a8aba72-a878-4480-b5e7-5f576770b5e1" path="/var/lib/kubelet/pods/7a8aba72-a878-4480-b5e7-5f576770b5e1/volumes"
Jul 24 20:14:03.887744 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:03.887696    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 20:14:07.274679 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:07.274645    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-11ccc9-745465fb5b-lqrdb"]
Jul 24 20:14:07.275197 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:07.274942    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-11ccc9-745465fb5b-lqrdb" podUID="9f754280-894e-401d-a550-2f8cfa56d884" containerName="maas-api" containerID="cri-o://a759e66d28c1aacf5e01342e19c1d0a783d55915758c603650c227fa6dd44725" gracePeriod=30
Jul 24 20:14:07.531671 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:07.531599    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-11ccc9-745465fb5b-lqrdb"
Jul 24 20:14:07.626215 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:07.626188    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2554\" (UniqueName: \"kubernetes.io/projected/9f754280-894e-401d-a550-2f8cfa56d884-kube-api-access-g2554\") pod \"9f754280-894e-401d-a550-2f8cfa56d884\" (UID: \"9f754280-894e-401d-a550-2f8cfa56d884\") "
Jul 24 20:14:07.626440 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:07.626228    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f754280-894e-401d-a550-2f8cfa56d884-maas-api-tls\") pod \"9f754280-894e-401d-a550-2f8cfa56d884\" (UID: \"9f754280-894e-401d-a550-2f8cfa56d884\") "
Jul 24 20:14:07.626440 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:07.626277    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f754280-894e-401d-a550-2f8cfa56d884-openshift-service-ca\") pod \"9f754280-894e-401d-a550-2f8cfa56d884\" (UID: \"9f754280-894e-401d-a550-2f8cfa56d884\") "
Jul 24 20:14:07.626713 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:07.626691    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f754280-894e-401d-a550-2f8cfa56d884-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9f754280-894e-401d-a550-2f8cfa56d884" (UID: "9f754280-894e-401d-a550-2f8cfa56d884"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:14:07.628501 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:07.628481    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f754280-894e-401d-a550-2f8cfa56d884-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9f754280-894e-401d-a550-2f8cfa56d884" (UID: "9f754280-894e-401d-a550-2f8cfa56d884"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 20:14:07.628560 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:07.628495    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f754280-894e-401d-a550-2f8cfa56d884-kube-api-access-g2554" (OuterVolumeSpecName: "kube-api-access-g2554") pod "9f754280-894e-401d-a550-2f8cfa56d884" (UID: "9f754280-894e-401d-a550-2f8cfa56d884"). InnerVolumeSpecName "kube-api-access-g2554". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:14:07.688631 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:07.688595    2579 generic.go:356] "Generic (PLEG): container finished" podID="9f754280-894e-401d-a550-2f8cfa56d884" containerID="a759e66d28c1aacf5e01342e19c1d0a783d55915758c603650c227fa6dd44725" exitCode=0
Jul 24 20:14:07.688819 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:07.688641    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-11ccc9-745465fb5b-lqrdb"
Jul 24 20:14:07.688819 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:07.688645    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-11ccc9-745465fb5b-lqrdb" event={"ID":"9f754280-894e-401d-a550-2f8cfa56d884","Type":"ContainerDied","Data":"a759e66d28c1aacf5e01342e19c1d0a783d55915758c603650c227fa6dd44725"}
Jul 24 20:14:07.688819 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:07.688693    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-11ccc9-745465fb5b-lqrdb" event={"ID":"9f754280-894e-401d-a550-2f8cfa56d884","Type":"ContainerDied","Data":"45b60c2e9eda57304079c0a871f736c40676b047e559306da0d01d5ff81ce65f"}
Jul 24 20:14:07.688819 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:07.688717    2579 scope.go:117] "RemoveContainer" containerID="a759e66d28c1aacf5e01342e19c1d0a783d55915758c603650c227fa6dd44725"
Jul 24 20:14:07.698592 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:07.698574    2579 scope.go:117] "RemoveContainer" containerID="a759e66d28c1aacf5e01342e19c1d0a783d55915758c603650c227fa6dd44725"
Jul 24 20:14:07.698913 ip-10-0-131-150 kubenswrapper[2579]: E0724 20:14:07.698887    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a759e66d28c1aacf5e01342e19c1d0a783d55915758c603650c227fa6dd44725\": container with ID starting with a759e66d28c1aacf5e01342e19c1d0a783d55915758c603650c227fa6dd44725 not found: ID does not exist" containerID="a759e66d28c1aacf5e01342e19c1d0a783d55915758c603650c227fa6dd44725"
Jul 24 20:14:07.699063 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:07.698919    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a759e66d28c1aacf5e01342e19c1d0a783d55915758c603650c227fa6dd44725"} err="failed to get container status \"a759e66d28c1aacf5e01342e19c1d0a783d55915758c603650c227fa6dd44725\": rpc error: code = NotFound desc = could not find container \"a759e66d28c1aacf5e01342e19c1d0a783d55915758c603650c227fa6dd44725\": container with ID starting with a759e66d28c1aacf5e01342e19c1d0a783d55915758c603650c227fa6dd44725 not found: ID does not exist"
Jul 24 20:14:07.709500 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:07.709470    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-11ccc9-745465fb5b-lqrdb"]
Jul 24 20:14:07.712846 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:07.712822    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-11ccc9-745465fb5b-lqrdb"]
Jul 24 20:14:07.727989 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:07.727969    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2554\" (UniqueName: \"kubernetes.io/projected/9f754280-894e-401d-a550-2f8cfa56d884-kube-api-access-g2554\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:14:07.727989 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:07.727991    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f754280-894e-401d-a550-2f8cfa56d884-maas-api-tls\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:14:07.728141 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:07.728000    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f754280-894e-401d-a550-2f8cfa56d884-openshift-service-ca\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:14:08.368479 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:08.368432    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f754280-894e-401d-a550-2f8cfa56d884" path="/var/lib/kubelet/pods/9f754280-894e-401d-a550-2f8cfa56d884/volumes"
Jul 24 20:14:16.724444 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:16.724406    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-11ccc9/ipp-route-11ccc9-kserve-58bbf89f79-7fs7z"]
Jul 24 20:14:18.391582 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:18.391541    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 20:14:31.744613 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:31.744564    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-11ccc9/ipp-route-11ccc9-kserve-58bbf89f79-7fs7z" podUID="cabb70a4-f405-4438-9115-7c0cea27a023" containerName="main" containerID="cri-o://6968265797bc703c4d4052163fa01f929625504d000edefb189949eabaca32c8" gracePeriod=45
Jul 24 20:14:31.992220 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:31.992193    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-11ccc9/ipp-route-11ccc9-kserve-58bbf89f79-7fs7z"
Jul 24 20:14:32.145422 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:32.145389    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rcg76\" (UniqueName: \"kubernetes.io/projected/cabb70a4-f405-4438-9115-7c0cea27a023-kube-api-access-rcg76\") pod \"cabb70a4-f405-4438-9115-7c0cea27a023\" (UID: \"cabb70a4-f405-4438-9115-7c0cea27a023\") "
Jul 24 20:14:32.145629 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:32.145434    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cabb70a4-f405-4438-9115-7c0cea27a023-tmp-dir\") pod \"cabb70a4-f405-4438-9115-7c0cea27a023\" (UID: \"cabb70a4-f405-4438-9115-7c0cea27a023\") "
Jul 24 20:14:32.145629 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:32.145462    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cabb70a4-f405-4438-9115-7c0cea27a023-tls-certs\") pod \"cabb70a4-f405-4438-9115-7c0cea27a023\" (UID: \"cabb70a4-f405-4438-9115-7c0cea27a023\") "
Jul 24 20:14:32.145629 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:32.145490    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cabb70a4-f405-4438-9115-7c0cea27a023-model-cache\") pod \"cabb70a4-f405-4438-9115-7c0cea27a023\" (UID: \"cabb70a4-f405-4438-9115-7c0cea27a023\") "
Jul 24 20:14:32.145629 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:32.145506    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cabb70a4-f405-4438-9115-7c0cea27a023-dshm\") pod \"cabb70a4-f405-4438-9115-7c0cea27a023\" (UID: \"cabb70a4-f405-4438-9115-7c0cea27a023\") "
Jul 24 20:14:32.145629 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:32.145540    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cabb70a4-f405-4438-9115-7c0cea27a023-home\") pod \"cabb70a4-f405-4438-9115-7c0cea27a023\" (UID: \"cabb70a4-f405-4438-9115-7c0cea27a023\") "
Jul 24 20:14:32.145948 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:32.145759    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cabb70a4-f405-4438-9115-7c0cea27a023-model-cache" (OuterVolumeSpecName: "model-cache") pod "cabb70a4-f405-4438-9115-7c0cea27a023" (UID: "cabb70a4-f405-4438-9115-7c0cea27a023"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:14:32.145948 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:32.145771    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cabb70a4-f405-4438-9115-7c0cea27a023-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cabb70a4-f405-4438-9115-7c0cea27a023" (UID: "cabb70a4-f405-4438-9115-7c0cea27a023"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:14:32.145948 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:32.145851    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cabb70a4-f405-4438-9115-7c0cea27a023-home" (OuterVolumeSpecName: "home") pod "cabb70a4-f405-4438-9115-7c0cea27a023" (UID: "cabb70a4-f405-4438-9115-7c0cea27a023"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:14:32.146082 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:32.145994    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cabb70a4-f405-4438-9115-7c0cea27a023-tmp-dir\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:14:32.146082 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:32.146012    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cabb70a4-f405-4438-9115-7c0cea27a023-model-cache\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:14:32.146082 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:32.146020    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cabb70a4-f405-4438-9115-7c0cea27a023-home\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:14:32.147975 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:32.147949    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cabb70a4-f405-4438-9115-7c0cea27a023-kube-api-access-rcg76" (OuterVolumeSpecName: "kube-api-access-rcg76") pod "cabb70a4-f405-4438-9115-7c0cea27a023" (UID: "cabb70a4-f405-4438-9115-7c0cea27a023"). InnerVolumeSpecName "kube-api-access-rcg76". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:14:32.148112 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:32.148050    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cabb70a4-f405-4438-9115-7c0cea27a023-dshm" (OuterVolumeSpecName: "dshm") pod "cabb70a4-f405-4438-9115-7c0cea27a023" (UID: "cabb70a4-f405-4438-9115-7c0cea27a023"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:14:32.148112 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:32.148052    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cabb70a4-f405-4438-9115-7c0cea27a023-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cabb70a4-f405-4438-9115-7c0cea27a023" (UID: "cabb70a4-f405-4438-9115-7c0cea27a023"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 20:14:32.247055 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:32.247016    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rcg76\" (UniqueName: \"kubernetes.io/projected/cabb70a4-f405-4438-9115-7c0cea27a023-kube-api-access-rcg76\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:14:32.247055 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:32.247047    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cabb70a4-f405-4438-9115-7c0cea27a023-tls-certs\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:14:32.247055 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:32.247057    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cabb70a4-f405-4438-9115-7c0cea27a023-dshm\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:14:32.820321 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:32.820230    2579 generic.go:356] "Generic (PLEG): container finished" podID="cabb70a4-f405-4438-9115-7c0cea27a023" containerID="6968265797bc703c4d4052163fa01f929625504d000edefb189949eabaca32c8" exitCode=0
Jul 24 20:14:32.820321 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:32.820276    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-11ccc9/ipp-route-11ccc9-kserve-58bbf89f79-7fs7z"
Jul 24 20:14:32.820321 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:32.820309    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-11ccc9/ipp-route-11ccc9-kserve-58bbf89f79-7fs7z" event={"ID":"cabb70a4-f405-4438-9115-7c0cea27a023","Type":"ContainerDied","Data":"6968265797bc703c4d4052163fa01f929625504d000edefb189949eabaca32c8"}
Jul 24 20:14:32.820896 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:32.820353    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-11ccc9/ipp-route-11ccc9-kserve-58bbf89f79-7fs7z" event={"ID":"cabb70a4-f405-4438-9115-7c0cea27a023","Type":"ContainerDied","Data":"f5cf20c7301dd003355821b458124d25438c7c632303514e41f5c0605a8d4c87"}
Jul 24 20:14:32.820896 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:32.820371    2579 scope.go:117] "RemoveContainer" containerID="6968265797bc703c4d4052163fa01f929625504d000edefb189949eabaca32c8"
Jul 24 20:14:32.829325 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:32.829308    2579 scope.go:117] "RemoveContainer" containerID="6968265797bc703c4d4052163fa01f929625504d000edefb189949eabaca32c8"
Jul 24 20:14:32.829572 ip-10-0-131-150 kubenswrapper[2579]: E0724 20:14:32.829554    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6968265797bc703c4d4052163fa01f929625504d000edefb189949eabaca32c8\": container with ID starting with 6968265797bc703c4d4052163fa01f929625504d000edefb189949eabaca32c8 not found: ID does not exist" containerID="6968265797bc703c4d4052163fa01f929625504d000edefb189949eabaca32c8"
Jul 24 20:14:32.829616 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:32.829580    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6968265797bc703c4d4052163fa01f929625504d000edefb189949eabaca32c8"} err="failed to get container status \"6968265797bc703c4d4052163fa01f929625504d000edefb189949eabaca32c8\": rpc error: code = NotFound desc = could not find container \"6968265797bc703c4d4052163fa01f929625504d000edefb189949eabaca32c8\": container with ID starting with 6968265797bc703c4d4052163fa01f929625504d000edefb189949eabaca32c8 not found: ID does not exist"
Jul 24 20:14:32.837123 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:32.837099    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-11ccc9/ipp-route-11ccc9-kserve-58bbf89f79-7fs7z"]
Jul 24 20:14:32.839036 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:32.839016    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-11ccc9/ipp-route-11ccc9-kserve-58bbf89f79-7fs7z"]
Jul 24 20:14:34.368951 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:14:34.368914    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cabb70a4-f405-4438-9115-7c0cea27a023" path="/var/lib/kubelet/pods/cabb70a4-f405-4438-9115-7c0cea27a023/volumes"
Jul 24 20:15:00.140740 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.140691    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3e15b4-29748735-krdmx"]
Jul 24 20:15:00.141225 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.141043    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f754280-894e-401d-a550-2f8cfa56d884" containerName="maas-api"
Jul 24 20:15:00.141225 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.141055    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f754280-894e-401d-a550-2f8cfa56d884" containerName="maas-api"
Jul 24 20:15:00.141225 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.141075    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cabb70a4-f405-4438-9115-7c0cea27a023" containerName="main"
Jul 24 20:15:00.141225 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.141082    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cabb70a4-f405-4438-9115-7c0cea27a023" containerName="main"
Jul 24 20:15:00.141225 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.141090    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7083c676-c54b-4af9-a812-a7b2123cdede" containerName="maas-api"
Jul 24 20:15:00.141225 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.141096    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7083c676-c54b-4af9-a812-a7b2123cdede" containerName="maas-api"
Jul 24 20:15:00.141225 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.141104    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a8aba72-a878-4480-b5e7-5f576770b5e1" containerName="istio-proxy"
Jul 24 20:15:00.141225 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.141109    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a8aba72-a878-4480-b5e7-5f576770b5e1" containerName="istio-proxy"
Jul 24 20:15:00.141225 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.141115    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a8aba72-a878-4480-b5e7-5f576770b5e1" containerName="istio-proxy"
Jul 24 20:15:00.141225 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.141121    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a8aba72-a878-4480-b5e7-5f576770b5e1" containerName="istio-proxy"
Jul 24 20:15:00.141225 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.141176    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a8aba72-a878-4480-b5e7-5f576770b5e1" containerName="istio-proxy"
Jul 24 20:15:00.141225 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.141182    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f754280-894e-401d-a550-2f8cfa56d884" containerName="maas-api"
Jul 24 20:15:00.141225 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.141190    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7083c676-c54b-4af9-a812-a7b2123cdede" containerName="maas-api"
Jul 24 20:15:00.141225 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.141197    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cabb70a4-f405-4438-9115-7c0cea27a023" containerName="main"
Jul 24 20:15:00.144511 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.144483    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3e15b4-29748735-krdmx"
Jul 24 20:15:00.145411 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.145390    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-75b982-29748735-tdtch"]
Jul 24 20:15:00.145839 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.145824    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a8aba72-a878-4480-b5e7-5f576770b5e1" containerName="istio-proxy"
Jul 24 20:15:00.146964 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.146943    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gqw4p\""
Jul 24 20:15:00.148578 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.148560    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-8abb86-29748735-lknbq"]
Jul 24 20:15:00.148692 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.148665    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-75b982-29748735-tdtch"
Jul 24 20:15:00.151751 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.151707    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748735-j89d2"]
Jul 24 20:15:00.151864 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.151809    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-8abb86-29748735-lknbq"
Jul 24 20:15:00.155764 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.155457    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748735-j89d2"
Jul 24 20:15:00.157564 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.157542    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3e15b4-29748735-krdmx"
Jul 24 20:15:00.157767 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.157750    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3e15b4-29748735-krdmx"]
Jul 24 20:15:00.160113 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.160088    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-75b982-29748735-tdtch"]
Jul 24 20:15:00.162818 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.162793    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748735-j89d2"]
Jul 24 20:15:00.179464 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.179427    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-8abb86-29748735-lknbq"]
Jul 24 20:15:00.181782 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.181204    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-75b982-29748735-tdtch"
Jul 24 20:15:00.227913 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.227883    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-8abb86-29748735-lknbq"
Jul 24 20:15:00.235423 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.235400    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748735-j89d2"
Jul 24 20:15:00.356859 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.356788    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3e15b4-29748735-krdmx"]
Jul 24 20:15:00.357496 ip-10-0-131-150 kubenswrapper[2579]: W0724 20:15:00.357444    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff3e72dd_c751_482e_af14_4f2a5648b3e8.slice/crio-e97bb3fdcaf04c379e9eb89ddcd1b699af25f990997fcfa8f39717fbaccc2eeb WatchSource:0}: Error finding container e97bb3fdcaf04c379e9eb89ddcd1b699af25f990997fcfa8f39717fbaccc2eeb: Status 404 returned error can't find the container with id e97bb3fdcaf04c379e9eb89ddcd1b699af25f990997fcfa8f39717fbaccc2eeb
Jul 24 20:15:00.378160 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.377603    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-75b982-29748735-tdtch"]
Jul 24 20:15:00.379902 ip-10-0-131-150 kubenswrapper[2579]: W0724 20:15:00.379861    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d0ae3f5_233e_4c9b_9e91_fec286457546.slice/crio-7cbffd7f50f57003b92cbcabbb65a942f1070e2b7b296a69082031f59d8bca21 WatchSource:0}: Error finding container 7cbffd7f50f57003b92cbcabbb65a942f1070e2b7b296a69082031f59d8bca21: Status 404 returned error can't find the container with id 7cbffd7f50f57003b92cbcabbb65a942f1070e2b7b296a69082031f59d8bca21
Jul 24 20:15:00.426784 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.426758    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-8abb86-29748735-lknbq"]
Jul 24 20:15:00.428524 ip-10-0-131-150 kubenswrapper[2579]: W0724 20:15:00.428500    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda117f9ba_4194_439a_9e43_ac18afba2e6e.slice/crio-9322ff26596492e9dd94e33c221497f65a299fb34b87333617b5b31722184e15 WatchSource:0}: Error finding container 9322ff26596492e9dd94e33c221497f65a299fb34b87333617b5b31722184e15: Status 404 returned error can't find the container with id 9322ff26596492e9dd94e33c221497f65a299fb34b87333617b5b31722184e15
Jul 24 20:15:00.449598 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.449573    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748735-j89d2"]
Jul 24 20:15:00.466014 ip-10-0-131-150 kubenswrapper[2579]: W0724 20:15:00.465983    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4d05bb6_a5c5_4661_98e2_c75d477d6a1d.slice/crio-05a5ec9a4dbb0da7128182d9d66526d62d47279636839e68313ca59fea8febf3 WatchSource:0}: Error finding container 05a5ec9a4dbb0da7128182d9d66526d62d47279636839e68313ca59fea8febf3: Status 404 returned error can't find the container with id 05a5ec9a4dbb0da7128182d9d66526d62d47279636839e68313ca59fea8febf3
Jul 24 20:15:00.962912 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.962817    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748735-j89d2" event={"ID":"c4d05bb6-a5c5-4661-98e2-c75d477d6a1d","Type":"ContainerStarted","Data":"25036cd0cb2fb86d4f91dbee5c76166e69d572bdc423085b7e985dd25ade85a6"}
Jul 24 20:15:00.962912 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.962877    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748735-j89d2" event={"ID":"c4d05bb6-a5c5-4661-98e2-c75d477d6a1d","Type":"ContainerStarted","Data":"05a5ec9a4dbb0da7128182d9d66526d62d47279636839e68313ca59fea8febf3"}
Jul 24 20:15:00.964427 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.964400    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-75b982-29748735-tdtch" event={"ID":"8d0ae3f5-233e-4c9b-9e91-fec286457546","Type":"ContainerStarted","Data":"208b8a812a02451d10ae004fae75272add1a981d3a450bb1fc5ffd7a1dae7855"}
Jul 24 20:15:00.964557 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.964450    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-75b982-29748735-tdtch" event={"ID":"8d0ae3f5-233e-4c9b-9e91-fec286457546","Type":"ContainerStarted","Data":"7cbffd7f50f57003b92cbcabbb65a942f1070e2b7b296a69082031f59d8bca21"}
Jul 24 20:15:00.965852 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.965818    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-8abb86-29748735-lknbq" event={"ID":"a117f9ba-4194-439a-9e43-ac18afba2e6e","Type":"ContainerStarted","Data":"d2ae4e31c82625ecdd0be62906d98b41e696c96f1543a1c96b6ff325cbe73d5a"}
Jul 24 20:15:00.965972 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.965872    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-8abb86-29748735-lknbq" event={"ID":"a117f9ba-4194-439a-9e43-ac18afba2e6e","Type":"ContainerStarted","Data":"9322ff26596492e9dd94e33c221497f65a299fb34b87333617b5b31722184e15"}
Jul 24 20:15:00.967266 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.967241    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3e15b4-29748735-krdmx" event={"ID":"ff3e72dd-c751-482e-af14-4f2a5648b3e8","Type":"ContainerStarted","Data":"72c8636c532ba99af0c70cd4db8561392d36b4bb36987ed9c464fc68cc53acd9"}
Jul 24 20:15:00.967346 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.967286    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3e15b4-29748735-krdmx" event={"ID":"ff3e72dd-c751-482e-af14-4f2a5648b3e8","Type":"ContainerStarted","Data":"e97bb3fdcaf04c379e9eb89ddcd1b699af25f990997fcfa8f39717fbaccc2eeb"}
Jul 24 20:15:00.979047 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.978994    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748735-j89d2" podStartSLOduration=0.978977388 podStartE2EDuration="978.977388ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:15:00.976937965 +0000 UTC m=+2899.166012278" watchObservedRunningTime="2026-07-24 20:15:00.978977388 +0000 UTC m=+2899.168051702"
Jul 24 20:15:00.993714 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:00.993658    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-75b982-29748735-tdtch" podStartSLOduration=0.993643865 podStartE2EDuration="993.643865ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:15:00.991850567 +0000 UTC m=+2899.180924879" watchObservedRunningTime="2026-07-24 20:15:00.993643865 +0000 UTC m=+2899.182718177"
Jul 24 20:15:01.006545 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:01.006491    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-8abb86-29748735-lknbq" podStartSLOduration=1.0064761 podStartE2EDuration="1.0064761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:15:01.004954325 +0000 UTC m=+2899.194028639" watchObservedRunningTime="2026-07-24 20:15:01.0064761 +0000 UTC m=+2899.195550413"
Jul 24 20:15:01.020189 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:01.020128    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3e15b4-29748735-krdmx" podStartSLOduration=1.020112717 podStartE2EDuration="1.020112717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:15:01.018679571 +0000 UTC m=+2899.207753885" watchObservedRunningTime="2026-07-24 20:15:01.020112717 +0000 UTC m=+2899.209187029"
Jul 24 20:15:01.310318 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:01.310281    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-75b982-w98nb"]
Jul 24 20:15:01.314040 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:01.314017    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-75b982-w98nb"
Jul 24 20:15:01.320575 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:01.320546    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-75b982-w98nb"]
Jul 24 20:15:01.403288 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:01.403259    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2ea3c37-84ee-49e7-bd0a-a7c07e27ecea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-75b982-w98nb\" (UID: \"f2ea3c37-84ee-49e7-bd0a-a7c07e27ecea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-75b982-w98nb"
Jul 24 20:15:01.503912 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:01.503882    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2ea3c37-84ee-49e7-bd0a-a7c07e27ecea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-75b982-w98nb\" (UID: \"f2ea3c37-84ee-49e7-bd0a-a7c07e27ecea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-75b982-w98nb"
Jul 24 20:15:01.504641 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:01.504617    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2ea3c37-84ee-49e7-bd0a-a7c07e27ecea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-75b982-w98nb\" (UID: \"f2ea3c37-84ee-49e7-bd0a-a7c07e27ecea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-75b982-w98nb"
Jul 24 20:15:01.626975 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:01.626898    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-75b982-w98nb"
Jul 24 20:15:01.768000 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:01.767951    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-75b982-w98nb"]
Jul 24 20:15:01.770452 ip-10-0-131-150 kubenswrapper[2579]: W0724 20:15:01.770429    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2ea3c37_84ee_49e7_bd0a_a7c07e27ecea.slice/crio-5d741f9cc1cd733e300a4558f0ae3e63f0e3170b6343678169aedf95a72498fc WatchSource:0}: Error finding container 5d741f9cc1cd733e300a4558f0ae3e63f0e3170b6343678169aedf95a72498fc: Status 404 returned error can't find the container with id 5d741f9cc1cd733e300a4558f0ae3e63f0e3170b6343678169aedf95a72498fc
Jul 24 20:15:01.975930 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:01.975847    2579 generic.go:356] "Generic (PLEG): container finished" podID="c4d05bb6-a5c5-4661-98e2-c75d477d6a1d" containerID="25036cd0cb2fb86d4f91dbee5c76166e69d572bdc423085b7e985dd25ade85a6" exitCode=0
Jul 24 20:15:01.976078 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:01.975935    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748735-j89d2" event={"ID":"c4d05bb6-a5c5-4661-98e2-c75d477d6a1d","Type":"ContainerDied","Data":"25036cd0cb2fb86d4f91dbee5c76166e69d572bdc423085b7e985dd25ade85a6"}
Jul 24 20:15:01.977356 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:01.977324    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-75b982-w98nb" event={"ID":"f2ea3c37-84ee-49e7-bd0a-a7c07e27ecea","Type":"ContainerStarted","Data":"5d741f9cc1cd733e300a4558f0ae3e63f0e3170b6343678169aedf95a72498fc"}
Jul 24 20:15:01.978842 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:01.978822    2579 generic.go:356] "Generic (PLEG): container finished" podID="8d0ae3f5-233e-4c9b-9e91-fec286457546" containerID="208b8a812a02451d10ae004fae75272add1a981d3a450bb1fc5ffd7a1dae7855" exitCode=0
Jul 24 20:15:01.978949 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:01.978911    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-75b982-29748735-tdtch" event={"ID":"8d0ae3f5-233e-4c9b-9e91-fec286457546","Type":"ContainerDied","Data":"208b8a812a02451d10ae004fae75272add1a981d3a450bb1fc5ffd7a1dae7855"}
Jul 24 20:15:01.980581 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:01.980558    2579 generic.go:356] "Generic (PLEG): container finished" podID="a117f9ba-4194-439a-9e43-ac18afba2e6e" containerID="d2ae4e31c82625ecdd0be62906d98b41e696c96f1543a1c96b6ff325cbe73d5a" exitCode=0
Jul 24 20:15:01.980681 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:01.980596    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-8abb86-29748735-lknbq" event={"ID":"a117f9ba-4194-439a-9e43-ac18afba2e6e","Type":"ContainerDied","Data":"d2ae4e31c82625ecdd0be62906d98b41e696c96f1543a1c96b6ff325cbe73d5a"}
Jul 24 20:15:01.982254 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:01.982235    2579 generic.go:356] "Generic (PLEG): container finished" podID="ff3e72dd-c751-482e-af14-4f2a5648b3e8" containerID="72c8636c532ba99af0c70cd4db8561392d36b4bb36987ed9c464fc68cc53acd9" exitCode=0
Jul 24 20:15:01.982344 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:01.982305    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3e15b4-29748735-krdmx" event={"ID":"ff3e72dd-c751-482e-af14-4f2a5648b3e8","Type":"ContainerDied","Data":"72c8636c532ba99af0c70cd4db8561392d36b4bb36987ed9c464fc68cc53acd9"}
Jul 24 20:15:02.992368 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:02.992287    2579 generic.go:356] "Generic (PLEG): container finished" podID="f2ea3c37-84ee-49e7-bd0a-a7c07e27ecea" containerID="885a1596adddb67d96ecca14558865bdf94b5ec95f7a4a3f4cc7dd1c820ae895" exitCode=0
Jul 24 20:15:02.992767 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:02.992371    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-75b982-w98nb" event={"ID":"f2ea3c37-84ee-49e7-bd0a-a7c07e27ecea","Type":"ContainerDied","Data":"885a1596adddb67d96ecca14558865bdf94b5ec95f7a4a3f4cc7dd1c820ae895"}
Jul 24 20:15:03.143012 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:03.142986    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-75b982-29748735-tdtch"
Jul 24 20:15:03.165470 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:03.165183    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3e15b4-29748735-krdmx"
Jul 24 20:15:03.248093 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:03.248018    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-8abb86-29748735-lknbq"
Jul 24 20:15:03.250826 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:03.250805    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748735-j89d2"
Jul 24 20:15:03.998891 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:03.998853    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748735-j89d2"
Jul 24 20:15:03.999322 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:03.998896    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748735-j89d2" event={"ID":"c4d05bb6-a5c5-4661-98e2-c75d477d6a1d","Type":"ContainerDied","Data":"05a5ec9a4dbb0da7128182d9d66526d62d47279636839e68313ca59fea8febf3"}
Jul 24 20:15:03.999322 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:03.998947    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="05a5ec9a4dbb0da7128182d9d66526d62d47279636839e68313ca59fea8febf3"
Jul 24 20:15:04.000229 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:04.000209    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-75b982-29748735-tdtch"
Jul 24 20:15:04.000346 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:04.000238    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-75b982-29748735-tdtch" event={"ID":"8d0ae3f5-233e-4c9b-9e91-fec286457546","Type":"ContainerDied","Data":"7cbffd7f50f57003b92cbcabbb65a942f1070e2b7b296a69082031f59d8bca21"}
Jul 24 20:15:04.000346 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:04.000283    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7cbffd7f50f57003b92cbcabbb65a942f1070e2b7b296a69082031f59d8bca21"
Jul 24 20:15:04.001630 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:04.001614    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-8abb86-29748735-lknbq"
Jul 24 20:15:04.001752 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:04.001618    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-8abb86-29748735-lknbq" event={"ID":"a117f9ba-4194-439a-9e43-ac18afba2e6e","Type":"ContainerDied","Data":"9322ff26596492e9dd94e33c221497f65a299fb34b87333617b5b31722184e15"}
Jul 24 20:15:04.001752 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:04.001674    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9322ff26596492e9dd94e33c221497f65a299fb34b87333617b5b31722184e15"
Jul 24 20:15:04.003091 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:04.003064    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3e15b4-29748735-krdmx" event={"ID":"ff3e72dd-c751-482e-af14-4f2a5648b3e8","Type":"ContainerDied","Data":"e97bb3fdcaf04c379e9eb89ddcd1b699af25f990997fcfa8f39717fbaccc2eeb"}
Jul 24 20:15:04.003189 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:04.003116    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e97bb3fdcaf04c379e9eb89ddcd1b699af25f990997fcfa8f39717fbaccc2eeb"
Jul 24 20:15:04.003189 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:04.003079    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3e15b4-29748735-krdmx"
Jul 24 20:15:04.134241 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:04.134212    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-75b982-w98nb"
Jul 24 20:15:04.228610 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:04.228572    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2ea3c37-84ee-49e7-bd0a-a7c07e27ecea-maas-api-service-ca\") pod \"f2ea3c37-84ee-49e7-bd0a-a7c07e27ecea\" (UID: \"f2ea3c37-84ee-49e7-bd0a-a7c07e27ecea\") "
Jul 24 20:15:04.229010 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:04.228986    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2ea3c37-84ee-49e7-bd0a-a7c07e27ecea-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f2ea3c37-84ee-49e7-bd0a-a7c07e27ecea" (UID: "f2ea3c37-84ee-49e7-bd0a-a7c07e27ecea"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:15:04.330209 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:04.330172    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2ea3c37-84ee-49e7-bd0a-a7c07e27ecea-maas-api-service-ca\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:15:05.009269 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:05.009238    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-75b982-w98nb"
Jul 24 20:15:05.009695 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:05.009280    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-75b982-w98nb" event={"ID":"f2ea3c37-84ee-49e7-bd0a-a7c07e27ecea","Type":"ContainerDied","Data":"5d741f9cc1cd733e300a4558f0ae3e63f0e3170b6343678169aedf95a72498fc"}
Jul 24 20:15:05.009695 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:05.009326    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5d741f9cc1cd733e300a4558f0ae3e63f0e3170b6343678169aedf95a72498fc"
Jul 24 20:15:12.735489 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:12.735455    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-75b982-5df486bfd8-mm9sj"]
Jul 24 20:15:12.735963 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:12.735717    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-75b982-5df486bfd8-mm9sj" podUID="c403be60-25ed-4f3f-824f-a84bdc3a90bd" containerName="maas-api" containerID="cri-o://097afc10b4598efc93d33d1eabae459bff807bb2596c4f071a32f3423c0f767d" gracePeriod=30
Jul 24 20:15:12.764625 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:12.764597    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-75b982-29748735-tdtch"]
Jul 24 20:15:12.768404 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:12.768382    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-75b982-29748735-tdtch"]
Jul 24 20:15:12.994021 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:12.993959    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-75b982-5df486bfd8-mm9sj"
Jul 24 20:15:13.058418 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:13.058380    2579 generic.go:356] "Generic (PLEG): container finished" podID="c403be60-25ed-4f3f-824f-a84bdc3a90bd" containerID="097afc10b4598efc93d33d1eabae459bff807bb2596c4f071a32f3423c0f767d" exitCode=0
Jul 24 20:15:13.058611 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:13.058431    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-75b982-5df486bfd8-mm9sj"
Jul 24 20:15:13.058611 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:13.058469    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-75b982-5df486bfd8-mm9sj" event={"ID":"c403be60-25ed-4f3f-824f-a84bdc3a90bd","Type":"ContainerDied","Data":"097afc10b4598efc93d33d1eabae459bff807bb2596c4f071a32f3423c0f767d"}
Jul 24 20:15:13.058611 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:13.058525    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-75b982-5df486bfd8-mm9sj" event={"ID":"c403be60-25ed-4f3f-824f-a84bdc3a90bd","Type":"ContainerDied","Data":"7ccd47643685a27a18de9d369cbbc30647e52180d22daf68534684ceee928805"}
Jul 24 20:15:13.058611 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:13.058552    2579 scope.go:117] "RemoveContainer" containerID="097afc10b4598efc93d33d1eabae459bff807bb2596c4f071a32f3423c0f767d"
Jul 24 20:15:13.067211 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:13.067194    2579 scope.go:117] "RemoveContainer" containerID="097afc10b4598efc93d33d1eabae459bff807bb2596c4f071a32f3423c0f767d"
Jul 24 20:15:13.067471 ip-10-0-131-150 kubenswrapper[2579]: E0724 20:15:13.067454    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"097afc10b4598efc93d33d1eabae459bff807bb2596c4f071a32f3423c0f767d\": container with ID starting with 097afc10b4598efc93d33d1eabae459bff807bb2596c4f071a32f3423c0f767d not found: ID does not exist" containerID="097afc10b4598efc93d33d1eabae459bff807bb2596c4f071a32f3423c0f767d"
Jul 24 20:15:13.067528 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:13.067479    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"097afc10b4598efc93d33d1eabae459bff807bb2596c4f071a32f3423c0f767d"} err="failed to get container status \"097afc10b4598efc93d33d1eabae459bff807bb2596c4f071a32f3423c0f767d\": rpc error: code = NotFound desc = could not find container \"097afc10b4598efc93d33d1eabae459bff807bb2596c4f071a32f3423c0f767d\": container with ID starting with 097afc10b4598efc93d33d1eabae459bff807bb2596c4f071a32f3423c0f767d not found: ID does not exist"
Jul 24 20:15:13.111575 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:13.111536    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrrpt\" (UniqueName: \"kubernetes.io/projected/c403be60-25ed-4f3f-824f-a84bdc3a90bd-kube-api-access-hrrpt\") pod \"c403be60-25ed-4f3f-824f-a84bdc3a90bd\" (UID: \"c403be60-25ed-4f3f-824f-a84bdc3a90bd\") "
Jul 24 20:15:13.111766 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:13.111609    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c403be60-25ed-4f3f-824f-a84bdc3a90bd-openshift-service-ca\") pod \"c403be60-25ed-4f3f-824f-a84bdc3a90bd\" (UID: \"c403be60-25ed-4f3f-824f-a84bdc3a90bd\") "
Jul 24 20:15:13.111766 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:13.111644    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c403be60-25ed-4f3f-824f-a84bdc3a90bd-maas-api-tls\") pod \"c403be60-25ed-4f3f-824f-a84bdc3a90bd\" (UID: \"c403be60-25ed-4f3f-824f-a84bdc3a90bd\") "
Jul 24 20:15:13.112060 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:13.112033    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c403be60-25ed-4f3f-824f-a84bdc3a90bd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c403be60-25ed-4f3f-824f-a84bdc3a90bd" (UID: "c403be60-25ed-4f3f-824f-a84bdc3a90bd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:15:13.113978 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:13.113942    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c403be60-25ed-4f3f-824f-a84bdc3a90bd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c403be60-25ed-4f3f-824f-a84bdc3a90bd" (UID: "c403be60-25ed-4f3f-824f-a84bdc3a90bd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 20:15:13.114141 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:13.114120    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c403be60-25ed-4f3f-824f-a84bdc3a90bd-kube-api-access-hrrpt" (OuterVolumeSpecName: "kube-api-access-hrrpt") pod "c403be60-25ed-4f3f-824f-a84bdc3a90bd" (UID: "c403be60-25ed-4f3f-824f-a84bdc3a90bd"). InnerVolumeSpecName "kube-api-access-hrrpt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:15:13.212651 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:13.212608    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c403be60-25ed-4f3f-824f-a84bdc3a90bd-openshift-service-ca\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:15:13.212651 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:13.212644    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c403be60-25ed-4f3f-824f-a84bdc3a90bd-maas-api-tls\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:15:13.212651 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:13.212658    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrrpt\" (UniqueName: \"kubernetes.io/projected/c403be60-25ed-4f3f-824f-a84bdc3a90bd-kube-api-access-hrrpt\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:15:13.380267 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:13.380235    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-75b982-5df486bfd8-mm9sj"]
Jul 24 20:15:13.382301 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:13.382282    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-75b982-5df486bfd8-mm9sj"]
Jul 24 20:15:14.369938 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:14.369906    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d0ae3f5-233e-4c9b-9e91-fec286457546" path="/var/lib/kubelet/pods/8d0ae3f5-233e-4c9b-9e91-fec286457546/volumes"
Jul 24 20:15:14.370317 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:14.370262    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c403be60-25ed-4f3f-824f-a84bdc3a90bd" path="/var/lib/kubelet/pods/c403be60-25ed-4f3f-824f-a84bdc3a90bd/volumes"
Jul 24 20:15:16.189788 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:16.189753    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 20:15:16.444937 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:16.444852    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-75b982-w98nb"]
Jul 24 20:15:16.449396 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:16.449372    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-75b982-w98nb"]
Jul 24 20:15:18.367768 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:18.367713    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2ea3c37-84ee-49e7-bd0a-a7c07e27ecea" path="/var/lib/kubelet/pods/f2ea3c37-84ee-49e7-bd0a-a7c07e27ecea/volumes"
Jul 24 20:15:22.877261 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:22.877229    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w"]
Jul 24 20:15:22.877661 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:22.877437    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w" podUID="a6907d32-9ab2-44cd-8d8d-0c350dd755a7" containerName="istio-proxy" containerID="cri-o://30dfa61ef74f9ff538e90ffd6c524a1c826b09c9012c69970be25bf6636fbabb" gracePeriod=30
Jul 24 20:15:23.272654 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:23.272618    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8abb86-mqp5p"]
Jul 24 20:15:23.272999 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:23.272985    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a117f9ba-4194-439a-9e43-ac18afba2e6e" containerName="cleanup"
Jul 24 20:15:23.273067 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:23.273002    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a117f9ba-4194-439a-9e43-ac18afba2e6e" containerName="cleanup"
Jul 24 20:15:23.273067 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:23.273014    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4d05bb6-a5c5-4661-98e2-c75d477d6a1d" containerName="cleanup"
Jul 24 20:15:23.273067 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:23.273021    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4d05bb6-a5c5-4661-98e2-c75d477d6a1d" containerName="cleanup"
Jul 24 20:15:23.273067 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:23.273032    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2ea3c37-84ee-49e7-bd0a-a7c07e27ecea" containerName="revoke-keys"
Jul 24 20:15:23.273067 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:23.273038    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2ea3c37-84ee-49e7-bd0a-a7c07e27ecea" containerName="revoke-keys"
Jul 24 20:15:23.273067 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:23.273047    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff3e72dd-c751-482e-af14-4f2a5648b3e8" containerName="cleanup"
Jul 24 20:15:23.273067 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:23.273052    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff3e72dd-c751-482e-af14-4f2a5648b3e8" containerName="cleanup"
Jul 24 20:15:23.273067 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:23.273065    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d0ae3f5-233e-4c9b-9e91-fec286457546" containerName="cleanup"
Jul 24 20:15:23.273067 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:23.273070    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d0ae3f5-233e-4c9b-9e91-fec286457546" containerName="cleanup"
Jul 24 20:15:23.273328 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:23.273077    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c403be60-25ed-4f3f-824f-a84bdc3a90bd" containerName="maas-api"
Jul 24 20:15:23.273328 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:23.273083    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c403be60-25ed-4f3f-824f-a84bdc3a90bd" containerName="maas-api"
Jul 24 20:15:23.273328 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:23.273132    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff3e72dd-c751-482e-af14-4f2a5648b3e8" containerName="cleanup"
Jul 24 20:15:23.273328 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:23.273139    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c403be60-25ed-4f3f-824f-a84bdc3a90bd" containerName="maas-api"
Jul 24 20:15:23.273328 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:23.273146    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2ea3c37-84ee-49e7-bd0a-a7c07e27ecea" containerName="revoke-keys"
Jul 24 20:15:23.273328 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:23.273154    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4d05bb6-a5c5-4661-98e2-c75d477d6a1d" containerName="cleanup"
Jul 24 20:15:23.273328 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:23.273159    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d0ae3f5-233e-4c9b-9e91-fec286457546" containerName="cleanup"
Jul 24 20:15:23.273328 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:23.273164    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a117f9ba-4194-439a-9e43-ac18afba2e6e" containerName="cleanup"
Jul 24 20:15:23.276131 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:23.276115    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8abb86-mqp5p"
Jul 24 20:15:23.278649 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:23.278628    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gqw4p\""
Jul 24 20:15:23.282716 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:23.282690    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8abb86-mqp5p"]
Jul 24 20:15:23.404235 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:23.404198    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e78d8899-53a0-45b3-904b-c7b7837d268a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-8abb86-mqp5p\" (UID: \"e78d8899-53a0-45b3-904b-c7b7837d268a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8abb86-mqp5p"
Jul 24 20:15:23.505556 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:23.505517    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e78d8899-53a0-45b3-904b-c7b7837d268a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-8abb86-mqp5p\" (UID: \"e78d8899-53a0-45b3-904b-c7b7837d268a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8abb86-mqp5p"
Jul 24 20:15:23.506159 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:23.506141    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e78d8899-53a0-45b3-904b-c7b7837d268a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-8abb86-mqp5p\" (UID: \"e78d8899-53a0-45b3-904b-c7b7837d268a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8abb86-mqp5p"
Jul 24 20:15:23.588754 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:23.588659    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8abb86-mqp5p"
Jul 24 20:15:23.720685 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:23.720660    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8abb86-mqp5p"]
Jul 24 20:15:23.722384 ip-10-0-131-150 kubenswrapper[2579]: W0724 20:15:23.722356    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode78d8899_53a0_45b3_904b_c7b7837d268a.slice/crio-6110552d356cb00d75a128ec77b9ab6c44edd863e9af6ff2b4608b3af6c37cf5 WatchSource:0}: Error finding container 6110552d356cb00d75a128ec77b9ab6c44edd863e9af6ff2b4608b3af6c37cf5: Status 404 returned error can't find the container with id 6110552d356cb00d75a128ec77b9ab6c44edd863e9af6ff2b4608b3af6c37cf5
Jul 24 20:15:24.118236 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:24.118200    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8abb86-mqp5p" event={"ID":"e78d8899-53a0-45b3-904b-c7b7837d268a","Type":"ContainerStarted","Data":"08d587d0f195c38e1f5ccebc0ce1ff5510a738129a6eb79c53a94d17c4549840"}
Jul 24 20:15:24.118602 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:24.118252    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8abb86-mqp5p" event={"ID":"e78d8899-53a0-45b3-904b-c7b7837d268a","Type":"ContainerStarted","Data":"6110552d356cb00d75a128ec77b9ab6c44edd863e9af6ff2b4608b3af6c37cf5"}
Jul 24 20:15:24.133292 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:24.133237    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8abb86-mqp5p" podStartSLOduration=1.133222865 podStartE2EDuration="1.133222865s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:15:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:15:24.132999755 +0000 UTC m=+2922.322074070" watchObservedRunningTime="2026-07-24 20:15:24.133222865 +0000 UTC m=+2922.322297177"
Jul 24 20:15:24.813905 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:24.813863    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 20:15:24.814075 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:24.813921    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w" podUID="a6907d32-9ab2-44cd-8d8d-0c350dd755a7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 20:15:25.125290 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:25.125193    2579 generic.go:356] "Generic (PLEG): container finished" podID="e78d8899-53a0-45b3-904b-c7b7837d268a" containerID="08d587d0f195c38e1f5ccebc0ce1ff5510a738129a6eb79c53a94d17c4549840" exitCode=0
Jul 24 20:15:25.125290 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:25.125270    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8abb86-mqp5p" event={"ID":"e78d8899-53a0-45b3-904b-c7b7837d268a","Type":"ContainerDied","Data":"08d587d0f195c38e1f5ccebc0ce1ff5510a738129a6eb79c53a94d17c4549840"}
Jul 24 20:15:26.258430 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:26.258406    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8abb86-mqp5p"
Jul 24 20:15:26.431105 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:26.431009    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e78d8899-53a0-45b3-904b-c7b7837d268a-maas-api-service-ca\") pod \"e78d8899-53a0-45b3-904b-c7b7837d268a\" (UID: \"e78d8899-53a0-45b3-904b-c7b7837d268a\") "
Jul 24 20:15:26.431376 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:26.431353    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e78d8899-53a0-45b3-904b-c7b7837d268a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e78d8899-53a0-45b3-904b-c7b7837d268a" (UID: "e78d8899-53a0-45b3-904b-c7b7837d268a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:15:26.532426 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:26.532389    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e78d8899-53a0-45b3-904b-c7b7837d268a-maas-api-service-ca\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:15:27.136637 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:27.136598    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8abb86-mqp5p" event={"ID":"e78d8899-53a0-45b3-904b-c7b7837d268a","Type":"ContainerDied","Data":"6110552d356cb00d75a128ec77b9ab6c44edd863e9af6ff2b4608b3af6c37cf5"}
Jul 24 20:15:27.136845 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:27.136653    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6110552d356cb00d75a128ec77b9ab6c44edd863e9af6ff2b4608b3af6c37cf5"
Jul 24 20:15:27.136845 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:27.136611    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8abb86-mqp5p"
Jul 24 20:15:28.135544 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:28.135516    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w"
Jul 24 20:15:28.143596 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:28.143523    2579 generic.go:356] "Generic (PLEG): container finished" podID="a6907d32-9ab2-44cd-8d8d-0c350dd755a7" containerID="30dfa61ef74f9ff538e90ffd6c524a1c826b09c9012c69970be25bf6636fbabb" exitCode=0
Jul 24 20:15:28.143596 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:28.143570    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w"
Jul 24 20:15:28.143767 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:28.143621    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w" event={"ID":"a6907d32-9ab2-44cd-8d8d-0c350dd755a7","Type":"ContainerDied","Data":"30dfa61ef74f9ff538e90ffd6c524a1c826b09c9012c69970be25bf6636fbabb"}
Jul 24 20:15:28.143767 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:28.143708    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w" event={"ID":"a6907d32-9ab2-44cd-8d8d-0c350dd755a7","Type":"ContainerDied","Data":"3cfe001948a88e3b18efe4a9f39c9cee9f9fe1cf43e492d57dcdf246140151fe"}
Jul 24 20:15:28.143767 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:28.143743    2579 scope.go:117] "RemoveContainer" containerID="30dfa61ef74f9ff538e90ffd6c524a1c826b09c9012c69970be25bf6636fbabb"
Jul 24 20:15:28.152566 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:28.152545    2579 scope.go:117] "RemoveContainer" containerID="0358c3081d5c2080ace6adeb3dbe3bc279bf6358d6512650357c55cd1ef4d311"
Jul 24 20:15:28.163327 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:28.163310    2579 scope.go:117] "RemoveContainer" containerID="30dfa61ef74f9ff538e90ffd6c524a1c826b09c9012c69970be25bf6636fbabb"
Jul 24 20:15:28.163631 ip-10-0-131-150 kubenswrapper[2579]: E0724 20:15:28.163609    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30dfa61ef74f9ff538e90ffd6c524a1c826b09c9012c69970be25bf6636fbabb\": container with ID starting with 30dfa61ef74f9ff538e90ffd6c524a1c826b09c9012c69970be25bf6636fbabb not found: ID does not exist" containerID="30dfa61ef74f9ff538e90ffd6c524a1c826b09c9012c69970be25bf6636fbabb"
Jul 24 20:15:28.163713 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:28.163638    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30dfa61ef74f9ff538e90ffd6c524a1c826b09c9012c69970be25bf6636fbabb"} err="failed to get container status \"30dfa61ef74f9ff538e90ffd6c524a1c826b09c9012c69970be25bf6636fbabb\": rpc error: code = NotFound desc = could not find container \"30dfa61ef74f9ff538e90ffd6c524a1c826b09c9012c69970be25bf6636fbabb\": container with ID starting with 30dfa61ef74f9ff538e90ffd6c524a1c826b09c9012c69970be25bf6636fbabb not found: ID does not exist"
Jul 24 20:15:28.163713 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:28.163657    2579 scope.go:117] "RemoveContainer" containerID="0358c3081d5c2080ace6adeb3dbe3bc279bf6358d6512650357c55cd1ef4d311"
Jul 24 20:15:28.163965 ip-10-0-131-150 kubenswrapper[2579]: E0724 20:15:28.163936    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0358c3081d5c2080ace6adeb3dbe3bc279bf6358d6512650357c55cd1ef4d311\": container with ID starting with 0358c3081d5c2080ace6adeb3dbe3bc279bf6358d6512650357c55cd1ef4d311 not found: ID does not exist" containerID="0358c3081d5c2080ace6adeb3dbe3bc279bf6358d6512650357c55cd1ef4d311"
Jul 24 20:15:28.164046 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:28.163970    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0358c3081d5c2080ace6adeb3dbe3bc279bf6358d6512650357c55cd1ef4d311"} err="failed to get container status \"0358c3081d5c2080ace6adeb3dbe3bc279bf6358d6512650357c55cd1ef4d311\": rpc error: code = NotFound desc = could not find container \"0358c3081d5c2080ace6adeb3dbe3bc279bf6358d6512650357c55cd1ef4d311\": container with ID starting with 0358c3081d5c2080ace6adeb3dbe3bc279bf6358d6512650357c55cd1ef4d311 not found: ID does not exist"
Jul 24 20:15:28.247462 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:28.247422    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-workload-socket\") pod \"a6907d32-9ab2-44cd-8d8d-0c350dd755a7\" (UID: \"a6907d32-9ab2-44cd-8d8d-0c350dd755a7\") "
Jul 24 20:15:28.247612 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:28.247481    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-istio-podinfo\") pod \"a6907d32-9ab2-44cd-8d8d-0c350dd755a7\" (UID: \"a6907d32-9ab2-44cd-8d8d-0c350dd755a7\") "
Jul 24 20:15:28.247612 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:28.247506    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-credential-socket\") pod \"a6907d32-9ab2-44cd-8d8d-0c350dd755a7\" (UID: \"a6907d32-9ab2-44cd-8d8d-0c350dd755a7\") "
Jul 24 20:15:28.247612 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:28.247529    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-istio-token\") pod \"a6907d32-9ab2-44cd-8d8d-0c350dd755a7\" (UID: \"a6907d32-9ab2-44cd-8d8d-0c350dd755a7\") "
Jul 24 20:15:28.247770 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:28.247642    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-istiod-ca-cert\") pod \"a6907d32-9ab2-44cd-8d8d-0c350dd755a7\" (UID: \"a6907d32-9ab2-44cd-8d8d-0c350dd755a7\") "
Jul 24 20:15:28.247770 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:28.247682    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-istio-envoy\") pod \"a6907d32-9ab2-44cd-8d8d-0c350dd755a7\" (UID: \"a6907d32-9ab2-44cd-8d8d-0c350dd755a7\") "
Jul 24 20:15:28.247770 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:28.247760    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x56vl\" (UniqueName: \"kubernetes.io/projected/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-kube-api-access-x56vl\") pod \"a6907d32-9ab2-44cd-8d8d-0c350dd755a7\" (UID: \"a6907d32-9ab2-44cd-8d8d-0c350dd755a7\") "
Jul 24 20:15:28.247928 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:28.247800    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a6907d32-9ab2-44cd-8d8d-0c350dd755a7" (UID: "a6907d32-9ab2-44cd-8d8d-0c350dd755a7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:15:28.247928 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:28.247830    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-istio-data\") pod \"a6907d32-9ab2-44cd-8d8d-0c350dd755a7\" (UID: \"a6907d32-9ab2-44cd-8d8d-0c350dd755a7\") "
Jul 24 20:15:28.247928 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:28.247841    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a6907d32-9ab2-44cd-8d8d-0c350dd755a7" (UID: "a6907d32-9ab2-44cd-8d8d-0c350dd755a7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:15:28.247928 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:28.247897    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-workload-certs\") pod \"a6907d32-9ab2-44cd-8d8d-0c350dd755a7\" (UID: \"a6907d32-9ab2-44cd-8d8d-0c350dd755a7\") "
Jul 24 20:15:28.248141 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:28.248111    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a6907d32-9ab2-44cd-8d8d-0c350dd755a7" (UID: "a6907d32-9ab2-44cd-8d8d-0c350dd755a7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:15:28.248226 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:28.248208    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-istiod-ca-cert\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:15:28.248313 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:28.248293    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a6907d32-9ab2-44cd-8d8d-0c350dd755a7" (UID: "a6907d32-9ab2-44cd-8d8d-0c350dd755a7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:15:28.248475 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:28.248232    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-workload-socket\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:15:28.248475 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:28.248334    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-credential-socket\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:15:28.248664 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:28.248635    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-istio-data" (OuterVolumeSpecName: "istio-data") pod "a6907d32-9ab2-44cd-8d8d-0c350dd755a7" (UID: "a6907d32-9ab2-44cd-8d8d-0c350dd755a7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:15:28.250125 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:28.250101    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-kube-api-access-x56vl" (OuterVolumeSpecName: "kube-api-access-x56vl") pod "a6907d32-9ab2-44cd-8d8d-0c350dd755a7" (UID: "a6907d32-9ab2-44cd-8d8d-0c350dd755a7"). InnerVolumeSpecName "kube-api-access-x56vl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:15:28.250231 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:28.250175    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a6907d32-9ab2-44cd-8d8d-0c350dd755a7" (UID: "a6907d32-9ab2-44cd-8d8d-0c350dd755a7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 20:15:28.250470 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:28.250454    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-istio-token" (OuterVolumeSpecName: "istio-token") pod "a6907d32-9ab2-44cd-8d8d-0c350dd755a7" (UID: "a6907d32-9ab2-44cd-8d8d-0c350dd755a7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:15:28.250533 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:28.250459    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a6907d32-9ab2-44cd-8d8d-0c350dd755a7" (UID: "a6907d32-9ab2-44cd-8d8d-0c350dd755a7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:15:28.349165 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:28.349106    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-workload-certs\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:15:28.349165 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:28.349156    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-istio-podinfo\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:15:28.349165 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:28.349168    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-istio-token\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:15:28.349165 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:28.349180    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-istio-envoy\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:15:28.349438 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:28.349192    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x56vl\" (UniqueName: \"kubernetes.io/projected/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-kube-api-access-x56vl\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:15:28.349438 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:28.349205    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6907d32-9ab2-44cd-8d8d-0c350dd755a7-istio-data\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:15:28.461857 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:28.461770    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w"]
Jul 24 20:15:28.465536 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:28.465511    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-75b982-openshift-default-9d44f8bbb-59t5w"]
Jul 24 20:15:30.367830 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:30.367773    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6907d32-9ab2-44cd-8d8d-0c350dd755a7" path="/var/lib/kubelet/pods/a6907d32-9ab2-44cd-8d8d-0c350dd755a7/volumes"
Jul 24 20:15:33.927942 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:33.927909    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-8abb86-6c78cc5d99-f6bqn"]
Jul 24 20:15:33.928458 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:33.928145    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8abb86-6c78cc5d99-f6bqn" podUID="1579e386-ae0f-4587-ae13-b73e5e0bbdd7" containerName="maas-api" containerID="cri-o://07d33cb247ff5836cb32cae79eaa6dcb13d746546bec62aac7d6936e7c0f2774" gracePeriod=30
Jul 24 20:15:33.963337 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:33.963297    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-8abb86-29748735-lknbq"]
Jul 24 20:15:33.966368 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:33.966343    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-8abb86-29748735-lknbq"]
Jul 24 20:15:34.178054 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:34.177916    2579 generic.go:356] "Generic (PLEG): container finished" podID="1579e386-ae0f-4587-ae13-b73e5e0bbdd7" containerID="07d33cb247ff5836cb32cae79eaa6dcb13d746546bec62aac7d6936e7c0f2774" exitCode=0
Jul 24 20:15:34.178054 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:34.178008    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8abb86-6c78cc5d99-f6bqn" event={"ID":"1579e386-ae0f-4587-ae13-b73e5e0bbdd7","Type":"ContainerDied","Data":"07d33cb247ff5836cb32cae79eaa6dcb13d746546bec62aac7d6936e7c0f2774"}
Jul 24 20:15:34.178054 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:34.178063    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8abb86-6c78cc5d99-f6bqn" event={"ID":"1579e386-ae0f-4587-ae13-b73e5e0bbdd7","Type":"ContainerDied","Data":"c5dacf85affedbe1815b55ca066188ecf0f87bd1656e99334dde1d24e1b92301"}
Jul 24 20:15:34.178350 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:34.178080    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c5dacf85affedbe1815b55ca066188ecf0f87bd1656e99334dde1d24e1b92301"
Jul 24 20:15:34.178350 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:34.178326    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8abb86-6c78cc5d99-f6bqn"
Jul 24 20:15:34.199293 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:34.199261    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1579e386-ae0f-4587-ae13-b73e5e0bbdd7-openshift-service-ca\") pod \"1579e386-ae0f-4587-ae13-b73e5e0bbdd7\" (UID: \"1579e386-ae0f-4587-ae13-b73e5e0bbdd7\") "
Jul 24 20:15:34.199487 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:34.199369    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cm252\" (UniqueName: \"kubernetes.io/projected/1579e386-ae0f-4587-ae13-b73e5e0bbdd7-kube-api-access-cm252\") pod \"1579e386-ae0f-4587-ae13-b73e5e0bbdd7\" (UID: \"1579e386-ae0f-4587-ae13-b73e5e0bbdd7\") "
Jul 24 20:15:34.199487 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:34.199422    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1579e386-ae0f-4587-ae13-b73e5e0bbdd7-maas-api-tls\") pod \"1579e386-ae0f-4587-ae13-b73e5e0bbdd7\" (UID: \"1579e386-ae0f-4587-ae13-b73e5e0bbdd7\") "
Jul 24 20:15:34.199756 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:34.199704    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1579e386-ae0f-4587-ae13-b73e5e0bbdd7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1579e386-ae0f-4587-ae13-b73e5e0bbdd7" (UID: "1579e386-ae0f-4587-ae13-b73e5e0bbdd7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:15:34.201739 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:34.201699    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1579e386-ae0f-4587-ae13-b73e5e0bbdd7-kube-api-access-cm252" (OuterVolumeSpecName: "kube-api-access-cm252") pod "1579e386-ae0f-4587-ae13-b73e5e0bbdd7" (UID: "1579e386-ae0f-4587-ae13-b73e5e0bbdd7"). InnerVolumeSpecName "kube-api-access-cm252". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:15:34.202405 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:34.202381    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1579e386-ae0f-4587-ae13-b73e5e0bbdd7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1579e386-ae0f-4587-ae13-b73e5e0bbdd7" (UID: "1579e386-ae0f-4587-ae13-b73e5e0bbdd7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 20:15:34.300239 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:34.300208    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cm252\" (UniqueName: \"kubernetes.io/projected/1579e386-ae0f-4587-ae13-b73e5e0bbdd7-kube-api-access-cm252\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:15:34.300239 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:34.300235    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1579e386-ae0f-4587-ae13-b73e5e0bbdd7-maas-api-tls\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:15:34.300239 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:34.300246    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1579e386-ae0f-4587-ae13-b73e5e0bbdd7-openshift-service-ca\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:15:34.367526 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:34.367489    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a117f9ba-4194-439a-9e43-ac18afba2e6e" path="/var/lib/kubelet/pods/a117f9ba-4194-439a-9e43-ac18afba2e6e/volumes"
Jul 24 20:15:35.183157 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:35.183116    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8abb86-6c78cc5d99-f6bqn"
Jul 24 20:15:35.203504 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:35.203463    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-8abb86-6c78cc5d99-f6bqn"]
Jul 24 20:15:35.207301 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:35.207269    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-8abb86-6c78cc5d99-f6bqn"]
Jul 24 20:15:36.368828 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:36.368793    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1579e386-ae0f-4587-ae13-b73e5e0bbdd7" path="/var/lib/kubelet/pods/1579e386-ae0f-4587-ae13-b73e5e0bbdd7/volumes"
Jul 24 20:15:37.093661 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:37.093621    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 20:15:38.420792 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:38.420756    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8abb86-mqp5p"]
Jul 24 20:15:38.422792 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:38.422770    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8abb86-mqp5p"]
Jul 24 20:15:40.367647 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:40.367608    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e78d8899-53a0-45b3-904b-c7b7837d268a" path="/var/lib/kubelet/pods/e78d8899-53a0-45b3-904b-c7b7837d268a/volumes"
Jul 24 20:15:42.859593 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:42.859566    2579 scope.go:117] "RemoveContainer" containerID="07d33cb247ff5836cb32cae79eaa6dcb13d746546bec62aac7d6936e7c0f2774"
Jul 24 20:15:45.550743 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:45.550684    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3e15b4-6lhtz"]
Jul 24 20:15:45.551128 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:45.551063    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6907d32-9ab2-44cd-8d8d-0c350dd755a7" containerName="istio-proxy"
Jul 24 20:15:45.551128 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:45.551077    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6907d32-9ab2-44cd-8d8d-0c350dd755a7" containerName="istio-proxy"
Jul 24 20:15:45.551128 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:45.551089    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1579e386-ae0f-4587-ae13-b73e5e0bbdd7" containerName="maas-api"
Jul 24 20:15:45.551128 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:45.551095    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1579e386-ae0f-4587-ae13-b73e5e0bbdd7" containerName="maas-api"
Jul 24 20:15:45.551128 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:45.551114    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e78d8899-53a0-45b3-904b-c7b7837d268a" containerName="revoke-keys"
Jul 24 20:15:45.551128 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:45.551120    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e78d8899-53a0-45b3-904b-c7b7837d268a" containerName="revoke-keys"
Jul 24 20:15:45.551312 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:45.551172    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6907d32-9ab2-44cd-8d8d-0c350dd755a7" containerName="istio-proxy"
Jul 24 20:15:45.551312 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:45.551180    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e78d8899-53a0-45b3-904b-c7b7837d268a" containerName="revoke-keys"
Jul 24 20:15:45.551312 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:45.551190    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1579e386-ae0f-4587-ae13-b73e5e0bbdd7" containerName="maas-api"
Jul 24 20:15:45.555627 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:45.555610    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3e15b4-6lhtz"
Jul 24 20:15:45.558213 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:45.558188    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gqw4p\""
Jul 24 20:15:45.561335 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:45.561310    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3e15b4-6lhtz"]
Jul 24 20:15:45.602694 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:45.602665    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b6be25b-c258-4e89-9eaa-3d49402f1acb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-3e15b4-6lhtz\" (UID: \"6b6be25b-c258-4e89-9eaa-3d49402f1acb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3e15b4-6lhtz"
Jul 24 20:15:45.704119 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:45.704073    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b6be25b-c258-4e89-9eaa-3d49402f1acb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-3e15b4-6lhtz\" (UID: \"6b6be25b-c258-4e89-9eaa-3d49402f1acb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3e15b4-6lhtz"
Jul 24 20:15:45.704780 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:45.704761    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b6be25b-c258-4e89-9eaa-3d49402f1acb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-3e15b4-6lhtz\" (UID: \"6b6be25b-c258-4e89-9eaa-3d49402f1acb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3e15b4-6lhtz"
Jul 24 20:15:45.868231 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:45.868146    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3e15b4-6lhtz"
Jul 24 20:15:45.999889 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:45.999857    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3e15b4-6lhtz"]
Jul 24 20:15:46.001418 ip-10-0-131-150 kubenswrapper[2579]: W0724 20:15:46.001389    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b6be25b_c258_4e89_9eaa_3d49402f1acb.slice/crio-ebc9b8dda22bdb955ef2790015a1d126a733d1ca059f0fe03c253deea6d47fe3 WatchSource:0}: Error finding container ebc9b8dda22bdb955ef2790015a1d126a733d1ca059f0fe03c253deea6d47fe3: Status 404 returned error can't find the container with id ebc9b8dda22bdb955ef2790015a1d126a733d1ca059f0fe03c253deea6d47fe3
Jul 24 20:15:46.242376 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:46.242335    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3e15b4-6lhtz" event={"ID":"6b6be25b-c258-4e89-9eaa-3d49402f1acb","Type":"ContainerStarted","Data":"b69336bbe9aeb05858ccf8c4236300f0d75a619ed73a52323fb26ea1560a0aa7"}
Jul 24 20:15:46.242685 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:46.242400    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3e15b4-6lhtz" event={"ID":"6b6be25b-c258-4e89-9eaa-3d49402f1acb","Type":"ContainerStarted","Data":"ebc9b8dda22bdb955ef2790015a1d126a733d1ca059f0fe03c253deea6d47fe3"}
Jul 24 20:15:46.258026 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:46.257979    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3e15b4-6lhtz" podStartSLOduration=1.25796583 podStartE2EDuration="1.25796583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:15:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:15:46.257520803 +0000 UTC m=+2944.446595119" watchObservedRunningTime="2026-07-24 20:15:46.25796583 +0000 UTC m=+2944.447040189"
Jul 24 20:15:47.249401 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:47.249370    2579 generic.go:356] "Generic (PLEG): container finished" podID="6b6be25b-c258-4e89-9eaa-3d49402f1acb" containerID="b69336bbe9aeb05858ccf8c4236300f0d75a619ed73a52323fb26ea1560a0aa7" exitCode=0
Jul 24 20:15:47.249825 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:47.249410    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3e15b4-6lhtz" event={"ID":"6b6be25b-c258-4e89-9eaa-3d49402f1acb","Type":"ContainerDied","Data":"b69336bbe9aeb05858ccf8c4236300f0d75a619ed73a52323fb26ea1560a0aa7"}
Jul 24 20:15:48.388993 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:48.388969    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3e15b4-6lhtz"
Jul 24 20:15:48.527789 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:48.527673    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b6be25b-c258-4e89-9eaa-3d49402f1acb-maas-api-service-ca\") pod \"6b6be25b-c258-4e89-9eaa-3d49402f1acb\" (UID: \"6b6be25b-c258-4e89-9eaa-3d49402f1acb\") "
Jul 24 20:15:48.528066 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:48.528045    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b6be25b-c258-4e89-9eaa-3d49402f1acb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6b6be25b-c258-4e89-9eaa-3d49402f1acb" (UID: "6b6be25b-c258-4e89-9eaa-3d49402f1acb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:15:48.629093 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:48.629057    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b6be25b-c258-4e89-9eaa-3d49402f1acb-maas-api-service-ca\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:15:49.261454 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:49.261424    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3e15b4-6lhtz"
Jul 24 20:15:49.261641 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:49.261451    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3e15b4-6lhtz" event={"ID":"6b6be25b-c258-4e89-9eaa-3d49402f1acb","Type":"ContainerDied","Data":"ebc9b8dda22bdb955ef2790015a1d126a733d1ca059f0fe03c253deea6d47fe3"}
Jul 24 20:15:49.261641 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:49.261495    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ebc9b8dda22bdb955ef2790015a1d126a733d1ca059f0fe03c253deea6d47fe3"
Jul 24 20:15:56.581917 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:56.581884    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-3e15b4-cccb98ffc-2lc4v"]
Jul 24 20:15:56.582335 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:56.582122    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3e15b4-cccb98ffc-2lc4v" podUID="bb0e69f5-ba51-4ed3-8d60-572b157f7bc0" containerName="maas-api" containerID="cri-o://9765627aa419b42fd9cc1311d5d524ee281c793ffea5cb7772a7a94e33359046" gracePeriod=30
Jul 24 20:15:56.615414 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:56.615377    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3e15b4-29748735-krdmx"]
Jul 24 20:15:56.619766 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:56.619739    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3e15b4-29748735-krdmx"]
Jul 24 20:15:56.847327 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:56.847296    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3e15b4-cccb98ffc-2lc4v"
Jul 24 20:15:57.006351 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:57.006314    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpfgl\" (UniqueName: \"kubernetes.io/projected/bb0e69f5-ba51-4ed3-8d60-572b157f7bc0-kube-api-access-hpfgl\") pod \"bb0e69f5-ba51-4ed3-8d60-572b157f7bc0\" (UID: \"bb0e69f5-ba51-4ed3-8d60-572b157f7bc0\") "
Jul 24 20:15:57.006541 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:57.006399    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb0e69f5-ba51-4ed3-8d60-572b157f7bc0-maas-api-tls\") pod \"bb0e69f5-ba51-4ed3-8d60-572b157f7bc0\" (UID: \"bb0e69f5-ba51-4ed3-8d60-572b157f7bc0\") "
Jul 24 20:15:57.006541 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:57.006423    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb0e69f5-ba51-4ed3-8d60-572b157f7bc0-openshift-service-ca\") pod \"bb0e69f5-ba51-4ed3-8d60-572b157f7bc0\" (UID: \"bb0e69f5-ba51-4ed3-8d60-572b157f7bc0\") "
Jul 24 20:15:57.006891 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:57.006865    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb0e69f5-ba51-4ed3-8d60-572b157f7bc0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bb0e69f5-ba51-4ed3-8d60-572b157f7bc0" (UID: "bb0e69f5-ba51-4ed3-8d60-572b157f7bc0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:15:57.008612 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:57.008590    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb0e69f5-ba51-4ed3-8d60-572b157f7bc0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bb0e69f5-ba51-4ed3-8d60-572b157f7bc0" (UID: "bb0e69f5-ba51-4ed3-8d60-572b157f7bc0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 20:15:57.008612 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:57.008594    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb0e69f5-ba51-4ed3-8d60-572b157f7bc0-kube-api-access-hpfgl" (OuterVolumeSpecName: "kube-api-access-hpfgl") pod "bb0e69f5-ba51-4ed3-8d60-572b157f7bc0" (UID: "bb0e69f5-ba51-4ed3-8d60-572b157f7bc0"). InnerVolumeSpecName "kube-api-access-hpfgl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:15:57.107947 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:57.107850    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb0e69f5-ba51-4ed3-8d60-572b157f7bc0-openshift-service-ca\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:15:57.107947 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:57.107881    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpfgl\" (UniqueName: \"kubernetes.io/projected/bb0e69f5-ba51-4ed3-8d60-572b157f7bc0-kube-api-access-hpfgl\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:15:57.107947 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:57.107894    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb0e69f5-ba51-4ed3-8d60-572b157f7bc0-maas-api-tls\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 24 20:15:57.303091 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:57.303060    2579 generic.go:356] "Generic (PLEG): container finished" podID="bb0e69f5-ba51-4ed3-8d60-572b157f7bc0" containerID="9765627aa419b42fd9cc1311d5d524ee281c793ffea5cb7772a7a94e33359046" exitCode=0
Jul 24 20:15:57.303264 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:57.303106    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3e15b4-cccb98ffc-2lc4v"
Jul 24 20:15:57.303264 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:57.303158    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3e15b4-cccb98ffc-2lc4v" event={"ID":"bb0e69f5-ba51-4ed3-8d60-572b157f7bc0","Type":"ContainerDied","Data":"9765627aa419b42fd9cc1311d5d524ee281c793ffea5cb7772a7a94e33359046"}
Jul 24 20:15:57.303264 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:57.303205    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3e15b4-cccb98ffc-2lc4v" event={"ID":"bb0e69f5-ba51-4ed3-8d60-572b157f7bc0","Type":"ContainerDied","Data":"51b422490764161c98a3534d0e38cc46fdb81e59b403ef54f2ffc34e5fabaf57"}
Jul 24 20:15:57.303264 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:57.303230    2579 scope.go:117] "RemoveContainer" containerID="9765627aa419b42fd9cc1311d5d524ee281c793ffea5cb7772a7a94e33359046"
Jul 24 20:15:57.314854 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:57.314828    2579 scope.go:117] "RemoveContainer" containerID="9765627aa419b42fd9cc1311d5d524ee281c793ffea5cb7772a7a94e33359046"
Jul 24 20:15:57.315234 ip-10-0-131-150 kubenswrapper[2579]: E0724 20:15:57.315206    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9765627aa419b42fd9cc1311d5d524ee281c793ffea5cb7772a7a94e33359046\": container with ID starting with 9765627aa419b42fd9cc1311d5d524ee281c793ffea5cb7772a7a94e33359046 not found: ID does not exist" containerID="9765627aa419b42fd9cc1311d5d524ee281c793ffea5cb7772a7a94e33359046"
Jul 24 20:15:57.315323 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:57.315235    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9765627aa419b42fd9cc1311d5d524ee281c793ffea5cb7772a7a94e33359046"} err="failed to get container status \"9765627aa419b42fd9cc1311d5d524ee281c793ffea5cb7772a7a94e33359046\": rpc error: code = NotFound desc = could not find container \"9765627aa419b42fd9cc1311d5d524ee281c793ffea5cb7772a7a94e33359046\": container with ID starting with 9765627aa419b42fd9cc1311d5d524ee281c793ffea5cb7772a7a94e33359046 not found: ID does not exist"
Jul 24 20:15:57.325080 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:57.325054    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-3e15b4-cccb98ffc-2lc4v"]
Jul 24 20:15:57.330591 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:57.330567    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-3e15b4-cccb98ffc-2lc4v"]
Jul 24 20:15:58.367615 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:58.367577    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb0e69f5-ba51-4ed3-8d60-572b157f7bc0" path="/var/lib/kubelet/pods/bb0e69f5-ba51-4ed3-8d60-572b157f7bc0/volumes"
Jul 24 20:15:58.368019 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:58.367886    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff3e72dd-c751-482e-af14-4f2a5648b3e8" path="/var/lib/kubelet/pods/ff3e72dd-c751-482e-af14-4f2a5648b3e8/volumes"
Jul 24 20:15:59.480762 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:15:59.480706    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f9dbl"]
Jul 24 20:16:00.630651 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:00.630613    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3e15b4-6lhtz"]
Jul 24 20:16:00.634332 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:00.634296    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3e15b4-6lhtz"]
Jul 24 20:16:02.367484 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:02.367451    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b6be25b-c258-4e89-9eaa-3d49402f1acb" path="/var/lib/kubelet/pods/6b6be25b-c258-4e89-9eaa-3d49402f1acb/volumes"
Jul 24 20:16:13.887353 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:13.887318    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69f558d7f4-bkbhr_44523b7e-3dd0-49ef-bf8c-7b2175e0f913/copy-manifests/0.log"
Jul 24 20:16:13.894111 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:13.894087    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69f558d7f4-bkbhr_44523b7e-3dd0-49ef-bf8c-7b2175e0f913/manager/0.log"
Jul 24 20:16:14.597392 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:14.597366    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29748720-28c95_9206d489-876d-4124-ad4b-0eccf3d1025c/cleanup/0.log"
Jul 24 20:16:14.713492 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:14.713462    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29748735-j89d2_c4d05bb6-a5c5-4661-98e2-c75d477d6a1d/cleanup/0.log"
Jul 24 20:16:15.591471 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:15.591441    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbpsc_9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7/util/0.log"
Jul 24 20:16:15.598028 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:15.598009    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbpsc_9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7/pull/0.log"
Jul 24 20:16:15.604516 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:15.604500    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbpsc_9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7/extract/0.log"
Jul 24 20:16:15.718684 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:15.718656    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l265r_55803b5e-0a8a-4fb8-be43-66ae2384ae83/util/0.log"
Jul 24 20:16:15.725692 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:15.725672    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l265r_55803b5e-0a8a-4fb8-be43-66ae2384ae83/pull/0.log"
Jul 24 20:16:15.732553 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:15.732535    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l265r_55803b5e-0a8a-4fb8-be43-66ae2384ae83/extract/0.log"
Jul 24 20:16:15.850238 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:15.850157    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73284sb_6ba14f7d-5712-47c8-b953-7dd2ae929de2/extract/0.log"
Jul 24 20:16:15.856673 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:15.856655    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73284sb_6ba14f7d-5712-47c8-b953-7dd2ae929de2/util/0.log"
Jul 24 20:16:15.862950 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:15.862929    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73284sb_6ba14f7d-5712-47c8-b953-7dd2ae929de2/pull/0.log"
Jul 24 20:16:15.978326 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:15.978295    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldnfs_648defd1-90ce-4050-b16a-b7d4e987b2ae/util/0.log"
Jul 24 20:16:15.987937 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:15.987909    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldnfs_648defd1-90ce-4050-b16a-b7d4e987b2ae/pull/0.log"
Jul 24 20:16:15.994356 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:15.994337    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldnfs_648defd1-90ce-4050-b16a-b7d4e987b2ae/extract/0.log"
Jul 24 20:16:16.800192 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:16.800151    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-f9dbl_c37179b3-74c5-4aa0-85be-27cda6e021e1/limitador/0.log"
Jul 24 20:16:17.393329 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:17.393298    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-pjn9h_2048cb12-40b5-4a3f-99d3-3c99a9654d21/discovery/0.log"
Jul 24 20:16:18.446661 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:18.446628    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-5zptw_0dd37235-69bc-473d-bfde-a02cbdde454a/main/0.log"
Jul 24 20:16:18.898915 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:18.898870    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-sk6sd_0a948a2a-9db9-48ac-b7d3-a22976d0f6b6/main/0.log"
Jul 24 20:16:26.799549 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:26.799510    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gkd6m_73db2676-b431-4046-8290-c4813da2ee8a/global-pull-secret-syncer/0.log"
Jul 24 20:16:26.995589 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:26.995546    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-v4nt7_c9faba17-c794-48f7-8416-b44094cd8946/konnectivity-agent/0.log"
Jul 24 20:16:27.017315 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:27.017291    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-150.ec2.internal_1188e37e92b4900d2886b98231ddef72/haproxy/0.log"
Jul 24 20:16:31.661504 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:31.661476    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbpsc_9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7/extract/0.log"
Jul 24 20:16:31.683595 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:31.683566    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbpsc_9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7/util/0.log"
Jul 24 20:16:31.704258 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:31.704234    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xbpsc_9378ca0e-2bbe-4ba0-be59-d3a28e83b1b7/pull/0.log"
Jul 24 20:16:31.732262 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:31.732241    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l265r_55803b5e-0a8a-4fb8-be43-66ae2384ae83/extract/0.log"
Jul 24 20:16:31.758579 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:31.758551    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l265r_55803b5e-0a8a-4fb8-be43-66ae2384ae83/util/0.log"
Jul 24 20:16:31.783083 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:31.783059    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l265r_55803b5e-0a8a-4fb8-be43-66ae2384ae83/pull/0.log"
Jul 24 20:16:31.816190 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:31.816167    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73284sb_6ba14f7d-5712-47c8-b953-7dd2ae929de2/extract/0.log"
Jul 24 20:16:31.844512 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:31.844485    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73284sb_6ba14f7d-5712-47c8-b953-7dd2ae929de2/util/0.log"
Jul 24 20:16:31.867095 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:31.867069    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73284sb_6ba14f7d-5712-47c8-b953-7dd2ae929de2/pull/0.log"
Jul 24 20:16:31.903786 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:31.903753    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldnfs_648defd1-90ce-4050-b16a-b7d4e987b2ae/extract/0.log"
Jul 24 20:16:31.925381 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:31.925310    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldnfs_648defd1-90ce-4050-b16a-b7d4e987b2ae/util/0.log"
Jul 24 20:16:31.947490 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:31.947466    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldnfs_648defd1-90ce-4050-b16a-b7d4e987b2ae/pull/0.log"
Jul 24 20:16:32.762464 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:32.762433    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-f9dbl_c37179b3-74c5-4aa0-85be-27cda6e021e1/limitador/0.log"
Jul 24 20:16:34.792088 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:34.792062    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6c6f46f7d7-7vlj7_96ef1151-e47f-43cd-aa8a-f694946ebdd2/metrics-server/0.log"
Jul 24 20:16:34.816455 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:34.816427    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-j8jrm_8e699ccc-1856-474a-8883-86c069c35908/monitoring-plugin/0.log"
Jul 24 20:16:35.023308 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:35.023279    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tccp4_f8f9659f-393d-44e8-9868-2fadd68ed84e/node-exporter/0.log"
Jul 24 20:16:35.047831 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:35.047766    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tccp4_f8f9659f-393d-44e8-9868-2fadd68ed84e/kube-rbac-proxy/0.log"
Jul 24 20:16:35.068894 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:35.068873    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tccp4_f8f9659f-393d-44e8-9868-2fadd68ed84e/init-textfile/0.log"
Jul 24 20:16:35.095473 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:35.095435    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-p9r7q_cb1831e3-c869-460e-9a83-f1e89cdcd60e/kube-rbac-proxy-main/0.log"
Jul 24 20:16:35.116717 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:35.116693    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-p9r7q_cb1831e3-c869-460e-9a83-f1e89cdcd60e/kube-rbac-proxy-self/0.log"
Jul 24 20:16:35.139976 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:35.139952    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-p9r7q_cb1831e3-c869-460e-9a83-f1e89cdcd60e/openshift-state-metrics/0.log"
Jul 24 20:16:35.518152 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:35.518127    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55567cf595-p7tz9_7a8c5fa6-637c-433c-9821-fd8e094a587f/thanos-query/0.log"
Jul 24 20:16:35.539036 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:35.539013    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55567cf595-p7tz9_7a8c5fa6-637c-433c-9821-fd8e094a587f/kube-rbac-proxy-web/0.log"
Jul 24 20:16:35.570759 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:35.570683    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55567cf595-p7tz9_7a8c5fa6-637c-433c-9821-fd8e094a587f/kube-rbac-proxy/0.log"
Jul 24 20:16:35.593054 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:35.593032    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55567cf595-p7tz9_7a8c5fa6-637c-433c-9821-fd8e094a587f/prom-label-proxy/0.log"
Jul 24 20:16:35.613492 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:35.613433    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55567cf595-p7tz9_7a8c5fa6-637c-433c-9821-fd8e094a587f/kube-rbac-proxy-rules/0.log"
Jul 24 20:16:35.635223 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:35.635190    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55567cf595-p7tz9_7a8c5fa6-637c-433c-9821-fd8e094a587f/kube-rbac-proxy-metrics/0.log"
Jul 24 20:16:36.740874 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:36.740837    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-g4kbv/perf-node-gather-daemonset-2rk72"]
Jul 24 20:16:36.741276 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:36.741157    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb0e69f5-ba51-4ed3-8d60-572b157f7bc0" containerName="maas-api"
Jul 24 20:16:36.741276 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:36.741170    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb0e69f5-ba51-4ed3-8d60-572b157f7bc0" containerName="maas-api"
Jul 24 20:16:36.741276 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:36.741186    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b6be25b-c258-4e89-9eaa-3d49402f1acb" containerName="revoke-keys"
Jul 24 20:16:36.741276 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:36.741192    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b6be25b-c258-4e89-9eaa-3d49402f1acb" containerName="revoke-keys"
Jul 24 20:16:36.741276 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:36.741204    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6907d32-9ab2-44cd-8d8d-0c350dd755a7" containerName="istio-proxy"
Jul 24 20:16:36.741276 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:36.741210    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6907d32-9ab2-44cd-8d8d-0c350dd755a7" containerName="istio-proxy"
Jul 24 20:16:36.741276 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:36.741256    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb0e69f5-ba51-4ed3-8d60-572b157f7bc0" containerName="maas-api"
Jul 24 20:16:36.741276 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:36.741265    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6907d32-9ab2-44cd-8d8d-0c350dd755a7" containerName="istio-proxy"
Jul 24 20:16:36.741276 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:36.741274    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b6be25b-c258-4e89-9eaa-3d49402f1acb" containerName="revoke-keys"
Jul 24 20:16:36.744887 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:36.744867    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g4kbv/perf-node-gather-daemonset-2rk72"
Jul 24 20:16:36.747589 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:36.747570    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g4kbv\"/\"openshift-service-ca.crt\""
Jul 24 20:16:36.747765 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:36.747741    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g4kbv\"/\"kube-root-ca.crt\""
Jul 24 20:16:36.748488 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:36.748471    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-g4kbv\"/\"default-dockercfg-d5j6l\""
Jul 24 20:16:36.753576 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:36.753552    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g4kbv/perf-node-gather-daemonset-2rk72"]
Jul 24 20:16:36.845746 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:36.845674    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkm57\" (UniqueName: \"kubernetes.io/projected/bd2b6891-31ad-4608-b259-45cc470dece9-kube-api-access-mkm57\") pod \"perf-node-gather-daemonset-2rk72\" (UID: \"bd2b6891-31ad-4608-b259-45cc470dece9\") " pod="openshift-must-gather-g4kbv/perf-node-gather-daemonset-2rk72"
Jul 24 20:16:36.845952 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:36.845778    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd2b6891-31ad-4608-b259-45cc470dece9-sys\") pod \"perf-node-gather-daemonset-2rk72\" (UID: \"bd2b6891-31ad-4608-b259-45cc470dece9\") " pod="openshift-must-gather-g4kbv/perf-node-gather-daemonset-2rk72"
Jul 24 20:16:36.845952 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:36.845870    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd2b6891-31ad-4608-b259-45cc470dece9-lib-modules\") pod \"perf-node-gather-daemonset-2rk72\" (UID: \"bd2b6891-31ad-4608-b259-45cc470dece9\") " pod="openshift-must-gather-g4kbv/perf-node-gather-daemonset-2rk72"
Jul 24 20:16:36.845952 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:36.845899    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bd2b6891-31ad-4608-b259-45cc470dece9-podres\") pod \"perf-node-gather-daemonset-2rk72\" (UID: \"bd2b6891-31ad-4608-b259-45cc470dece9\") " pod="openshift-must-gather-g4kbv/perf-node-gather-daemonset-2rk72"
Jul 24 20:16:36.845952 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:36.845933    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bd2b6891-31ad-4608-b259-45cc470dece9-proc\") pod \"perf-node-gather-daemonset-2rk72\" (UID: \"bd2b6891-31ad-4608-b259-45cc470dece9\") " pod="openshift-must-gather-g4kbv/perf-node-gather-daemonset-2rk72"
Jul 24 20:16:36.947205 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:36.947166    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkm57\" (UniqueName: \"kubernetes.io/projected/bd2b6891-31ad-4608-b259-45cc470dece9-kube-api-access-mkm57\") pod \"perf-node-gather-daemonset-2rk72\" (UID: \"bd2b6891-31ad-4608-b259-45cc470dece9\") " pod="openshift-must-gather-g4kbv/perf-node-gather-daemonset-2rk72"
Jul 24 20:16:36.947205 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:36.947211    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd2b6891-31ad-4608-b259-45cc470dece9-sys\") pod \"perf-node-gather-daemonset-2rk72\" (UID: \"bd2b6891-31ad-4608-b259-45cc470dece9\") " pod="openshift-must-gather-g4kbv/perf-node-gather-daemonset-2rk72"
Jul 24 20:16:36.947461 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:36.947282    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd2b6891-31ad-4608-b259-45cc470dece9-sys\") pod \"perf-node-gather-daemonset-2rk72\" (UID: \"bd2b6891-31ad-4608-b259-45cc470dece9\") " pod="openshift-must-gather-g4kbv/perf-node-gather-daemonset-2rk72"
Jul 24 20:16:36.947461 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:36.947332    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd2b6891-31ad-4608-b259-45cc470dece9-lib-modules\") pod \"perf-node-gather-daemonset-2rk72\" (UID: \"bd2b6891-31ad-4608-b259-45cc470dece9\") " pod="openshift-must-gather-g4kbv/perf-node-gather-daemonset-2rk72"
Jul 24 20:16:36.947461 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:36.947377    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bd2b6891-31ad-4608-b259-45cc470dece9-podres\") pod \"perf-node-gather-daemonset-2rk72\" (UID: \"bd2b6891-31ad-4608-b259-45cc470dece9\") " pod="openshift-must-gather-g4kbv/perf-node-gather-daemonset-2rk72"
Jul 24 20:16:36.947461 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:36.947408    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bd2b6891-31ad-4608-b259-45cc470dece9-proc\") pod \"perf-node-gather-daemonset-2rk72\" (UID: \"bd2b6891-31ad-4608-b259-45cc470dece9\") " pod="openshift-must-gather-g4kbv/perf-node-gather-daemonset-2rk72"
Jul 24 20:16:36.947630 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:36.947521    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bd2b6891-31ad-4608-b259-45cc470dece9-proc\") pod \"perf-node-gather-daemonset-2rk72\" (UID: \"bd2b6891-31ad-4608-b259-45cc470dece9\") " pod="openshift-must-gather-g4kbv/perf-node-gather-daemonset-2rk72"
Jul 24 20:16:36.947630 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:36.947523    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd2b6891-31ad-4608-b259-45cc470dece9-lib-modules\") pod \"perf-node-gather-daemonset-2rk72\" (UID: \"bd2b6891-31ad-4608-b259-45cc470dece9\") " pod="openshift-must-gather-g4kbv/perf-node-gather-daemonset-2rk72"
Jul 24 20:16:36.947630 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:36.947553    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bd2b6891-31ad-4608-b259-45cc470dece9-podres\") pod \"perf-node-gather-daemonset-2rk72\" (UID: \"bd2b6891-31ad-4608-b259-45cc470dece9\") " pod="openshift-must-gather-g4kbv/perf-node-gather-daemonset-2rk72"
Jul 24 20:16:36.955635 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:36.955596    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkm57\" (UniqueName: \"kubernetes.io/projected/bd2b6891-31ad-4608-b259-45cc470dece9-kube-api-access-mkm57\") pod \"perf-node-gather-daemonset-2rk72\" (UID: \"bd2b6891-31ad-4608-b259-45cc470dece9\") " pod="openshift-must-gather-g4kbv/perf-node-gather-daemonset-2rk72"
Jul 24 20:16:37.056317 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:37.056284    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g4kbv/perf-node-gather-daemonset-2rk72"
Jul 24 20:16:37.188664 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:37.188636    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g4kbv/perf-node-gather-daemonset-2rk72"]
Jul 24 20:16:37.190526 ip-10-0-131-150 kubenswrapper[2579]: W0724 20:16:37.190496    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbd2b6891_31ad_4608_b259_45cc470dece9.slice/crio-e322f2c5519572c33cdd3489525b5c1f1bd6ad97e7fb3d9e4a16c5bfe035c983 WatchSource:0}: Error finding container e322f2c5519572c33cdd3489525b5c1f1bd6ad97e7fb3d9e4a16c5bfe035c983: Status 404 returned error can't find the container with id e322f2c5519572c33cdd3489525b5c1f1bd6ad97e7fb3d9e4a16c5bfe035c983
Jul 24 20:16:37.517249 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:37.517211    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g4kbv/perf-node-gather-daemonset-2rk72" event={"ID":"bd2b6891-31ad-4608-b259-45cc470dece9","Type":"ContainerStarted","Data":"af2c9a0f45b49f849c01a5ed1e53bb49e6865d57d89a2ab84cf2c1ebca910f77"}
Jul 24 20:16:37.517431 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:37.517272    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-g4kbv/perf-node-gather-daemonset-2rk72"
Jul 24 20:16:37.517431 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:37.517289    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g4kbv/perf-node-gather-daemonset-2rk72" event={"ID":"bd2b6891-31ad-4608-b259-45cc470dece9","Type":"ContainerStarted","Data":"e322f2c5519572c33cdd3489525b5c1f1bd6ad97e7fb3d9e4a16c5bfe035c983"}
Jul 24 20:16:37.534867 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:37.534816    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-g4kbv/perf-node-gather-daemonset-2rk72" podStartSLOduration=1.5348005169999999 podStartE2EDuration="1.534800517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 20:16:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:16:37.533198951 +0000 UTC m=+2995.722273265" watchObservedRunningTime="2026-07-24 20:16:37.534800517 +0000 UTC m=+2995.723874831"
Jul 24 20:16:39.473821 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:39.473793    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gcmpj_e143a2cc-07ac-4ca4-917a-493cd1053866/dns/0.log"
Jul 24 20:16:39.495438 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:39.495408    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gcmpj_e143a2cc-07ac-4ca4-917a-493cd1053866/kube-rbac-proxy/0.log"
Jul 24 20:16:39.609692 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:39.609655    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ctz4q_dd30d02e-4ca3-4014-85f3-b809471d2ad8/dns-node-resolver/0.log"
Jul 24 20:16:40.175100 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:40.175068    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6dbd567794-jpt64_cffc2cc7-f0ca-4b98-a0b2-58fdfbdd2e90/registry/0.log"
Jul 24 20:16:40.228823 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:40.228790    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d8zx6_d2eb9885-1490-41e3-8e05-2a21ed230573/node-ca/0.log"
Jul 24 20:16:41.318629 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:41.318596    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-pjn9h_2048cb12-40b5-4a3f-99d3-3c99a9654d21/discovery/0.log"
Jul 24 20:16:42.296645 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:42.296613    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lrf4t_dbf25fcb-e1f7-4b38-aa66-c87a829df526/serve-healthcheck-canary/0.log"
Jul 24 20:16:42.558657 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:42.558581    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vclnd_fa8789c9-6c39-46cd-a540-657dea710eb8/ovn-acl-logging/0.log"
Jul 24 20:16:42.567666 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:42.567646    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vclnd_fa8789c9-6c39-46cd-a540-657dea710eb8/ovn-acl-logging/0.log"
Jul 24 20:16:42.902145 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:42.902061    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pl97h_954670cf-545b-4939-b6c6-63c2a32be646/kube-rbac-proxy/0.log"
Jul 24 20:16:42.923023 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:42.923000    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pl97h_954670cf-545b-4939-b6c6-63c2a32be646/exporter/0.log"
Jul 24 20:16:42.943615 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:42.943590    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pl97h_954670cf-545b-4939-b6c6-63c2a32be646/extractor/0.log"
Jul 24 20:16:43.533179 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:43.533143    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-g4kbv/perf-node-gather-daemonset-2rk72"
Jul 24 20:16:45.817525 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:45.817496    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69f558d7f4-bkbhr_44523b7e-3dd0-49ef-bf8c-7b2175e0f913/manager/0.log"
Jul 24 20:16:45.838180 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:45.838154    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69f558d7f4-bkbhr_44523b7e-3dd0-49ef-bf8c-7b2175e0f913/copy-manifests/0.log"
Jul 24 20:16:47.376967 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:47.376936    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-9ccbf6686-bmxtf_249d775c-1a34-4e43-9910-369a118bca40/manager/0.log"
Jul 24 20:16:47.402640 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:47.402618    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-lq5p9_b463703d-4132-47ca-9d35-16f2f4cd1f14/openshift-lws-operator/0.log"
Jul 24 20:16:48.038776 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:48.038741    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-pjn9h_2048cb12-40b5-4a3f-99d3-3c99a9654d21/discovery/0.log"
Jul 24 20:16:49.645972 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:49.645941    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-pjn9h_2048cb12-40b5-4a3f-99d3-3c99a9654d21/discovery/0.log"
Jul 24 20:16:53.851715 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:53.851675    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7s5nj_1a57aec4-d102-4483-a562-53ae8ed51e6e/kube-multus/0.log"
Jul 24 20:16:53.873918 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:53.873889    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4zz8w_aac7b50f-a1bd-40ba-9b16-f98984e5ed50/kube-multus-additional-cni-plugins/0.log"
Jul 24 20:16:53.893998 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:53.893974    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4zz8w_aac7b50f-a1bd-40ba-9b16-f98984e5ed50/egress-router-binary-copy/0.log"
Jul 24 20:16:53.913656 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:53.913635    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4zz8w_aac7b50f-a1bd-40ba-9b16-f98984e5ed50/cni-plugins/0.log"
Jul 24 20:16:53.933606 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:53.933585    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4zz8w_aac7b50f-a1bd-40ba-9b16-f98984e5ed50/bond-cni-plugin/0.log"
Jul 24 20:16:53.953277 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:53.953249    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4zz8w_aac7b50f-a1bd-40ba-9b16-f98984e5ed50/routeoverride-cni/0.log"
Jul 24 20:16:53.973266 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:53.973245    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4zz8w_aac7b50f-a1bd-40ba-9b16-f98984e5ed50/whereabouts-cni-bincopy/0.log"
Jul 24 20:16:53.994427 ip-10-0-131-150 kubenswrapper[2579]: I0724 20:16:53.994399    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4zz8w_aac7b50f-a1bd-40ba-9b16-f98984e5ed50/whereabouts-cni/0.log"