Jul 29 14:35:25.710275 ip-10-0-142-130 systemd[1]: Starting Kubernetes Kubelet...
Jul 29 14:35:26.083887 ip-10-0-142-130 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 14:35:26.083887 ip-10-0-142-130 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 29 14:35:26.083887 ip-10-0-142-130 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 14:35:26.083887 ip-10-0-142-130 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 29 14:35:26.083887 ip-10-0-142-130 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 14:35:26.085296 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.085232    2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 29 14:35:26.089063 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089049    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 14:35:26.089063 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089063    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 14:35:26.089125 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089067    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 14:35:26.089125 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089070    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 14:35:26.089125 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089074    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 14:35:26.089125 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089076    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 14:35:26.089125 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089079    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 14:35:26.089125 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089083    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 14:35:26.089125 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089086    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 14:35:26.089125 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089089    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 14:35:26.089125 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089092    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 14:35:26.089125 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089095    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 14:35:26.089125 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089098    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 14:35:26.089125 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089101    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 14:35:26.089125 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089104    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 14:35:26.089125 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089107    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 14:35:26.089125 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089109    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 14:35:26.089125 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089112    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 14:35:26.089125 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089115    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 14:35:26.089125 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089118    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 14:35:26.089125 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089121    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 14:35:26.089125 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089123    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 14:35:26.089591 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089127    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 14:35:26.089591 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089131    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 14:35:26.089591 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089134    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 14:35:26.089591 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089137    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 14:35:26.089591 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089140    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 14:35:26.089591 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089142    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 14:35:26.089591 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089145    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 14:35:26.089591 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089147    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 14:35:26.089591 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089150    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 14:35:26.089591 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089153    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 14:35:26.089591 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089155    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 14:35:26.089591 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089158    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 14:35:26.089591 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089160    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 14:35:26.089591 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089163    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 14:35:26.089591 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089165    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 14:35:26.089591 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089168    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 14:35:26.089591 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089170    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 14:35:26.089591 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089172    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 14:35:26.089591 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089175    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 14:35:26.090056 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089178    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 14:35:26.090056 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089180    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 14:35:26.090056 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089183    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 14:35:26.090056 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089185    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 14:35:26.090056 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089188    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 14:35:26.090056 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089191    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 14:35:26.090056 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089193    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 14:35:26.090056 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089196    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 14:35:26.090056 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089200    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 14:35:26.090056 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089203    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 14:35:26.090056 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089205    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 14:35:26.090056 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089208    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 14:35:26.090056 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089210    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 14:35:26.090056 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089214    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 14:35:26.090056 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089216    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 14:35:26.090056 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089219    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 14:35:26.090056 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089222    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 14:35:26.090056 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089224    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 14:35:26.090056 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089227    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 14:35:26.090056 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089229    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 14:35:26.090519 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089232    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 14:35:26.090519 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089234    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 14:35:26.090519 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089236    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 14:35:26.090519 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089239    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 14:35:26.090519 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089241    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 14:35:26.090519 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089244    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 14:35:26.090519 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089246    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 14:35:26.090519 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089248    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 14:35:26.090519 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089251    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 14:35:26.090519 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089254    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 14:35:26.090519 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089256    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 14:35:26.090519 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089259    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 14:35:26.090519 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089262    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 14:35:26.090519 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089264    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 14:35:26.090519 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089267    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 14:35:26.090519 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089269    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 14:35:26.090519 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089272    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 14:35:26.090519 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089274    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 14:35:26.090519 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089276    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 14:35:26.090519 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089279    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 14:35:26.090987 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089281    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 14:35:26.090987 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089283    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 14:35:26.090987 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089286    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 14:35:26.090987 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089290    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 14:35:26.090987 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089293    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 14:35:26.090987 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089296    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 14:35:26.090987 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089300    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 14:35:26.090987 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089303    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 14:35:26.090987 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089306    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 14:35:26.090987 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089308    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 14:35:26.090987 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089311    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 14:35:26.090987 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089314    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 14:35:26.090987 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089316    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 14:35:26.090987 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089318    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 14:35:26.090987 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089321    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 14:35:26.090987 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089323    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 14:35:26.090987 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089325    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 14:35:26.090987 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089328    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 14:35:26.090987 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089975    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 14:35:26.090987 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089981    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 14:35:26.091472 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089984    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 14:35:26.091472 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.089987    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 14:35:26.091472 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090005    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 14:35:26.091472 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090008    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 14:35:26.091472 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090011    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 14:35:26.091472 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090014    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 14:35:26.091472 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090017    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 14:35:26.091472 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090019    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 14:35:26.091472 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090022    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 14:35:26.091472 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090025    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 14:35:26.091472 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090028    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 14:35:26.091472 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090030    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 14:35:26.091472 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090033    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 14:35:26.091472 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090035    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 14:35:26.091472 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090038    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 14:35:26.091472 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090040    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 14:35:26.091472 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090043    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 14:35:26.091472 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090045    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 14:35:26.091472 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090048    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 14:35:26.091966 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090051    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 14:35:26.091966 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090053    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 14:35:26.091966 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090056    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 14:35:26.091966 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090060    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 14:35:26.091966 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090064    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 14:35:26.091966 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090066    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 14:35:26.091966 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090069    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 14:35:26.091966 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090071    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 14:35:26.091966 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090074    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 14:35:26.091966 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090077    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 14:35:26.091966 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090080    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 14:35:26.091966 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090082    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 14:35:26.091966 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090084    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 14:35:26.091966 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090087    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 14:35:26.091966 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090089    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 14:35:26.091966 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090092    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 14:35:26.091966 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090094    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 14:35:26.091966 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090097    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 14:35:26.091966 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090099    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 14:35:26.092427 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090102    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 14:35:26.092427 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090105    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 14:35:26.092427 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090107    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 14:35:26.092427 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090109    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 14:35:26.092427 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090112    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 14:35:26.092427 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090114    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 14:35:26.092427 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090117    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 14:35:26.092427 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090119    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 14:35:26.092427 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090121    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 14:35:26.092427 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090124    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 14:35:26.092427 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090127    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 14:35:26.092427 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090130    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 14:35:26.092427 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090133    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 14:35:26.092427 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090135    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 14:35:26.092427 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090138    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 14:35:26.092427 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090140    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 14:35:26.092427 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090143    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 14:35:26.092427 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090145    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 14:35:26.092427 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090148    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 14:35:26.092427 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090150    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 14:35:26.092900 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090152    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 14:35:26.092900 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090155    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 14:35:26.092900 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090158    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 14:35:26.092900 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090160    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 14:35:26.092900 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090162    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 14:35:26.092900 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090165    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 14:35:26.092900 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090168    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 14:35:26.092900 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090171    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 14:35:26.092900 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090175    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 14:35:26.092900 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090179    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 14:35:26.092900 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090182    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 14:35:26.092900 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090185    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 14:35:26.092900 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090188    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 14:35:26.092900 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090194    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 14:35:26.092900 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090197    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 14:35:26.092900 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090199    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 14:35:26.092900 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090202    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 14:35:26.092900 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090204    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 14:35:26.092900 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090207    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 14:35:26.093467 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090209    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 14:35:26.093467 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090211    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 14:35:26.093467 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090214    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 14:35:26.093467 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090219    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 14:35:26.093467 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090222    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 14:35:26.093467 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090225    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 14:35:26.093467 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090228    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 14:35:26.093467 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090230    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 14:35:26.093467 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090233    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 14:35:26.093467 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090235    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 14:35:26.093467 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090238    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 14:35:26.093467 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090240    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 14:35:26.093467 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090243    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 14:35:26.093467 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090245    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 14:35:26.093467 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090248    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 14:35:26.093467 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090251    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 14:35:26.093467 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090253    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 14:35:26.093467 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090256    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 14:35:26.093467 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090258    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 14:35:26.094305 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090261    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 14:35:26.094305 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090578    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 14:35:26.094305 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090582    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 14:35:26.094305 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090585    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 14:35:26.094305 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090587    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 14:35:26.094305 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090590    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 14:35:26.094305 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090594    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 14:35:26.094305 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090605    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 14:35:26.094305 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090608    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 14:35:26.094305 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090611    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 14:35:26.094305 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090615    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 14:35:26.094305 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090617    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 14:35:26.094305 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090620    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 14:35:26.094305 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090624    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 14:35:26.094305 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090627    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 14:35:26.094305 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090630    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 14:35:26.094305 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090633    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 14:35:26.094305 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090636    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 14:35:26.094305 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090638    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 14:35:26.094778 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090641    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 14:35:26.094778 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090644    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 14:35:26.094778 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090647    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 14:35:26.094778 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090649    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 14:35:26.094778 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090652    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 14:35:26.094778 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090654    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 14:35:26.094778 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090658    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 14:35:26.094778 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090662    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 14:35:26.094778 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090664    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 14:35:26.094778 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090667    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 14:35:26.094778 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090669    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 14:35:26.094778 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090672    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 14:35:26.094778 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090674    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 14:35:26.094778 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090677    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 14:35:26.094778 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090679    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 14:35:26.094778 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090682    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 14:35:26.094778 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090684    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 14:35:26.094778 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090686    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 14:35:26.094778 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090689    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 14:35:26.094778 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090691    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 14:35:26.095345 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090694    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 14:35:26.095345 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090697    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 14:35:26.095345 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090700    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 14:35:26.095345 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090702    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 14:35:26.095345 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090704    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 14:35:26.095345 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090707    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 14:35:26.095345 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090709    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 14:35:26.095345 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090712    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 14:35:26.095345 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090714    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 14:35:26.095345 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090717    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 14:35:26.095345 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090719    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 14:35:26.095345 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090722    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 14:35:26.095345 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090724    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 14:35:26.095345 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090726    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 14:35:26.095345 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090729    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 14:35:26.095345 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090731    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 14:35:26.095345 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090734    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 14:35:26.095345 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090736    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 14:35:26.095345 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090739    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 14:35:26.095345 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090741    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 14:35:26.095833 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090744    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 14:35:26.095833 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090746    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 14:35:26.095833 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090749    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 14:35:26.095833 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090751    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 14:35:26.095833 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090754    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 14:35:26.095833 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090756    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 14:35:26.095833 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090758    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 14:35:26.095833 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090761    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 14:35:26.095833 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090763    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 14:35:26.095833 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090766    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 14:35:26.095833 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090768    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 14:35:26.095833 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090770    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 14:35:26.095833 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090773    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 14:35:26.095833 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090775    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 14:35:26.095833 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090778    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 14:35:26.095833 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090780    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 14:35:26.095833 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090782    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 14:35:26.095833 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090785    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 14:35:26.095833 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090787    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 14:35:26.095833 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090790    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 14:35:26.096327 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090793    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 14:35:26.096327 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090796    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 14:35:26.096327 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090799    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 14:35:26.096327 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090801    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 14:35:26.096327 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090804    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 14:35:26.096327 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090806    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 14:35:26.096327 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090808    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 14:35:26.096327 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090811    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 14:35:26.096327 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090813    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 14:35:26.096327 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090816    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 14:35:26.096327 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090818    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 14:35:26.096327 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090821    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 14:35:26.096327 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090823    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 14:35:26.096327 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090825    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 14:35:26.096327 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090828    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 14:35:26.096327 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090830    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 14:35:26.096327 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090833    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 14:35:26.096327 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090835    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 14:35:26.096327 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090837    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 14:35:26.096844 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090840    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 14:35:26.096844 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.090842    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 14:35:26.096844 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.090917    2578 flags.go:64] FLAG: --address="0.0.0.0"
Jul 29 14:35:26.096844 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.090927    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 29 14:35:26.096844 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.090935    2578 flags.go:64] FLAG: --anonymous-auth="true"
Jul 29 14:35:26.096844 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.090942    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 29 14:35:26.096844 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.090947    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 29 14:35:26.096844 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.090952    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 29 14:35:26.096844 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.090957    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 29 14:35:26.096844 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.090961    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 29 14:35:26.096844 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.090964    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 29 14:35:26.096844 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.090967    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 29 14:35:26.096844 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.090971    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 29 14:35:26.096844 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.090974    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 29 14:35:26.096844 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.090977    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 29 14:35:26.096844 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.090979    2578 flags.go:64] FLAG: --cgroup-root=""
Jul 29 14:35:26.096844 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.090982    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 29 14:35:26.096844 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.090985    2578 flags.go:64] FLAG: --client-ca-file=""
Jul 29 14:35:26.096844 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.090988    2578 flags.go:64] FLAG: --cloud-provider="external"
Jul 29 14:35:26.096844 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091002    2578 flags.go:64] FLAG: --cluster-dns="[]"
Jul 29 14:35:26.096844 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091006    2578 flags.go:64] FLAG: --cluster-domain=""
Jul 29 14:35:26.096844 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091009    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 29 14:35:26.096844 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091012    2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 29 14:35:26.096844 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091016    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 29 14:35:26.097789 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091019    2578 flags.go:64] FLAG: --container-log-max-files="5"
Jul 29 14:35:26.097789 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091023    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 29 14:35:26.097789 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091026    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 29 14:35:26.097789 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091029    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 29 14:35:26.097789 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091032    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 29 14:35:26.097789 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091035    2578 flags.go:64] FLAG: --contention-profiling="false"
Jul 29 14:35:26.097789 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091038    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 29 14:35:26.097789 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091041    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 29 14:35:26.097789 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091044    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 29 14:35:26.097789 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091047    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 29 14:35:26.097789 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091051    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 29 14:35:26.097789 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091054    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 29 14:35:26.097789 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091057    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 29 14:35:26.097789 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091059    2578 flags.go:64] FLAG: --enable-load-reader="false"
Jul 29 14:35:26.097789 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091062    2578 flags.go:64] FLAG: --enable-server="true"
Jul 29 14:35:26.097789 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091065    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 29 14:35:26.097789 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091069    2578 flags.go:64] FLAG: --event-burst="100"
Jul 29 14:35:26.097789 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091076    2578 flags.go:64] FLAG: --event-qps="50"
Jul 29 14:35:26.097789 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091079    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 29 14:35:26.097789 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091082    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 29 14:35:26.097789 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091085    2578 flags.go:64] FLAG: --eviction-hard=""
Jul 29 14:35:26.097789 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091088    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 29 14:35:26.097789 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091092    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 29 14:35:26.097789 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091094    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 29 14:35:26.097789 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091097    2578 flags.go:64] FLAG: --eviction-soft=""
Jul 29 14:35:26.098386 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091100    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 29 14:35:26.098386 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091103    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 29 14:35:26.098386 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091106    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 29 14:35:26.098386 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091108    2578 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 29 14:35:26.098386 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091111    2578 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 29 14:35:26.098386 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091114    2578 flags.go:64] FLAG: --fail-swap-on="true"
Jul 29 14:35:26.098386 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091117    2578 flags.go:64] FLAG: --feature-gates=""
Jul 29 14:35:26.098386 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091122    2578 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 29 14:35:26.098386 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091125    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 29 14:35:26.098386 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091128    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 29 14:35:26.098386 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091131    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 29 14:35:26.098386 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091133    2578 flags.go:64] FLAG: --healthz-port="10248"
Jul 29 14:35:26.098386 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091136    2578 flags.go:64] FLAG: --help="false"
Jul 29 14:35:26.098386 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091139    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-142-130.ec2.internal"
Jul 29 14:35:26.098386 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091142    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 29 14:35:26.098386 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091145    2578 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 29 14:35:26.098386 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091148    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 29 14:35:26.098386 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091151    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 29 14:35:26.098386 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091154    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 29 14:35:26.098386 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091157    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 29 14:35:26.098386 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091160    2578 flags.go:64] FLAG: --image-service-endpoint=""
Jul 29 14:35:26.098386 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091163    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 29 14:35:26.098386 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091165    2578 flags.go:64] FLAG: --kube-api-burst="100"
Jul 29 14:35:26.098938 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091168    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 29 14:35:26.098938 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091172    2578 flags.go:64] FLAG: --kube-api-qps="50"
Jul 29 14:35:26.098938 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091176    2578 flags.go:64] FLAG: --kube-reserved=""
Jul 29 14:35:26.098938 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091179    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 29 14:35:26.098938 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091181    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 29 14:35:26.098938 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091184    2578 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 29 14:35:26.098938 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091187    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 29 14:35:26.098938 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091190    2578 flags.go:64] FLAG: --lock-file=""
Jul 29 14:35:26.098938 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091192    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 29 14:35:26.098938 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091195    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 29 14:35:26.098938 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091198    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 29 14:35:26.098938 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091203    2578 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 29 14:35:26.098938 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091206    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 29 14:35:26.098938 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091208    2578 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 29 14:35:26.098938 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091211    2578 flags.go:64] FLAG: --logging-format="text"
Jul 29 14:35:26.098938 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091213    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 29 14:35:26.098938 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091218    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 29 14:35:26.098938 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091221    2578 flags.go:64] FLAG: --manifest-url=""
Jul 29 14:35:26.098938 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091224    2578 flags.go:64] FLAG: --manifest-url-header=""
Jul 29 14:35:26.098938 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091228    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 29 14:35:26.098938 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091231    2578 flags.go:64] FLAG: --max-open-files="1000000"
Jul 29 14:35:26.098938 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091240    2578 flags.go:64] FLAG: --max-pods="110"
Jul 29 14:35:26.098938 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091243    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 29 14:35:26.098938 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091246    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 29 14:35:26.098938 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091249    2578 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 29 14:35:26.099536 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091251    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 29 14:35:26.099536 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091254    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 29 14:35:26.099536 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091257    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 29 14:35:26.099536 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091260    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 29 14:35:26.099536 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091266    2578 flags.go:64] FLAG: --node-status-max-images="50"
Jul 29 14:35:26.099536 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091269    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 29 14:35:26.099536 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091272    2578 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 29 14:35:26.099536 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091275    2578 flags.go:64] FLAG: --pod-cidr=""
Jul 29 14:35:26.099536 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091279    2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 29 14:35:26.099536 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091284    2578 flags.go:64] FLAG: --pod-manifest-path=""
Jul 29 14:35:26.099536 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091287    2578 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 29 14:35:26.099536 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091290    2578 flags.go:64] FLAG: --pods-per-core="0"
Jul 29 14:35:26.099536 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091293    2578 flags.go:64] FLAG: --port="10250"
Jul 29 14:35:26.099536 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091296    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 29 14:35:26.099536 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091299    2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d50c3301a8f13d80"
Jul 29 14:35:26.099536 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091302    2578 flags.go:64] FLAG: --qos-reserved=""
Jul 29 14:35:26.099536 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091305    2578 flags.go:64] FLAG: --read-only-port="10255"
Jul 29 14:35:26.099536 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091308    2578 flags.go:64] FLAG: --register-node="true"
Jul 29 14:35:26.099536 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091311    2578 flags.go:64] FLAG: --register-with-taints=""
Jul 29 14:35:26.099536 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091314    2578 flags.go:64] FLAG: --registry-burst="10"
Jul 29 14:35:26.099536 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091317    2578 flags.go:64] FLAG: --registry-qps="5"
Jul 29 14:35:26.099536 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091319    2578 flags.go:64] FLAG: --reserved-cpus=""
Jul 29 14:35:26.099536 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091322    2578 flags.go:64] FLAG: --reserved-memory=""
Jul 29 14:35:26.099536 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091327    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 29 14:35:26.099536 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091330    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 29 14:35:26.100176 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091333    2578 flags.go:64] FLAG: --rotate-certificates="false"
Jul 29 14:35:26.100176 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091336    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 29 14:35:26.100176 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091338    2578 flags.go:64] FLAG: --runonce="false"
Jul 29 14:35:26.100176 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091341    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 29 14:35:26.100176 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091344    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 29 14:35:26.100176 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091347    2578 flags.go:64] FLAG: --seccomp-default="false"
Jul 29 14:35:26.100176 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091350    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 29 14:35:26.100176 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091353    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 29 14:35:26.100176 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091355    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 29 14:35:26.100176 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091359    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 29 14:35:26.100176 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091361    2578 flags.go:64] FLAG: --storage-driver-password="root"
Jul 29 14:35:26.100176 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091364    2578 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 29 14:35:26.100176 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091367    2578 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 29 14:35:26.100176 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091370    2578 flags.go:64] FLAG: --storage-driver-user="root"
Jul 29 14:35:26.100176 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091372    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 29 14:35:26.100176 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091375    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 29 14:35:26.100176 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091379    2578 flags.go:64] FLAG: --system-cgroups=""
Jul 29 14:35:26.100176 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091382    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 29 14:35:26.100176 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091388    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 29 14:35:26.100176 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091390    2578 flags.go:64] FLAG: --tls-cert-file=""
Jul 29 14:35:26.100176 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091393    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 29 14:35:26.100176 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091397    2578 flags.go:64] FLAG: --tls-min-version=""
Jul 29 14:35:26.100176 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091399    2578 flags.go:64] FLAG: --tls-private-key-file=""
Jul 29 14:35:26.100176 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091402    2578 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 29 14:35:26.100176 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091405    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 29 14:35:26.100743 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091408    2578 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 29 14:35:26.100743 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091410    2578 flags.go:64] FLAG: --v="2"
Jul 29 14:35:26.100743 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091414    2578 flags.go:64] FLAG: --version="false"
Jul 29 14:35:26.100743 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091418    2578 flags.go:64] FLAG: --vmodule=""
Jul 29 14:35:26.100743 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091421    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 29 14:35:26.100743 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.091426    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 29 14:35:26.100743 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091531    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 14:35:26.100743 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091535    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 14:35:26.100743 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091538    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 14:35:26.100743 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091540    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 14:35:26.100743 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091544    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 14:35:26.100743 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091546    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 14:35:26.100743 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091549    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 14:35:26.100743 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091552    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 14:35:26.100743 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091555    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 14:35:26.100743 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091557    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 14:35:26.100743 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091560    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 14:35:26.100743 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091562    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 14:35:26.100743 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091565    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 14:35:26.100743 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091567    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 14:35:26.100743 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091570    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 14:35:26.101293 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091572    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 14:35:26.101293 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091575    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 14:35:26.101293 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091579    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 14:35:26.101293 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091581    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 14:35:26.101293 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091584    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 14:35:26.101293 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091587    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 14:35:26.101293 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091589    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 14:35:26.101293 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091592    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 14:35:26.101293 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091594    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 14:35:26.101293 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091597    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 14:35:26.101293 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091600    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 14:35:26.101293 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091602    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 14:35:26.101293 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091605    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 14:35:26.101293 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091607    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 14:35:26.101293 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091610    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 14:35:26.101293 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091613    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 14:35:26.101293 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091617    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 14:35:26.101293 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091620    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 14:35:26.101293 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091623    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 14:35:26.101293 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091625    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 14:35:26.101783 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091628    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 14:35:26.101783 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091630    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 14:35:26.101783 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091633    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 14:35:26.101783 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091635    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 14:35:26.101783 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091638    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 14:35:26.101783 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091640    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 14:35:26.101783 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091643    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 14:35:26.101783 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091647    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 14:35:26.101783 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091650    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 14:35:26.101783 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091653    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 14:35:26.101783 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091656    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 14:35:26.101783 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091659    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 14:35:26.101783 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091661    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 14:35:26.101783 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091664    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 14:35:26.101783 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091668    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 14:35:26.101783 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091670    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 14:35:26.101783 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091673    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 14:35:26.101783 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091675    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 14:35:26.101783 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091681    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 14:35:26.102254 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091684    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 14:35:26.102254 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091686    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 14:35:26.102254 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091688    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 14:35:26.102254 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091691    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 14:35:26.102254 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091693    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 14:35:26.102254 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091696    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 14:35:26.102254 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091698    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 14:35:26.102254 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091700    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 14:35:26.102254 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091703    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 14:35:26.102254 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091708    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 14:35:26.102254 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091711    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 14:35:26.102254 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091714    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 14:35:26.102254 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091716    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 14:35:26.102254 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091719    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 14:35:26.102254 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091721    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 14:35:26.102254 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091724    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 14:35:26.102254 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091726    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 14:35:26.102254 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091729    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 14:35:26.102254 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091731    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 14:35:26.102254 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091733    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 14:35:26.102816 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091736    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 14:35:26.102816 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091738    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 14:35:26.102816 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091741    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 14:35:26.102816 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091743    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 14:35:26.102816 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091746    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 14:35:26.102816 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091748    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 14:35:26.102816 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091750    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 14:35:26.102816 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091754    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 14:35:26.102816 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091757    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 14:35:26.102816 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091760    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 14:35:26.102816 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091762    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 14:35:26.102816 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091764    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 14:35:26.102816 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091767    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 14:35:26.102816 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091770    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 14:35:26.102816 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091773    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 14:35:26.102816 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091775    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 14:35:26.102816 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091777    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 14:35:26.102816 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091780    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 14:35:26.102816 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091782    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 14:35:26.103282 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091785    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 14:35:26.103282 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091787    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 14:35:26.103282 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091791    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 14:35:26.103282 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091793    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 14:35:26.103282 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091796    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 14:35:26.103282 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.091800    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 14:35:26.103282 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.092512    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 14:35:26.103282 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.099661    2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 29 14:35:26.103282 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.099677    2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 29 14:35:26.103282 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.100604    2578 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 29 14:35:26.103282 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.100613    2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 29 14:35:26.103282 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100687    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 14:35:26.103282 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100694    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 14:35:26.103282 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100698    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 14:35:26.103625 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100702    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 14:35:26.103625 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100708    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 14:35:26.103625 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100713    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 14:35:26.103625 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100717    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 14:35:26.103625 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100721    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 14:35:26.103625 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100725    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 14:35:26.103625 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100728    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 14:35:26.103625 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100732    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 14:35:26.103625 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100736    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 14:35:26.103625 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100740    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 14:35:26.103625 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100744    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 14:35:26.103625 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100748    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 14:35:26.103625 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100752    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 14:35:26.103625 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100757    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 14:35:26.103625 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100760    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 14:35:26.103625 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100764    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 14:35:26.103625 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100768    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 14:35:26.103625 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100773    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 14:35:26.103625 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100777    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 14:35:26.103625 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100780    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 14:35:26.104117 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100784    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 14:35:26.104117 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100788    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 14:35:26.104117 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100791    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 14:35:26.104117 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100794    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 14:35:26.104117 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100798    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 14:35:26.104117 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100803    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 14:35:26.104117 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100807    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 14:35:26.104117 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100811    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 14:35:26.104117 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100815    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 14:35:26.104117 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100819    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 14:35:26.104117 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100823    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 14:35:26.104117 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100827    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 14:35:26.104117 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100833    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 14:35:26.104117 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100838    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 14:35:26.104117 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100842    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 14:35:26.104117 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100846    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 14:35:26.104117 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100850    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 14:35:26.104117 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100855    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 14:35:26.104117 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100858    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 14:35:26.104568 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100862    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 14:35:26.104568 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100866    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 14:35:26.104568 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100871    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 14:35:26.104568 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100875    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 14:35:26.104568 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100880    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 14:35:26.104568 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100885    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 14:35:26.104568 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100889    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 14:35:26.104568 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100893    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 14:35:26.104568 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100897    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 14:35:26.104568 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100901    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 14:35:26.104568 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100905    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 14:35:26.104568 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100908    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 14:35:26.104568 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100912    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 14:35:26.104568 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100916    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 14:35:26.104568 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100919    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 14:35:26.104568 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100923    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 14:35:26.104568 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100927    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 14:35:26.104568 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100931    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 14:35:26.104568 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100935    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 14:35:26.104568 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100939    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 14:35:26.105062 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100943    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 14:35:26.105062 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100947    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 14:35:26.105062 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100951    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 14:35:26.105062 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100955    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 14:35:26.105062 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100958    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 14:35:26.105062 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100962    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 14:35:26.105062 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100966    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 14:35:26.105062 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100970    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 14:35:26.105062 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100973    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 14:35:26.105062 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100977    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 14:35:26.105062 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100981    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 14:35:26.105062 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100984    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 14:35:26.105062 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.100988    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 14:35:26.105062 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101003    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 14:35:26.105062 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101007    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 14:35:26.105062 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101011    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 14:35:26.105062 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101015    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 14:35:26.105062 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101019    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 14:35:26.105062 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101023    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 14:35:26.105062 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101028    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 14:35:26.105554 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101031    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 14:35:26.105554 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101035    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 14:35:26.105554 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101039    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 14:35:26.105554 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101042    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 14:35:26.105554 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101046    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 14:35:26.105554 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101050    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 14:35:26.105554 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101055    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 14:35:26.105554 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101058    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 14:35:26.105554 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101061    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 14:35:26.105554 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101065    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 14:35:26.105554 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101069    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 14:35:26.105554 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101074    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 14:35:26.105554 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101077    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 14:35:26.105554 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101081    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 14:35:26.105554 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101085    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 14:35:26.105554 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101089    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 14:35:26.105554 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101093    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 14:35:26.105955 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.101099    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 14:35:26.105955 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101246    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 14:35:26.105955 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101253    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 14:35:26.105955 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101257    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 14:35:26.105955 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101262    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 14:35:26.105955 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101267    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 14:35:26.105955 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101270    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 14:35:26.105955 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101273    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 14:35:26.105955 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101277    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 14:35:26.105955 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101282    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 14:35:26.105955 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101285    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 14:35:26.105955 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101289    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 14:35:26.105955 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101293    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 14:35:26.105955 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101297    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 14:35:26.106423 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101301    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 14:35:26.106423 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101305    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 14:35:26.106423 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101309    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 14:35:26.106423 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101312    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 14:35:26.106423 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101316    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 14:35:26.106423 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101319    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 14:35:26.106423 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101323    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 14:35:26.106423 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101326    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 14:35:26.106423 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101330    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 14:35:26.106423 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101333    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 14:35:26.106423 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101336    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 14:35:26.106423 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101341    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 14:35:26.106423 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101344    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 14:35:26.106423 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101348    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 14:35:26.106423 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101352    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 14:35:26.106423 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101355    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 14:35:26.106423 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101359    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 14:35:26.106423 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101363    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 14:35:26.106423 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101366    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 14:35:26.106423 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101370    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 14:35:26.106916 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101374    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 14:35:26.106916 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101377    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 14:35:26.106916 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101381    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 14:35:26.106916 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101384    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 14:35:26.106916 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101388    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 14:35:26.106916 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101392    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 14:35:26.106916 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101395    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 14:35:26.106916 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101399    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 14:35:26.106916 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101402    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 14:35:26.106916 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101406    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 14:35:26.106916 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101410    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 14:35:26.106916 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101413    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 14:35:26.106916 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101419    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 14:35:26.106916 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101423    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 14:35:26.106916 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101427    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 14:35:26.106916 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101430    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 14:35:26.106916 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101434    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 14:35:26.106916 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101438    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 14:35:26.106916 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101442    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 14:35:26.106916 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101445    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 14:35:26.107398 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101448    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 14:35:26.107398 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101452    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 14:35:26.107398 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101456    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 14:35:26.107398 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101460    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 14:35:26.107398 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101463    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 14:35:26.107398 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101466    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 14:35:26.107398 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101471    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 14:35:26.107398 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101474    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 14:35:26.107398 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101479    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 14:35:26.107398 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101485    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 14:35:26.107398 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101489    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 14:35:26.107398 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101493    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 14:35:26.107398 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101496    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 14:35:26.107398 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101500    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 14:35:26.107398 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101504    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 14:35:26.107398 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101514    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 14:35:26.107398 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101518    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 14:35:26.107398 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101537    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 14:35:26.107398 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101542    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 14:35:26.107398 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101546    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 14:35:26.107866 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101551    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 14:35:26.107866 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101555    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 14:35:26.107866 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101560    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 14:35:26.107866 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101564    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 14:35:26.107866 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101568    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 14:35:26.107866 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101574    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 14:35:26.107866 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101578    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 14:35:26.107866 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101582    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 14:35:26.107866 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101586    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 14:35:26.107866 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101590    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 14:35:26.107866 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101595    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 14:35:26.107866 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101599    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 14:35:26.107866 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101602    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 14:35:26.107866 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101606    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 14:35:26.107866 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101610    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 14:35:26.107866 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101614    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 14:35:26.107866 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101618    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 14:35:26.107866 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101621    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 14:35:26.107866 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101625    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 14:35:26.107866 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101629    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 14:35:26.108345 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101634    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 14:35:26.108345 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101638    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 14:35:26.108345 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101642    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 14:35:26.108345 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101646    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 14:35:26.108345 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101650    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 14:35:26.108345 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:26.101654    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 14:35:26.108345 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.101661    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 14:35:26.108345 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.101787    2578 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 29 14:35:26.108345 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.104663    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 29 14:35:26.108345 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.105854    2578 server.go:1019] "Starting client certificate rotation"
Jul 29 14:35:26.108345 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.105954    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 14:35:26.108345 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.106009    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 14:35:26.108649 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.108483    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 14:35:26.109933 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.109918    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 14:35:26.118810 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.118792    2578 log.go:25] "Validated CRI v1 runtime API"
Jul 29 14:35:26.121313 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.121297    2578 log.go:25] "Validated CRI v1 image API"
Jul 29 14:35:26.122138 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.122123    2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 29 14:35:26.125699 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.125679    2578 fs.go:135] Filesystem UUIDs: map[0a8c67ca-0a2e-40f6-a3c8-586fa46eb159:/dev/nvme0n1p3 423700bc-172f-4d7f-afb9-06e1eaa62618:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 29 14:35:26.125781 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.125698    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 29 14:35:26.131812 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.131707    2578 manager.go:216] Machine: {Timestamp:2026-07-29 14:35:26.130647239 +0000 UTC m=+0.313357003 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3202613 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f8e29338d23ad255c0f6ee92a14c7 SystemUUID:ec2f8e29-338d-23ad-255c-0f6ee92a14c7 BootID:60e3888e-fff0-4f15-a11c-282deb069348 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:59:2f:f6:0b:b3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:59:2f:f6:0b:b3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:c7:2f:65:ea:5a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 29 14:35:26.131812 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.131803    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 29 14:35:26.131983 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.131864    2578 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 29 14:35:26.132062 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.132048    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 14:35:26.134867 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.134840    2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 29 14:35:26.135030 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.134872    2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-130.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 29 14:35:26.136121 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.136109    2578 topology_manager.go:138] "Creating topology manager with none policy"
Jul 29 14:35:26.136176 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.136126    2578 container_manager_linux.go:309] "Creating device plugin manager"
Jul 29 14:35:26.136176 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.136137    2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 14:35:26.136740 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.136728    2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 14:35:26.137365 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.137353    2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 29 14:35:26.139785 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.139771    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 14:35:26.139903 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.139892    2578 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 29 14:35:26.139956 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.139928    2578 kubelet.go:486] "Attempting to sync node with API server"
Jul 29 14:35:26.139956 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.139942    2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 29 14:35:26.139956 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.139954    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 29 14:35:26.140093 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.139967    2578 kubelet.go:398] "Adding apiserver pod source"
Jul 29 14:35:26.140093 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.139979    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 29 14:35:26.140349 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.140334    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 14:35:26.140408 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.140358    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 14:35:26.143059 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.143044    2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 29 14:35:26.144761 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.144748    2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 29 14:35:26.144808 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.144778    2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 29 14:35:26.145963 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.145950    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 29 14:35:26.146044 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.145967    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 29 14:35:26.146044 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.145973    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 29 14:35:26.146044 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.145979    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 29 14:35:26.146044 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.145987    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 29 14:35:26.146044 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.146006    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 29 14:35:26.146044 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.146014    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 29 14:35:26.146044 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.146035    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 29 14:35:26.146044 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.146042    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 29 14:35:26.146044 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.146047    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 29 14:35:26.146267 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.146060    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 29 14:35:26.146267 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.146066    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 29 14:35:26.146952 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.146937    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 29 14:35:26.146952 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.146947    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 29 14:35:26.149780 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.149765    2578 server.go:1268] "Started kubelet"
Jul 29 14:35:26.149918 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.149904    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-130.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 29 14:35:26.149918 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.149903    2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 29 14:35:26.150508 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:26.150482    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-130.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 29 14:35:26.150508 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:26.150485    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 29 14:35:26.150658 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.150492    2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 29 14:35:26.150658 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.150549    2578 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 29 14:35:26.151670 ip-10-0-142-130 systemd[1]: Started Kubernetes Kubelet.
Jul 29 14:35:26.151974 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.151953    2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 29 14:35:26.154085 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.154058    2578 server.go:310] "Adding debug handlers to kubelet server"
Jul 29 14:35:26.155153 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.155138    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gblnh"
Jul 29 14:35:26.155892 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:26.155868    2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 29 14:35:26.156983 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:26.156277    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-130.ec2.internal.18c6c96241f838e0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-130.ec2.internal,UID:ip-10-0-142-130.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-130.ec2.internal,},FirstTimestamp:2026-07-29 14:35:26.149744864 +0000 UTC m=+0.332454628,LastTimestamp:2026-07-29 14:35:26.149744864 +0000 UTC m=+0.332454628,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-130.ec2.internal,}"
Jul 29 14:35:26.158673 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.158658    2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 29 14:35:26.158742 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.158673    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 29 14:35:26.158742 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:26.158729    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-130.ec2.internal\" not found"
Jul 29 14:35:26.159104 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.159086    2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 29 14:35:26.161609 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.159312    2578 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 29 14:35:26.161609 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.161611    2578 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 29 14:35:26.161751 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.160399    2578 factory.go:153] Registering CRI-O factory
Jul 29 14:35:26.161751 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.161697    2578 factory.go:223] Registration of the crio container factory successfully
Jul 29 14:35:26.161840 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.161773    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 29 14:35:26.161840 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.161782    2578 factory.go:55] Registering systemd factory
Jul 29 14:35:26.161840 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.161788    2578 factory.go:223] Registration of the systemd container factory successfully
Jul 29 14:35:26.161840 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.161791    2578 reconstruct.go:97] "Volume reconstruction finished"
Jul 29 14:35:26.161840 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.161802    2578 reconciler.go:29] "Reconciler: start to sync state"
Jul 29 14:35:26.161840 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.161808    2578 factory.go:103] Registering Raw factory
Jul 29 14:35:26.161840 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.161823    2578 manager.go:1196] Started watching for new ooms in manager
Jul 29 14:35:26.162251 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.162232    2578 manager.go:349] Starting recovery of all containers
Jul 29 14:35:26.165094 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.165075    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gblnh"
Jul 29 14:35:26.165695 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:26.165667    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 29 14:35:26.165773 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:26.165705    2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-130.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 29 14:35:26.173204 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.173190    2578 manager.go:354] Recovery completed
Jul 29 14:35:26.177123 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.177112    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 14:35:26.178846 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.178832    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-130.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 14:35:26.178905 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.178856    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-130.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 14:35:26.178905 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.178869    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-130.ec2.internal" event="NodeHasSufficientPID"
Jul 29 14:35:26.179388 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.179374    2578 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 29 14:35:26.179388 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.179388    2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 29 14:35:26.179472 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.179404    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 14:35:26.179472 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.179375    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 14:35:26.180292 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.180277    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-130.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 14:35:26.180375 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.180300    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-130.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 14:35:26.180375 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.180309    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-130.ec2.internal" event="NodeHasSufficientPID"
Jul 29 14:35:26.180838 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:26.180779    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-130.ec2.internal.18c6c96243b441d5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-130.ec2.internal,UID:ip-10-0-142-130.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-130.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-130.ec2.internal,},FirstTimestamp:2026-07-29 14:35:26.178845141 +0000 UTC m=+0.361554908,LastTimestamp:2026-07-29 14:35:26.178845141 +0000 UTC m=+0.361554908,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-130.ec2.internal,}"
Jul 29 14:35:26.181742 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.181728    2578 policy_none.go:49] "None policy: Start"
Jul 29 14:35:26.181798 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.181746    2578 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 29 14:35:26.181798 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.181759    2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 29 14:35:26.183624 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.183611    2578 policy_none.go:47] "Start"
Jul 29 14:35:26.221506 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.221491    2578 manager.go:337] "Starting Device Plugin manager"
Jul 29 14:35:26.221569 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:26.221526    2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 29 14:35:26.221569 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.221538    2578 server.go:87] "Starting device plugin registration server"
Jul 29 14:35:26.221747 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.221735    2578 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 29 14:35:26.221795 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.221756    2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 29 14:35:26.221897 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.221884    2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 29 14:35:26.221981 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.221967    2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 29 14:35:26.222046 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.221984    2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 29 14:35:26.222519 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:26.222456    2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 29 14:35:26.222519 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:26.222504    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-130.ec2.internal\" not found"
Jul 29 14:35:26.322280 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.322180    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 14:35:26.324257 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.322916    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-130.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 14:35:26.324257 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.322937    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-130.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 14:35:26.324257 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.322946    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-130.ec2.internal" event="NodeHasSufficientPID"
Jul 29 14:35:26.324257 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.322966    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-130.ec2.internal"
Jul 29 14:35:26.331745 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.331733    2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-130.ec2.internal"
Jul 29 14:35:26.331796 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:26.331750    2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-130.ec2.internal\": node \"ip-10-0-142-130.ec2.internal\" not found"
Jul 29 14:35:26.349081 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:26.349033    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-130.ec2.internal\" not found"
Jul 29 14:35:26.390592 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.390568    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 29 14:35:26.391607 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.391592    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 29 14:35:26.391661 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.391625    2578 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 29 14:35:26.391661 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.391642    2578 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 29 14:35:26.391723 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:26.391674    2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 29 14:35:26.394051 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.394030    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 14:35:26.449909 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:26.449889    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-130.ec2.internal\" not found"
Jul 29 14:35:26.492478 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.492456    2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-130.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-130.ec2.internal"]
Jul 29 14:35:26.492531 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.492511    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 14:35:26.493250 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.493235    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-130.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 14:35:26.493319 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.493261    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-130.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 14:35:26.493319 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.493279    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-130.ec2.internal" event="NodeHasSufficientPID"
Jul 29 14:35:26.495568 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.495555    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 14:35:26.495696 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.495681    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-130.ec2.internal"
Jul 29 14:35:26.495730 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.495710    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 14:35:26.496232 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.496218    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-130.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 14:35:26.496310 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.496233    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-130.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 14:35:26.496310 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.496242    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-130.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 14:35:26.496310 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.496251    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-130.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 14:35:26.496310 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.496257    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-130.ec2.internal" event="NodeHasSufficientPID"
Jul 29 14:35:26.496310 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.496265    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-130.ec2.internal" event="NodeHasSufficientPID"
Jul 29 14:35:26.498481 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.498466    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-130.ec2.internal"
Jul 29 14:35:26.498549 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.498495    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 14:35:26.499186 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.499164    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-130.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 14:35:26.499281 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.499191    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-130.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 14:35:26.499281 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.499201    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-130.ec2.internal" event="NodeHasSufficientPID"
Jul 29 14:35:26.512515 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:26.512496    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-130.ec2.internal\" not found" node="ip-10-0-142-130.ec2.internal"
Jul 29 14:35:26.516761 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:26.516746    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-130.ec2.internal\" not found" node="ip-10-0-142-130.ec2.internal"
Jul 29 14:35:26.551001 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:26.550981    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-130.ec2.internal\" not found"
Jul 29 14:35:26.565175 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.565156    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/694b68de4c8fb4483f79ff80c8121d75-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-130.ec2.internal\" (UID: \"694b68de4c8fb4483f79ff80c8121d75\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-130.ec2.internal"
Jul 29 14:35:26.565222 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.565180    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/694b68de4c8fb4483f79ff80c8121d75-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-130.ec2.internal\" (UID: \"694b68de4c8fb4483f79ff80c8121d75\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-130.ec2.internal"
Jul 29 14:35:26.565259 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.565222    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/038bed7cc4edb557ac94333e7b84bbab-config\") pod \"kube-apiserver-proxy-ip-10-0-142-130.ec2.internal\" (UID: \"038bed7cc4edb557ac94333e7b84bbab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-130.ec2.internal"
Jul 29 14:35:26.651649 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:26.651594    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-130.ec2.internal\" not found"
Jul 29 14:35:26.666080 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.666060    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/694b68de4c8fb4483f79ff80c8121d75-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-130.ec2.internal\" (UID: \"694b68de4c8fb4483f79ff80c8121d75\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-130.ec2.internal"
Jul 29 14:35:26.666139 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.666085    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/694b68de4c8fb4483f79ff80c8121d75-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-130.ec2.internal\" (UID: \"694b68de4c8fb4483f79ff80c8121d75\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-130.ec2.internal"
Jul 29 14:35:26.666139 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.666103    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/038bed7cc4edb557ac94333e7b84bbab-config\") pod \"kube-apiserver-proxy-ip-10-0-142-130.ec2.internal\" (UID: \"038bed7cc4edb557ac94333e7b84bbab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-130.ec2.internal"
Jul 29 14:35:26.666201 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.666145    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/038bed7cc4edb557ac94333e7b84bbab-config\") pod \"kube-apiserver-proxy-ip-10-0-142-130.ec2.internal\" (UID: \"038bed7cc4edb557ac94333e7b84bbab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-130.ec2.internal"
Jul 29 14:35:26.666201 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.666150    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/694b68de4c8fb4483f79ff80c8121d75-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-130.ec2.internal\" (UID: \"694b68de4c8fb4483f79ff80c8121d75\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-130.ec2.internal"
Jul 29 14:35:26.666201 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:26.666185    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/694b68de4c8fb4483f79ff80c8121d75-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-130.ec2.internal\" (UID: \"694b68de4c8fb4483f79ff80c8121d75\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-130.ec2.internal"
Jul 29 14:35:28.632473 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:28.632452    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-130.ec2.internal\" not found"
Jul 29 14:35:28.695062 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:28.695036    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-130.ec2.internal"
Jul 29 14:35:28.699816 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:28.699676    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-130.ec2.internal"
Jul 29 14:35:28.733012 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:28.732989    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-130.ec2.internal\" not found"
Jul 29 14:35:28.833628 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:28.833573    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-130.ec2.internal\" not found"
Jul 29 14:35:28.934197 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:28.934173    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-130.ec2.internal\" not found"
Jul 29 14:35:28.986770 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:28.986748    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 29 14:35:28.987105 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:28.986871    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 14:35:29.034970 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:29.034947    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-130.ec2.internal\" not found"
Jul 29 14:35:29.050299 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:29.050267    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 14:30:28 +0000 UTC" deadline="2027-12-29 20:19:34.953213298 +0000 UTC"
Jul 29 14:35:29.050299 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:29.050292    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12437h44m5.902924637s"
Jul 29 14:35:29.135788 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:29.135738    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-130.ec2.internal\" not found"
Jul 29 14:35:29.236334 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:29.236310    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-130.ec2.internal\" not found"
Jul 29 14:35:29.273491 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:29.272502    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod694b68de4c8fb4483f79ff80c8121d75.slice/crio-01a245d989d47147cc036a06f5f9b1b7ec091eed7bc59dafe6e365860f1b70e7 WatchSource:0}: Error finding container 01a245d989d47147cc036a06f5f9b1b7ec091eed7bc59dafe6e365860f1b70e7: Status 404 returned error can't find the container with id 01a245d989d47147cc036a06f5f9b1b7ec091eed7bc59dafe6e365860f1b70e7
Jul 29 14:35:29.273491 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:29.273443    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod038bed7cc4edb557ac94333e7b84bbab.slice/crio-01bd023cd853ca0db54e337368c66c120d8e9b1b74f1b1dacff5865448267bda WatchSource:0}: Error finding container 01bd023cd853ca0db54e337368c66c120d8e9b1b74f1b1dacff5865448267bda: Status 404 returned error can't find the container with id 01bd023cd853ca0db54e337368c66c120d8e9b1b74f1b1dacff5865448267bda
Jul 29 14:35:29.278046 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:29.278030    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 14:35:29.319171 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:29.319154    2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 14:35:29.340002 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:29.339982    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-130.ec2.internal"
Jul 29 14:35:29.351632 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:29.351614    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 14:35:29.353323 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:29.353312    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-130.ec2.internal"
Jul 29 14:35:29.363366 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:29.363353    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 14:35:29.540834 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:29.540781    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 14:35:29.637373 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:29.637348    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 14:35:30.021682 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.021619    2578 apiserver.go:52] "Watching apiserver"
Jul 29 14:35:30.029402 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.029378    2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 29 14:35:30.030511 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.030486    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-2vpqw","kube-system/konnectivity-agent-fhxsx","kube-system/kube-apiserver-proxy-ip-10-0-142-130.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb6hf","openshift-cluster-node-tuning-operator/tuned-wcj2h","openshift-dns/node-resolver-7x2lq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-130.ec2.internal","openshift-multus/multus-xzx26","openshift-image-registry/node-ca-45d2s","openshift-multus/multus-additional-cni-plugins-snmxs","openshift-multus/network-metrics-daemon-6mrz9","openshift-network-diagnostics/network-check-target-nct6x","openshift-network-operator/iptables-alerter-5ssbl","openshift-ovn-kubernetes/ovnkube-node-988xj"]
Jul 29 14:35:30.032886 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.032858    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-snmxs"
Jul 29 14:35:30.035396 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.035023    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5ssbl"
Jul 29 14:35:30.035396 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.035341    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 29 14:35:30.036769 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.035684    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 29 14:35:30.036769 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.035758    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 29 14:35:30.036769 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.035837    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-tqtvj\""
Jul 29 14:35:30.037009 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.036984    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 29 14:35:30.037966 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.037938    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 29 14:35:30.038125 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.038106    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.038216 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.038201    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4q7j7\""
Jul 29 14:35:30.038643 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.038628    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 29 14:35:30.038766 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.038750    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 29 14:35:30.039527 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.039511    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 29 14:35:30.039771 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.039754    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 29 14:35:30.040554 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.040231    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb6hf"
Jul 29 14:35:30.040554 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.040550    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 29 14:35:30.041282 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.041178    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 29 14:35:30.041282 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.041249    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 29 14:35:30.041567 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.041546    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gx9l8\""
Jul 29 14:35:30.041932 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.041916    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 29 14:35:30.043628 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.043604    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wcj2h"
Jul 29 14:35:30.044252 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.044215    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 29 14:35:30.045107 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.044579    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 29 14:35:30.045107 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.044591    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 29 14:35:30.045107 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.044713    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 29 14:35:30.045107 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.044803    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-blp8h\""
Jul 29 14:35:30.045107 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.044959    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 29 14:35:30.046440 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.046253    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 29 14:35:30.046979 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.046598    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 29 14:35:30.046979 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.046622    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pnkp7\""
Jul 29 14:35:30.046979 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.046772    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7x2lq"
Jul 29 14:35:30.048815 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.048794    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-45d2s"
Jul 29 14:35:30.049326 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.049298    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 29 14:35:30.049417 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.049338    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 29 14:35:30.049510 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.049495    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fv8lx\""
Jul 29 14:35:30.049920 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.049901    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 14:35:30.051225 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.051076    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 29 14:35:30.051225 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.051183    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.051848 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.051830    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 29 14:35:30.051972 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.051953    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 29 14:35:30.052156 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.052080    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-j7sdl\""
Jul 29 14:35:30.053553 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.053533    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fhxsx"
Jul 29 14:35:30.053977 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.053862    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-56l7r\""
Jul 29 14:35:30.055006 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.054731    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0e1522ce-4233-4d55-9c6c-0cd5d33306de-run-openvswitch\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.055006 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.054772    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0e1522ce-4233-4d55-9c6c-0cd5d33306de-env-overrides\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.055006 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.054799    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/83bcb626-fb26-45b7-8196-ed63201905b8-device-dir\") pod \"aws-ebs-csi-driver-node-fb6hf\" (UID: \"83bcb626-fb26-45b7-8196-ed63201905b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb6hf"
Jul 29 14:35:30.055006 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.054822    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2522b73f-2f30-4989-95e2-e580353f3476-etc-sysctl-conf\") pod \"tuned-wcj2h\" (UID: \"2522b73f-2f30-4989-95e2-e580353f3476\") " pod="openshift-cluster-node-tuning-operator/tuned-wcj2h"
Jul 29 14:35:30.055006 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.054880    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0e1522ce-4233-4d55-9c6c-0cd5d33306de-host-run-netns\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.055006 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.054901    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/83bcb626-fb26-45b7-8196-ed63201905b8-socket-dir\") pod \"aws-ebs-csi-driver-node-fb6hf\" (UID: \"83bcb626-fb26-45b7-8196-ed63201905b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb6hf"
Jul 29 14:35:30.055006 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.054940    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hz7t\" (UniqueName: \"kubernetes.io/projected/83bcb626-fb26-45b7-8196-ed63201905b8-kube-api-access-8hz7t\") pod \"aws-ebs-csi-driver-node-fb6hf\" (UID: \"83bcb626-fb26-45b7-8196-ed63201905b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb6hf"
Jul 29 14:35:30.055006 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.054963    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/07bd3568-fdc0-4b2b-968f-16a9798a8837-system-cni-dir\") pod \"multus-additional-cni-plugins-snmxs\" (UID: \"07bd3568-fdc0-4b2b-968f-16a9798a8837\") " pod="openshift-multus/multus-additional-cni-plugins-snmxs"
Jul 29 14:35:30.055006 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.054992    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/07bd3568-fdc0-4b2b-968f-16a9798a8837-cnibin\") pod \"multus-additional-cni-plugins-snmxs\" (UID: \"07bd3568-fdc0-4b2b-968f-16a9798a8837\") " pod="openshift-multus/multus-additional-cni-plugins-snmxs"
Jul 29 14:35:30.055540 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.055027    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/07bd3568-fdc0-4b2b-968f-16a9798a8837-cni-binary-copy\") pod \"multus-additional-cni-plugins-snmxs\" (UID: \"07bd3568-fdc0-4b2b-968f-16a9798a8837\") " pod="openshift-multus/multus-additional-cni-plugins-snmxs"
Jul 29 14:35:30.055540 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.055054    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvh6c\" (UniqueName: \"kubernetes.io/projected/9c25d1eb-eae7-472d-ab72-96a1c5b1c27b-kube-api-access-bvh6c\") pod \"iptables-alerter-5ssbl\" (UID: \"9c25d1eb-eae7-472d-ab72-96a1c5b1c27b\") " pod="openshift-network-operator/iptables-alerter-5ssbl"
Jul 29 14:35:30.055540 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.055093    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0e1522ce-4233-4d55-9c6c-0cd5d33306de-host-cni-bin\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.055540 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.055124    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bd27b85-9683-41c2-a03a-acdb420a89e2-tmp-dir\") pod \"node-resolver-7x2lq\" (UID: \"7bd27b85-9683-41c2-a03a-acdb420a89e2\") " pod="openshift-dns/node-resolver-7x2lq"
Jul 29 14:35:30.055540 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.055175    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm7ph\" (UniqueName: \"kubernetes.io/projected/07bd3568-fdc0-4b2b-968f-16a9798a8837-kube-api-access-bm7ph\") pod \"multus-additional-cni-plugins-snmxs\" (UID: \"07bd3568-fdc0-4b2b-968f-16a9798a8837\") " pod="openshift-multus/multus-additional-cni-plugins-snmxs"
Jul 29 14:35:30.055540 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.055198    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2522b73f-2f30-4989-95e2-e580353f3476-etc-modprobe-d\") pod \"tuned-wcj2h\" (UID: \"2522b73f-2f30-4989-95e2-e580353f3476\") " pod="openshift-cluster-node-tuning-operator/tuned-wcj2h"
Jul 29 14:35:30.055540 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.055219    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2522b73f-2f30-4989-95e2-e580353f3476-etc-sysctl-d\") pod \"tuned-wcj2h\" (UID: \"2522b73f-2f30-4989-95e2-e580353f3476\") " pod="openshift-cluster-node-tuning-operator/tuned-wcj2h"
Jul 29 14:35:30.055540 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.055231    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 29 14:35:30.055540 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.055256    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vlzw\" (UniqueName: \"kubernetes.io/projected/7bd27b85-9683-41c2-a03a-acdb420a89e2-kube-api-access-5vlzw\") pod \"node-resolver-7x2lq\" (UID: \"7bd27b85-9683-41c2-a03a-acdb420a89e2\") " pod="openshift-dns/node-resolver-7x2lq"
Jul 29 14:35:30.055540 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.055305    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/07bd3568-fdc0-4b2b-968f-16a9798a8837-os-release\") pod \"multus-additional-cni-plugins-snmxs\" (UID: \"07bd3568-fdc0-4b2b-968f-16a9798a8837\") " pod="openshift-multus/multus-additional-cni-plugins-snmxs"
Jul 29 14:35:30.055540 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.055329    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e1522ce-4233-4d55-9c6c-0cd5d33306de-host-kubelet\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.055540 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.055351    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0e1522ce-4233-4d55-9c6c-0cd5d33306de-var-lib-openvswitch\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.055540 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.055383    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0e1522ce-4233-4d55-9c6c-0cd5d33306de-run-ovn\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.055540 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.055404    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/83bcb626-fb26-45b7-8196-ed63201905b8-registration-dir\") pod \"aws-ebs-csi-driver-node-fb6hf\" (UID: \"83bcb626-fb26-45b7-8196-ed63201905b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb6hf"
Jul 29 14:35:30.055540 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.055425    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2522b73f-2f30-4989-95e2-e580353f3476-sys\") pod \"tuned-wcj2h\" (UID: \"2522b73f-2f30-4989-95e2-e580353f3476\") " pod="openshift-cluster-node-tuning-operator/tuned-wcj2h"
Jul 29 14:35:30.055540 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.055458    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/07bd3568-fdc0-4b2b-968f-16a9798a8837-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-snmxs\" (UID: \"07bd3568-fdc0-4b2b-968f-16a9798a8837\") " pod="openshift-multus/multus-additional-cni-plugins-snmxs"
Jul 29 14:35:30.055540 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.055504    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0e1522ce-4233-4d55-9c6c-0cd5d33306de-host-slash\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.056340 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.055536    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0e1522ce-4233-4d55-9c6c-0cd5d33306de-run-systemd\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.056340 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.055557    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2522b73f-2f30-4989-95e2-e580353f3476-etc-kubernetes\") pod \"tuned-wcj2h\" (UID: \"2522b73f-2f30-4989-95e2-e580353f3476\") " pod="openshift-cluster-node-tuning-operator/tuned-wcj2h"
Jul 29 14:35:30.056340 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.055577    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2522b73f-2f30-4989-95e2-e580353f3476-etc-systemd\") pod \"tuned-wcj2h\" (UID: \"2522b73f-2f30-4989-95e2-e580353f3476\") " pod="openshift-cluster-node-tuning-operator/tuned-wcj2h"
Jul 29 14:35:30.056340 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.055601    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0e1522ce-4233-4d55-9c6c-0cd5d33306de-etc-openvswitch\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.056340 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.055626    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0e1522ce-4233-4d55-9c6c-0cd5d33306de-host-cni-netd\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.056340 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.055663    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/83bcb626-fb26-45b7-8196-ed63201905b8-sys-fs\") pod \"aws-ebs-csi-driver-node-fb6hf\" (UID: \"83bcb626-fb26-45b7-8196-ed63201905b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb6hf"
Jul 29 14:35:30.056340 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.055684    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2522b73f-2f30-4989-95e2-e580353f3476-var-lib-kubelet\") pod \"tuned-wcj2h\" (UID: \"2522b73f-2f30-4989-95e2-e580353f3476\") " pod="openshift-cluster-node-tuning-operator/tuned-wcj2h"
Jul 29 14:35:30.056340 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.055694    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6wppp\""
Jul 29 14:35:30.056340 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.055704    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2522b73f-2f30-4989-95e2-e580353f3476-host\") pod \"tuned-wcj2h\" (UID: \"2522b73f-2f30-4989-95e2-e580353f3476\") " pod="openshift-cluster-node-tuning-operator/tuned-wcj2h"
Jul 29 14:35:30.056340 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.055726    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c25d1eb-eae7-472d-ab72-96a1c5b1c27b-iptables-alerter-script\") pod \"iptables-alerter-5ssbl\" (UID: \"9c25d1eb-eae7-472d-ab72-96a1c5b1c27b\") " pod="openshift-network-operator/iptables-alerter-5ssbl"
Jul 29 14:35:30.056340 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.055747    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/83bcb626-fb26-45b7-8196-ed63201905b8-etc-selinux\") pod \"aws-ebs-csi-driver-node-fb6hf\" (UID: \"83bcb626-fb26-45b7-8196-ed63201905b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb6hf"
Jul 29 14:35:30.056340 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.055769    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0e1522ce-4233-4d55-9c6c-0cd5d33306de-log-socket\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.056340 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.055790    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0e1522ce-4233-4d55-9c6c-0cd5d33306de-ovnkube-config\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.056340 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.055818    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0e1522ce-4233-4d55-9c6c-0cd5d33306de-ovnkube-script-lib\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.056340 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.055841    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwz44\" (UniqueName: \"kubernetes.io/projected/0e1522ce-4233-4d55-9c6c-0cd5d33306de-kube-api-access-jwz44\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.056340 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.055877    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0e1522ce-4233-4d55-9c6c-0cd5d33306de-node-log\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.056340 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.055898    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/83bcb626-fb26-45b7-8196-ed63201905b8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fb6hf\" (UID: \"83bcb626-fb26-45b7-8196-ed63201905b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb6hf"
Jul 29 14:35:30.057060 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.055920    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2522b73f-2f30-4989-95e2-e580353f3476-etc-sysconfig\") pod \"tuned-wcj2h\" (UID: \"2522b73f-2f30-4989-95e2-e580353f3476\") " pod="openshift-cluster-node-tuning-operator/tuned-wcj2h"
Jul 29 14:35:30.057060 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.055943    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e1522ce-4233-4d55-9c6c-0cd5d33306de-host-run-ovn-kubernetes\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.057060 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.055966    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e1522ce-4233-4d55-9c6c-0cd5d33306de-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.057060 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.055990    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0e1522ce-4233-4d55-9c6c-0cd5d33306de-ovn-node-metrics-cert\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.057060 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.056006    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vpqw"
Jul 29 14:35:30.057060 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.056013    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0e1522ce-4233-4d55-9c6c-0cd5d33306de-systemd-units\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.057060 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.056034    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlvb2\" (UniqueName: \"kubernetes.io/projected/2522b73f-2f30-4989-95e2-e580353f3476-kube-api-access-dlvb2\") pod \"tuned-wcj2h\" (UID: \"2522b73f-2f30-4989-95e2-e580353f3476\") " pod="openshift-cluster-node-tuning-operator/tuned-wcj2h"
Jul 29 14:35:30.057060 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.056059    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/07bd3568-fdc0-4b2b-968f-16a9798a8837-tuning-conf-dir\") pod \"multus-additional-cni-plugins-snmxs\" (UID: \"07bd3568-fdc0-4b2b-968f-16a9798a8837\") " pod="openshift-multus/multus-additional-cni-plugins-snmxs"
Jul 29 14:35:30.057060 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:30.056080    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vpqw" podUID="a331e3af-23b3-4dd4-a427-8b1a93f9441c"
Jul 29 14:35:30.057060 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.056081    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/07bd3568-fdc0-4b2b-968f-16a9798a8837-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-snmxs\" (UID: \"07bd3568-fdc0-4b2b-968f-16a9798a8837\") " pod="openshift-multus/multus-additional-cni-plugins-snmxs"
Jul 29 14:35:30.057060 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.056134    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c25d1eb-eae7-472d-ab72-96a1c5b1c27b-host-slash\") pod \"iptables-alerter-5ssbl\" (UID: \"9c25d1eb-eae7-472d-ab72-96a1c5b1c27b\") " pod="openshift-network-operator/iptables-alerter-5ssbl"
Jul 29 14:35:30.057060 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.056225    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2522b73f-2f30-4989-95e2-e580353f3476-lib-modules\") pod \"tuned-wcj2h\" (UID: \"2522b73f-2f30-4989-95e2-e580353f3476\") " pod="openshift-cluster-node-tuning-operator/tuned-wcj2h"
Jul 29 14:35:30.057060 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.056269    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2522b73f-2f30-4989-95e2-e580353f3476-etc-tuned\") pod \"tuned-wcj2h\" (UID: \"2522b73f-2f30-4989-95e2-e580353f3476\") " pod="openshift-cluster-node-tuning-operator/tuned-wcj2h"
Jul 29 14:35:30.057060 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.056304    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7bd27b85-9683-41c2-a03a-acdb420a89e2-hosts-file\") pod \"node-resolver-7x2lq\" (UID: \"7bd27b85-9683-41c2-a03a-acdb420a89e2\") " pod="openshift-dns/node-resolver-7x2lq"
Jul 29 14:35:30.057060 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.056335    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2522b73f-2f30-4989-95e2-e580353f3476-run\") pod \"tuned-wcj2h\" (UID: \"2522b73f-2f30-4989-95e2-e580353f3476\") " pod="openshift-cluster-node-tuning-operator/tuned-wcj2h"
Jul 29 14:35:30.057060 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.056383    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2522b73f-2f30-4989-95e2-e580353f3476-tmp\") pod \"tuned-wcj2h\" (UID: \"2522b73f-2f30-4989-95e2-e580353f3476\") " pod="openshift-cluster-node-tuning-operator/tuned-wcj2h"
Jul 29 14:35:30.057757 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.057075    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 29 14:35:30.057757 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.057284    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 29 14:35:30.058202 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.058186    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6mrz9"
Jul 29 14:35:30.058331 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:30.058278    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6mrz9" podUID="3d750720-77d3-457c-91d0-a8638d494329"
Jul 29 14:35:30.060619 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.060558    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nct6x"
Jul 29 14:35:30.060730 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:30.060618    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nct6x" podUID="c03c2192-7d27-4033-9f74-f91ae62dc072"
Jul 29 14:35:30.072822 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.072791    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nbn4v"
Jul 29 14:35:30.083858 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.083640    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nbn4v"
Jul 29 14:35:30.143151 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.143130    2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 29 14:35:30.156840 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.156815    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e1522ce-4233-4d55-9c6c-0cd5d33306de-host-run-ovn-kubernetes\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.156939 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.156851    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e1522ce-4233-4d55-9c6c-0cd5d33306de-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.156939 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.156870    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0e1522ce-4233-4d55-9c6c-0cd5d33306de-ovn-node-metrics-cert\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.156939 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.156894    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b15e08c3-042f-4cee-b09a-ac696b3a8c75-host-var-lib-kubelet\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.156939 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.156917    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b15e08c3-042f-4cee-b09a-ac696b3a8c75-multus-conf-dir\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.156939 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.156927    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e1522ce-4233-4d55-9c6c-0cd5d33306de-host-run-ovn-kubernetes\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.156939 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.156939    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt7wp\" (UniqueName: \"kubernetes.io/projected/b15e08c3-042f-4cee-b09a-ac696b3a8c75-kube-api-access-zt7wp\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.157364 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.156951    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e1522ce-4233-4d55-9c6c-0cd5d33306de-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.157364 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.156963    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zsbw\" (UniqueName: \"kubernetes.io/projected/c03c2192-7d27-4033-9f74-f91ae62dc072-kube-api-access-9zsbw\") pod \"network-check-target-nct6x\" (UID: \"c03c2192-7d27-4033-9f74-f91ae62dc072\") " pod="openshift-network-diagnostics/network-check-target-nct6x"
Jul 29 14:35:30.157364 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.156999    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/19ba33a6-9b54-4130-a3e0-950186199417-host\") pod \"node-ca-45d2s\" (UID: \"19ba33a6-9b54-4130-a3e0-950186199417\") " pod="openshift-image-registry/node-ca-45d2s"
Jul 29 14:35:30.157364 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.157041    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0e1522ce-4233-4d55-9c6c-0cd5d33306de-systemd-units\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.157364 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.157074    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlvb2\" (UniqueName: \"kubernetes.io/projected/2522b73f-2f30-4989-95e2-e580353f3476-kube-api-access-dlvb2\") pod \"tuned-wcj2h\" (UID: \"2522b73f-2f30-4989-95e2-e580353f3476\") " pod="openshift-cluster-node-tuning-operator/tuned-wcj2h"
Jul 29 14:35:30.157364 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.157079    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0e1522ce-4233-4d55-9c6c-0cd5d33306de-systemd-units\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.157364 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.157192    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/07bd3568-fdc0-4b2b-968f-16a9798a8837-tuning-conf-dir\") pod \"multus-additional-cni-plugins-snmxs\" (UID: \"07bd3568-fdc0-4b2b-968f-16a9798a8837\") " pod="openshift-multus/multus-additional-cni-plugins-snmxs"
Jul 29 14:35:30.157364 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.157227    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/07bd3568-fdc0-4b2b-968f-16a9798a8837-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-snmxs\" (UID: \"07bd3568-fdc0-4b2b-968f-16a9798a8837\") " pod="openshift-multus/multus-additional-cni-plugins-snmxs"
Jul 29 14:35:30.157364 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.157264    2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 29 14:35:30.157364 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.157267    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c25d1eb-eae7-472d-ab72-96a1c5b1c27b-host-slash\") pod \"iptables-alerter-5ssbl\" (UID: \"9c25d1eb-eae7-472d-ab72-96a1c5b1c27b\") " pod="openshift-network-operator/iptables-alerter-5ssbl"
Jul 29 14:35:30.157364 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.157321    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cc65f159-92b2-4ba1-ba56-9ebde361a37f-konnectivity-ca\") pod \"konnectivity-agent-fhxsx\" (UID: \"cc65f159-92b2-4ba1-ba56-9ebde361a37f\") " pod="kube-system/konnectivity-agent-fhxsx"
Jul 29 14:35:30.157364 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.157334    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c25d1eb-eae7-472d-ab72-96a1c5b1c27b-host-slash\") pod \"iptables-alerter-5ssbl\" (UID: \"9c25d1eb-eae7-472d-ab72-96a1c5b1c27b\") " pod="openshift-network-operator/iptables-alerter-5ssbl"
Jul 29 14:35:30.157935 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.157384    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2522b73f-2f30-4989-95e2-e580353f3476-lib-modules\") pod \"tuned-wcj2h\" (UID: \"2522b73f-2f30-4989-95e2-e580353f3476\") " pod="openshift-cluster-node-tuning-operator/tuned-wcj2h"
Jul 29 14:35:30.157935 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.157412    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2522b73f-2f30-4989-95e2-e580353f3476-etc-tuned\") pod \"tuned-wcj2h\" (UID: \"2522b73f-2f30-4989-95e2-e580353f3476\") " pod="openshift-cluster-node-tuning-operator/tuned-wcj2h"
Jul 29 14:35:30.157935 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.157417    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/07bd3568-fdc0-4b2b-968f-16a9798a8837-tuning-conf-dir\") pod \"multus-additional-cni-plugins-snmxs\" (UID: \"07bd3568-fdc0-4b2b-968f-16a9798a8837\") " pod="openshift-multus/multus-additional-cni-plugins-snmxs"
Jul 29 14:35:30.157935 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.157436    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7bd27b85-9683-41c2-a03a-acdb420a89e2-hosts-file\") pod \"node-resolver-7x2lq\" (UID: \"7bd27b85-9683-41c2-a03a-acdb420a89e2\") " pod="openshift-dns/node-resolver-7x2lq"
Jul 29 14:35:30.157935 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.157459    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2522b73f-2f30-4989-95e2-e580353f3476-run\") pod \"tuned-wcj2h\" (UID: \"2522b73f-2f30-4989-95e2-e580353f3476\") " pod="openshift-cluster-node-tuning-operator/tuned-wcj2h"
Jul 29 14:35:30.157935 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.157479    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2522b73f-2f30-4989-95e2-e580353f3476-tmp\") pod \"tuned-wcj2h\" (UID: \"2522b73f-2f30-4989-95e2-e580353f3476\") " pod="openshift-cluster-node-tuning-operator/tuned-wcj2h"
Jul 29 14:35:30.157935 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.157489    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7bd27b85-9683-41c2-a03a-acdb420a89e2-hosts-file\") pod \"node-resolver-7x2lq\" (UID: \"7bd27b85-9683-41c2-a03a-acdb420a89e2\") " pod="openshift-dns/node-resolver-7x2lq"
Jul 29 14:35:30.157935 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.157504    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b15e08c3-042f-4cee-b09a-ac696b3a8c75-multus-socket-dir-parent\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.157935 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.157529    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b15e08c3-042f-4cee-b09a-ac696b3a8c75-multus-daemon-config\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.157935 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.157436    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2522b73f-2f30-4989-95e2-e580353f3476-lib-modules\") pod \"tuned-wcj2h\" (UID: \"2522b73f-2f30-4989-95e2-e580353f3476\") " pod="openshift-cluster-node-tuning-operator/tuned-wcj2h"
Jul 29 14:35:30.157935 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.157551    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg64f\" (UniqueName: \"kubernetes.io/projected/19ba33a6-9b54-4130-a3e0-950186199417-kube-api-access-kg64f\") pod \"node-ca-45d2s\" (UID: \"19ba33a6-9b54-4130-a3e0-950186199417\") " pod="openshift-image-registry/node-ca-45d2s"
Jul 29 14:35:30.157935 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.157606    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2522b73f-2f30-4989-95e2-e580353f3476-run\") pod \"tuned-wcj2h\" (UID: \"2522b73f-2f30-4989-95e2-e580353f3476\") " pod="openshift-cluster-node-tuning-operator/tuned-wcj2h"
Jul 29 14:35:30.157935 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.157611    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0e1522ce-4233-4d55-9c6c-0cd5d33306de-run-openvswitch\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.157935 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.157652    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0e1522ce-4233-4d55-9c6c-0cd5d33306de-env-overrides\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.157935 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.157666    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0e1522ce-4233-4d55-9c6c-0cd5d33306de-run-openvswitch\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.157935 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.157681    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/83bcb626-fb26-45b7-8196-ed63201905b8-device-dir\") pod \"aws-ebs-csi-driver-node-fb6hf\" (UID: \"83bcb626-fb26-45b7-8196-ed63201905b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb6hf"
Jul 29 14:35:30.157935 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.157703    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2522b73f-2f30-4989-95e2-e580353f3476-etc-sysctl-conf\") pod \"tuned-wcj2h\" (UID: \"2522b73f-2f30-4989-95e2-e580353f3476\") " pod="openshift-cluster-node-tuning-operator/tuned-wcj2h"
Jul 29 14:35:30.158696 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.157727    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b15e08c3-042f-4cee-b09a-ac696b3a8c75-multus-cni-dir\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.158696 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.157758    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b15e08c3-042f-4cee-b09a-ac696b3a8c75-os-release\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.158696 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.157780    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0e1522ce-4233-4d55-9c6c-0cd5d33306de-host-run-netns\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.158696 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.157786    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/07bd3568-fdc0-4b2b-968f-16a9798a8837-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-snmxs\" (UID: \"07bd3568-fdc0-4b2b-968f-16a9798a8837\") " pod="openshift-multus/multus-additional-cni-plugins-snmxs"
Jul 29 14:35:30.158696 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.157802    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/83bcb626-fb26-45b7-8196-ed63201905b8-socket-dir\") pod \"aws-ebs-csi-driver-node-fb6hf\" (UID: \"83bcb626-fb26-45b7-8196-ed63201905b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb6hf"
Jul 29 14:35:30.158696 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.157829    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hz7t\" (UniqueName: \"kubernetes.io/projected/83bcb626-fb26-45b7-8196-ed63201905b8-kube-api-access-8hz7t\") pod \"aws-ebs-csi-driver-node-fb6hf\" (UID: \"83bcb626-fb26-45b7-8196-ed63201905b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb6hf"
Jul 29 14:35:30.158696 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.157871    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/07bd3568-fdc0-4b2b-968f-16a9798a8837-system-cni-dir\") pod \"multus-additional-cni-plugins-snmxs\" (UID: \"07bd3568-fdc0-4b2b-968f-16a9798a8837\") " pod="openshift-multus/multus-additional-cni-plugins-snmxs"
Jul 29 14:35:30.158696 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.157899    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/07bd3568-fdc0-4b2b-968f-16a9798a8837-cnibin\") pod \"multus-additional-cni-plugins-snmxs\" (UID: \"07bd3568-fdc0-4b2b-968f-16a9798a8837\") " pod="openshift-multus/multus-additional-cni-plugins-snmxs"
Jul 29 14:35:30.158696 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.157924    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/07bd3568-fdc0-4b2b-968f-16a9798a8837-cni-binary-copy\") pod \"multus-additional-cni-plugins-snmxs\" (UID: \"07bd3568-fdc0-4b2b-968f-16a9798a8837\") " pod="openshift-multus/multus-additional-cni-plugins-snmxs"
Jul 29 14:35:30.158696 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.157945    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b15e08c3-042f-4cee-b09a-ac696b3a8c75-host-run-k8s-cni-cncf-io\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.158696 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.157967    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a331e3af-23b3-4dd4-a427-8b1a93f9441c-original-pull-secret\") pod \"global-pull-secret-syncer-2vpqw\" (UID: \"a331e3af-23b3-4dd4-a427-8b1a93f9441c\") " pod="kube-system/global-pull-secret-syncer-2vpqw"
Jul 29 14:35:30.158696 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.157988    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvh6c\" (UniqueName: \"kubernetes.io/projected/9c25d1eb-eae7-472d-ab72-96a1c5b1c27b-kube-api-access-bvh6c\") pod \"iptables-alerter-5ssbl\" (UID: \"9c25d1eb-eae7-472d-ab72-96a1c5b1c27b\") " pod="openshift-network-operator/iptables-alerter-5ssbl"
Jul 29 14:35:30.158696 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.158008    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d750720-77d3-457c-91d0-a8638d494329-metrics-certs\") pod \"network-metrics-daemon-6mrz9\" (UID: \"3d750720-77d3-457c-91d0-a8638d494329\") " pod="openshift-multus/network-metrics-daemon-6mrz9"
Jul 29 14:35:30.158696 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.158026    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0e1522ce-4233-4d55-9c6c-0cd5d33306de-host-cni-bin\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.158696 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.158035    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0e1522ce-4233-4d55-9c6c-0cd5d33306de-env-overrides\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.158696 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.158046    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bd27b85-9683-41c2-a03a-acdb420a89e2-tmp-dir\") pod \"node-resolver-7x2lq\" (UID: \"7bd27b85-9683-41c2-a03a-acdb420a89e2\") " pod="openshift-dns/node-resolver-7x2lq"
Jul 29 14:35:30.158696 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.158057    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/83bcb626-fb26-45b7-8196-ed63201905b8-device-dir\") pod \"aws-ebs-csi-driver-node-fb6hf\" (UID: \"83bcb626-fb26-45b7-8196-ed63201905b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb6hf"
Jul 29 14:35:30.159487 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.158076    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bm7ph\" (UniqueName: \"kubernetes.io/projected/07bd3568-fdc0-4b2b-968f-16a9798a8837-kube-api-access-bm7ph\") pod \"multus-additional-cni-plugins-snmxs\" (UID: \"07bd3568-fdc0-4b2b-968f-16a9798a8837\") " pod="openshift-multus/multus-additional-cni-plugins-snmxs"
Jul 29 14:35:30.159487 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.158103    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b15e08c3-042f-4cee-b09a-ac696b3a8c75-etc-kubernetes\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.159487 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.158127    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2522b73f-2f30-4989-95e2-e580353f3476-etc-modprobe-d\") pod \"tuned-wcj2h\" (UID: \"2522b73f-2f30-4989-95e2-e580353f3476\") " pod="openshift-cluster-node-tuning-operator/tuned-wcj2h"
Jul 29 14:35:30.159487 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.158146    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2522b73f-2f30-4989-95e2-e580353f3476-etc-sysctl-d\") pod \"tuned-wcj2h\" (UID: \"2522b73f-2f30-4989-95e2-e580353f3476\") " pod="openshift-cluster-node-tuning-operator/tuned-wcj2h"
Jul 29 14:35:30.159487 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.158163    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2522b73f-2f30-4989-95e2-e580353f3476-etc-sysctl-conf\") pod \"tuned-wcj2h\" (UID: \"2522b73f-2f30-4989-95e2-e580353f3476\") " pod="openshift-cluster-node-tuning-operator/tuned-wcj2h"
Jul 29 14:35:30.159487 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.158165    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vlzw\" (UniqueName: \"kubernetes.io/projected/7bd27b85-9683-41c2-a03a-acdb420a89e2-kube-api-access-5vlzw\") pod \"node-resolver-7x2lq\" (UID: \"7bd27b85-9683-41c2-a03a-acdb420a89e2\") " pod="openshift-dns/node-resolver-7x2lq"
Jul 29 14:35:30.159487 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.158281    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bd27b85-9683-41c2-a03a-acdb420a89e2-tmp-dir\") pod \"node-resolver-7x2lq\" (UID: \"7bd27b85-9683-41c2-a03a-acdb420a89e2\") " pod="openshift-dns/node-resolver-7x2lq"
Jul 29 14:35:30.159487 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.158456    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2522b73f-2f30-4989-95e2-e580353f3476-etc-modprobe-d\") pod \"tuned-wcj2h\" (UID: \"2522b73f-2f30-4989-95e2-e580353f3476\") " pod="openshift-cluster-node-tuning-operator/tuned-wcj2h"
Jul 29 14:35:30.159487 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.158457    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/07bd3568-fdc0-4b2b-968f-16a9798a8837-cnibin\") pod \"multus-additional-cni-plugins-snmxs\" (UID: \"07bd3568-fdc0-4b2b-968f-16a9798a8837\") " pod="openshift-multus/multus-additional-cni-plugins-snmxs"
Jul 29 14:35:30.159487 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.158494    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/07bd3568-fdc0-4b2b-968f-16a9798a8837-os-release\") pod \"multus-additional-cni-plugins-snmxs\" (UID: \"07bd3568-fdc0-4b2b-968f-16a9798a8837\") " pod="openshift-multus/multus-additional-cni-plugins-snmxs"
Jul 29 14:35:30.159487 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.158516    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e1522ce-4233-4d55-9c6c-0cd5d33306de-host-kubelet\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.159487 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.158529    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2522b73f-2f30-4989-95e2-e580353f3476-etc-sysctl-d\") pod \"tuned-wcj2h\" (UID: \"2522b73f-2f30-4989-95e2-e580353f3476\") " pod="openshift-cluster-node-tuning-operator/tuned-wcj2h"
Jul 29 14:35:30.159487 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.158539    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0e1522ce-4233-4d55-9c6c-0cd5d33306de-var-lib-openvswitch\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.159487 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.158561    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0e1522ce-4233-4d55-9c6c-0cd5d33306de-run-ovn\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.159487 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.158586    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/83bcb626-fb26-45b7-8196-ed63201905b8-registration-dir\") pod \"aws-ebs-csi-driver-node-fb6hf\" (UID: \"83bcb626-fb26-45b7-8196-ed63201905b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb6hf"
Jul 29 14:35:30.159487 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.158613    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/83bcb626-fb26-45b7-8196-ed63201905b8-socket-dir\") pod \"aws-ebs-csi-driver-node-fb6hf\" (UID: \"83bcb626-fb26-45b7-8196-ed63201905b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb6hf"
Jul 29 14:35:30.159487 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.158645    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2522b73f-2f30-4989-95e2-e580353f3476-sys\") pod \"tuned-wcj2h\" (UID: \"2522b73f-2f30-4989-95e2-e580353f3476\") " pod="openshift-cluster-node-tuning-operator/tuned-wcj2h"
Jul 29 14:35:30.160340 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.158614    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2522b73f-2f30-4989-95e2-e580353f3476-sys\") pod \"tuned-wcj2h\" (UID: \"2522b73f-2f30-4989-95e2-e580353f3476\") " pod="openshift-cluster-node-tuning-operator/tuned-wcj2h"
Jul 29 14:35:30.160340 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.158711    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0e1522ce-4233-4d55-9c6c-0cd5d33306de-host-run-netns\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.160340 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.158747    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/07bd3568-fdc0-4b2b-968f-16a9798a8837-system-cni-dir\") pod \"multus-additional-cni-plugins-snmxs\" (UID: \"07bd3568-fdc0-4b2b-968f-16a9798a8837\") " pod="openshift-multus/multus-additional-cni-plugins-snmxs"
Jul 29 14:35:30.160340 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.158770    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b15e08c3-042f-4cee-b09a-ac696b3a8c75-cnibin\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.160340 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.158801    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/07bd3568-fdc0-4b2b-968f-16a9798a8837-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-snmxs\" (UID: \"07bd3568-fdc0-4b2b-968f-16a9798a8837\") " pod="openshift-multus/multus-additional-cni-plugins-snmxs"
Jul 29 14:35:30.160340 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.158807    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0e1522ce-4233-4d55-9c6c-0cd5d33306de-host-cni-bin\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.160340 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.158829    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0e1522ce-4233-4d55-9c6c-0cd5d33306de-host-slash\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.160340 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.158853    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0e1522ce-4233-4d55-9c6c-0cd5d33306de-run-systemd\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.160340 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.158857    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/07bd3568-fdc0-4b2b-968f-16a9798a8837-os-release\") pod \"multus-additional-cni-plugins-snmxs\" (UID: \"07bd3568-fdc0-4b2b-968f-16a9798a8837\") " pod="openshift-multus/multus-additional-cni-plugins-snmxs"
Jul 29 14:35:30.160340 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.158871    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/07bd3568-fdc0-4b2b-968f-16a9798a8837-cni-binary-copy\") pod \"multus-additional-cni-plugins-snmxs\" (UID: \"07bd3568-fdc0-4b2b-968f-16a9798a8837\") " pod="openshift-multus/multus-additional-cni-plugins-snmxs"
Jul 29 14:35:30.160340 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.158877    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2522b73f-2f30-4989-95e2-e580353f3476-etc-kubernetes\") pod \"tuned-wcj2h\" (UID: \"2522b73f-2f30-4989-95e2-e580353f3476\") " pod="openshift-cluster-node-tuning-operator/tuned-wcj2h"
Jul 29 14:35:30.160340 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.158919    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2522b73f-2f30-4989-95e2-e580353f3476-etc-systemd\") pod \"tuned-wcj2h\" (UID: \"2522b73f-2f30-4989-95e2-e580353f3476\") " pod="openshift-cluster-node-tuning-operator/tuned-wcj2h"
Jul 29 14:35:30.160340 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.158939    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/83bcb626-fb26-45b7-8196-ed63201905b8-registration-dir\") pod \"aws-ebs-csi-driver-node-fb6hf\" (UID: \"83bcb626-fb26-45b7-8196-ed63201905b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb6hf"
Jul 29 14:35:30.160340 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.158952    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b15e08c3-042f-4cee-b09a-ac696b3a8c75-cni-binary-copy\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.160340 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.158973    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0e1522ce-4233-4d55-9c6c-0cd5d33306de-var-lib-openvswitch\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.160340 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.158982    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b15e08c3-042f-4cee-b09a-ac696b3a8c75-system-cni-dir\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.160340 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.158986    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e1522ce-4233-4d55-9c6c-0cd5d33306de-host-kubelet\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.161092 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.159026    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2522b73f-2f30-4989-95e2-e580353f3476-etc-kubernetes\") pod \"tuned-wcj2h\" (UID: \"2522b73f-2f30-4989-95e2-e580353f3476\") " pod="openshift-cluster-node-tuning-operator/tuned-wcj2h"
Jul 29 14:35:30.161092 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.159072    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2522b73f-2f30-4989-95e2-e580353f3476-etc-systemd\") pod \"tuned-wcj2h\" (UID: \"2522b73f-2f30-4989-95e2-e580353f3476\") " pod="openshift-cluster-node-tuning-operator/tuned-wcj2h"
Jul 29 14:35:30.161092 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.159104    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0e1522ce-4233-4d55-9c6c-0cd5d33306de-run-systemd\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.161092 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.159118    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0e1522ce-4233-4d55-9c6c-0cd5d33306de-run-ovn\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.161092 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.159133    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0e1522ce-4233-4d55-9c6c-0cd5d33306de-host-slash\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.161092 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.159174    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b15e08c3-042f-4cee-b09a-ac696b3a8c75-host-var-lib-cni-multus\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.161092 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.159214    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b15e08c3-042f-4cee-b09a-ac696b3a8c75-hostroot\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.161092 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.159253    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b15e08c3-042f-4cee-b09a-ac696b3a8c75-host-run-multus-certs\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.161092 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.159284    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a331e3af-23b3-4dd4-a427-8b1a93f9441c-dbus\") pod \"global-pull-secret-syncer-2vpqw\" (UID: \"a331e3af-23b3-4dd4-a427-8b1a93f9441c\") " pod="kube-system/global-pull-secret-syncer-2vpqw"
Jul 29 14:35:30.161092 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.159318    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/19ba33a6-9b54-4130-a3e0-950186199417-serviceca\") pod \"node-ca-45d2s\" (UID: \"19ba33a6-9b54-4130-a3e0-950186199417\") " pod="openshift-image-registry/node-ca-45d2s"
Jul 29 14:35:30.161092 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.159347    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cc65f159-92b2-4ba1-ba56-9ebde361a37f-agent-certs\") pod \"konnectivity-agent-fhxsx\" (UID: \"cc65f159-92b2-4ba1-ba56-9ebde361a37f\") " pod="kube-system/konnectivity-agent-fhxsx"
Jul 29 14:35:30.161092 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.159370    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0e1522ce-4233-4d55-9c6c-0cd5d33306de-etc-openvswitch\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.161092 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.159398    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0e1522ce-4233-4d55-9c6c-0cd5d33306de-host-cni-netd\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.161092 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.159420    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/83bcb626-fb26-45b7-8196-ed63201905b8-sys-fs\") pod \"aws-ebs-csi-driver-node-fb6hf\" (UID: \"83bcb626-fb26-45b7-8196-ed63201905b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb6hf"
Jul 29 14:35:30.161092 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.159441    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2522b73f-2f30-4989-95e2-e580353f3476-var-lib-kubelet\") pod \"tuned-wcj2h\" (UID: \"2522b73f-2f30-4989-95e2-e580353f3476\") " pod="openshift-cluster-node-tuning-operator/tuned-wcj2h"
Jul 29 14:35:30.161092 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.159450    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0e1522ce-4233-4d55-9c6c-0cd5d33306de-etc-openvswitch\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.161092 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.159440    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/07bd3568-fdc0-4b2b-968f-16a9798a8837-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-snmxs\" (UID: \"07bd3568-fdc0-4b2b-968f-16a9798a8837\") " pod="openshift-multus/multus-additional-cni-plugins-snmxs"
Jul 29 14:35:30.161890 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.159470    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0e1522ce-4233-4d55-9c6c-0cd5d33306de-host-cni-netd\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.161890 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.159488    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/83bcb626-fb26-45b7-8196-ed63201905b8-sys-fs\") pod \"aws-ebs-csi-driver-node-fb6hf\" (UID: \"83bcb626-fb26-45b7-8196-ed63201905b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb6hf"
Jul 29 14:35:30.161890 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.159489    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2522b73f-2f30-4989-95e2-e580353f3476-var-lib-kubelet\") pod \"tuned-wcj2h\" (UID: \"2522b73f-2f30-4989-95e2-e580353f3476\") " pod="openshift-cluster-node-tuning-operator/tuned-wcj2h"
Jul 29 14:35:30.161890 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.159507    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2522b73f-2f30-4989-95e2-e580353f3476-host\") pod \"tuned-wcj2h\" (UID: \"2522b73f-2f30-4989-95e2-e580353f3476\") " pod="openshift-cluster-node-tuning-operator/tuned-wcj2h"
Jul 29 14:35:30.161890 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.159533    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c25d1eb-eae7-472d-ab72-96a1c5b1c27b-iptables-alerter-script\") pod \"iptables-alerter-5ssbl\" (UID: \"9c25d1eb-eae7-472d-ab72-96a1c5b1c27b\") " pod="openshift-network-operator/iptables-alerter-5ssbl"
Jul 29 14:35:30.161890 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.159585    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2522b73f-2f30-4989-95e2-e580353f3476-host\") pod \"tuned-wcj2h\" (UID: \"2522b73f-2f30-4989-95e2-e580353f3476\") " pod="openshift-cluster-node-tuning-operator/tuned-wcj2h"
Jul 29 14:35:30.161890 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.159615    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b15e08c3-042f-4cee-b09a-ac696b3a8c75-host-run-netns\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.161890 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.159641    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b15e08c3-042f-4cee-b09a-ac696b3a8c75-host-var-lib-cni-bin\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.161890 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.159665    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/83bcb626-fb26-45b7-8196-ed63201905b8-etc-selinux\") pod \"aws-ebs-csi-driver-node-fb6hf\" (UID: \"83bcb626-fb26-45b7-8196-ed63201905b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb6hf"
Jul 29 14:35:30.161890 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.159689    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0e1522ce-4233-4d55-9c6c-0cd5d33306de-log-socket\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.161890 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.159711    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0e1522ce-4233-4d55-9c6c-0cd5d33306de-ovnkube-config\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.161890 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.159742    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0e1522ce-4233-4d55-9c6c-0cd5d33306de-log-socket\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.161890 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.159760    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/83bcb626-fb26-45b7-8196-ed63201905b8-etc-selinux\") pod \"aws-ebs-csi-driver-node-fb6hf\" (UID: \"83bcb626-fb26-45b7-8196-ed63201905b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb6hf"
Jul 29 14:35:30.161890 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.159801    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0e1522ce-4233-4d55-9c6c-0cd5d33306de-ovnkube-script-lib\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.161890 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.159830    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwz44\" (UniqueName: \"kubernetes.io/projected/0e1522ce-4233-4d55-9c6c-0cd5d33306de-kube-api-access-jwz44\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.161890 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.159857    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a331e3af-23b3-4dd4-a427-8b1a93f9441c-kubelet-config\") pod \"global-pull-secret-syncer-2vpqw\" (UID: \"a331e3af-23b3-4dd4-a427-8b1a93f9441c\") " pod="kube-system/global-pull-secret-syncer-2vpqw"
Jul 29 14:35:30.161890 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.159884    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5zf2\" (UniqueName: \"kubernetes.io/projected/3d750720-77d3-457c-91d0-a8638d494329-kube-api-access-p5zf2\") pod \"network-metrics-daemon-6mrz9\" (UID: \"3d750720-77d3-457c-91d0-a8638d494329\") " pod="openshift-multus/network-metrics-daemon-6mrz9"
Jul 29 14:35:30.162752 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.159909    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0e1522ce-4233-4d55-9c6c-0cd5d33306de-node-log\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.162752 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.159933    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/83bcb626-fb26-45b7-8196-ed63201905b8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fb6hf\" (UID: \"83bcb626-fb26-45b7-8196-ed63201905b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb6hf"
Jul 29 14:35:30.162752 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.159955    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2522b73f-2f30-4989-95e2-e580353f3476-etc-sysconfig\") pod \"tuned-wcj2h\" (UID: \"2522b73f-2f30-4989-95e2-e580353f3476\") " pod="openshift-cluster-node-tuning-operator/tuned-wcj2h"
Jul 29 14:35:30.162752 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.160012    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c25d1eb-eae7-472d-ab72-96a1c5b1c27b-iptables-alerter-script\") pod \"iptables-alerter-5ssbl\" (UID: \"9c25d1eb-eae7-472d-ab72-96a1c5b1c27b\") " pod="openshift-network-operator/iptables-alerter-5ssbl"
Jul 29 14:35:30.162752 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.160030    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2522b73f-2f30-4989-95e2-e580353f3476-etc-sysconfig\") pod \"tuned-wcj2h\" (UID: \"2522b73f-2f30-4989-95e2-e580353f3476\") " pod="openshift-cluster-node-tuning-operator/tuned-wcj2h"
Jul 29 14:35:30.162752 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.160075    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0e1522ce-4233-4d55-9c6c-0cd5d33306de-node-log\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.162752 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.160076    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/83bcb626-fb26-45b7-8196-ed63201905b8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fb6hf\" (UID: \"83bcb626-fb26-45b7-8196-ed63201905b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb6hf"
Jul 29 14:35:30.162752 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.160191    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0e1522ce-4233-4d55-9c6c-0cd5d33306de-ovnkube-config\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.162752 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.160282    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0e1522ce-4233-4d55-9c6c-0cd5d33306de-ovnkube-script-lib\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.162752 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.161366    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2522b73f-2f30-4989-95e2-e580353f3476-etc-tuned\") pod \"tuned-wcj2h\" (UID: \"2522b73f-2f30-4989-95e2-e580353f3476\") " pod="openshift-cluster-node-tuning-operator/tuned-wcj2h"
Jul 29 14:35:30.162752 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.161613    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2522b73f-2f30-4989-95e2-e580353f3476-tmp\") pod \"tuned-wcj2h\" (UID: \"2522b73f-2f30-4989-95e2-e580353f3476\") " pod="openshift-cluster-node-tuning-operator/tuned-wcj2h"
Jul 29 14:35:30.163323 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.163092    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0e1522ce-4233-4d55-9c6c-0cd5d33306de-ovn-node-metrics-cert\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.166037 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.165495    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlvb2\" (UniqueName: \"kubernetes.io/projected/2522b73f-2f30-4989-95e2-e580353f3476-kube-api-access-dlvb2\") pod \"tuned-wcj2h\" (UID: \"2522b73f-2f30-4989-95e2-e580353f3476\") " pod="openshift-cluster-node-tuning-operator/tuned-wcj2h"
Jul 29 14:35:30.167300 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.167227    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vlzw\" (UniqueName: \"kubernetes.io/projected/7bd27b85-9683-41c2-a03a-acdb420a89e2-kube-api-access-5vlzw\") pod \"node-resolver-7x2lq\" (UID: \"7bd27b85-9683-41c2-a03a-acdb420a89e2\") " pod="openshift-dns/node-resolver-7x2lq"
Jul 29 14:35:30.167300 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.167251    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm7ph\" (UniqueName: \"kubernetes.io/projected/07bd3568-fdc0-4b2b-968f-16a9798a8837-kube-api-access-bm7ph\") pod \"multus-additional-cni-plugins-snmxs\" (UID: \"07bd3568-fdc0-4b2b-968f-16a9798a8837\") " pod="openshift-multus/multus-additional-cni-plugins-snmxs"
Jul 29 14:35:30.167429 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.167320    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hz7t\" (UniqueName: \"kubernetes.io/projected/83bcb626-fb26-45b7-8196-ed63201905b8-kube-api-access-8hz7t\") pod \"aws-ebs-csi-driver-node-fb6hf\" (UID: \"83bcb626-fb26-45b7-8196-ed63201905b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb6hf"
Jul 29 14:35:30.168185 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.168149    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwz44\" (UniqueName: \"kubernetes.io/projected/0e1522ce-4233-4d55-9c6c-0cd5d33306de-kube-api-access-jwz44\") pod \"ovnkube-node-988xj\" (UID: \"0e1522ce-4233-4d55-9c6c-0cd5d33306de\") " pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.169645 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.169626    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvh6c\" (UniqueName: \"kubernetes.io/projected/9c25d1eb-eae7-472d-ab72-96a1c5b1c27b-kube-api-access-bvh6c\") pod \"iptables-alerter-5ssbl\" (UID: \"9c25d1eb-eae7-472d-ab72-96a1c5b1c27b\") " pod="openshift-network-operator/iptables-alerter-5ssbl"
Jul 29 14:35:30.261061 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.261032    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b15e08c3-042f-4cee-b09a-ac696b3a8c75-host-run-k8s-cni-cncf-io\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.261214 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.261070    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a331e3af-23b3-4dd4-a427-8b1a93f9441c-original-pull-secret\") pod \"global-pull-secret-syncer-2vpqw\" (UID: \"a331e3af-23b3-4dd4-a427-8b1a93f9441c\") " pod="kube-system/global-pull-secret-syncer-2vpqw"
Jul 29 14:35:30.261214 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.261095    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d750720-77d3-457c-91d0-a8638d494329-metrics-certs\") pod \"network-metrics-daemon-6mrz9\" (UID: \"3d750720-77d3-457c-91d0-a8638d494329\") " pod="openshift-multus/network-metrics-daemon-6mrz9"
Jul 29 14:35:30.261214 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.261122    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b15e08c3-042f-4cee-b09a-ac696b3a8c75-etc-kubernetes\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.261214 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.261150    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b15e08c3-042f-4cee-b09a-ac696b3a8c75-cnibin\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.261214 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.261175    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b15e08c3-042f-4cee-b09a-ac696b3a8c75-cni-binary-copy\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.261214 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:30.261183    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 14:35:30.261214 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.261198    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b15e08c3-042f-4cee-b09a-ac696b3a8c75-system-cni-dir\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.261586 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.261220    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b15e08c3-042f-4cee-b09a-ac696b3a8c75-host-var-lib-cni-multus\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.261586 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:30.261274    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a331e3af-23b3-4dd4-a427-8b1a93f9441c-original-pull-secret podName:a331e3af-23b3-4dd4-a427-8b1a93f9441c nodeName:}" failed. No retries permitted until 2026-07-29 14:35:30.761227395 +0000 UTC m=+3.063693982 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a331e3af-23b3-4dd4-a427-8b1a93f9441c-original-pull-secret") pod "global-pull-secret-syncer-2vpqw" (UID: "a331e3af-23b3-4dd4-a427-8b1a93f9441c") : object "kube-system"/"original-pull-secret" not registered
Jul 29 14:35:30.261586 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.261291    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b15e08c3-042f-4cee-b09a-ac696b3a8c75-host-var-lib-cni-multus\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.261586 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.261306    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b15e08c3-042f-4cee-b09a-ac696b3a8c75-hostroot\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.261586 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.261332    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b15e08c3-042f-4cee-b09a-ac696b3a8c75-host-run-multus-certs\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.261586 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.261354    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a331e3af-23b3-4dd4-a427-8b1a93f9441c-dbus\") pod \"global-pull-secret-syncer-2vpqw\" (UID: \"a331e3af-23b3-4dd4-a427-8b1a93f9441c\") " pod="kube-system/global-pull-secret-syncer-2vpqw"
Jul 29 14:35:30.261586 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:30.261374    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 14:35:30.261586 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.261378    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/19ba33a6-9b54-4130-a3e0-950186199417-serviceca\") pod \"node-ca-45d2s\" (UID: \"19ba33a6-9b54-4130-a3e0-950186199417\") " pod="openshift-image-registry/node-ca-45d2s"
Jul 29 14:35:30.261586 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.261402    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cc65f159-92b2-4ba1-ba56-9ebde361a37f-agent-certs\") pod \"konnectivity-agent-fhxsx\" (UID: \"cc65f159-92b2-4ba1-ba56-9ebde361a37f\") " pod="kube-system/konnectivity-agent-fhxsx"
Jul 29 14:35:30.261586 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.261422    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b15e08c3-042f-4cee-b09a-ac696b3a8c75-cnibin\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.261586 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:30.261432    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d750720-77d3-457c-91d0-a8638d494329-metrics-certs podName:3d750720-77d3-457c-91d0-a8638d494329 nodeName:}" failed. No retries permitted until 2026-07-29 14:35:30.761400875 +0000 UTC m=+3.063867465 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d750720-77d3-457c-91d0-a8638d494329-metrics-certs") pod "network-metrics-daemon-6mrz9" (UID: "3d750720-77d3-457c-91d0-a8638d494329") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 14:35:30.261586 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.261095    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b15e08c3-042f-4cee-b09a-ac696b3a8c75-host-run-k8s-cni-cncf-io\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.261586 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.261495    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b15e08c3-042f-4cee-b09a-ac696b3a8c75-etc-kubernetes\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.261586 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.261537    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b15e08c3-042f-4cee-b09a-ac696b3a8c75-host-run-netns\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.261586 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.261561    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b15e08c3-042f-4cee-b09a-ac696b3a8c75-host-var-lib-cni-bin\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.261586 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.261590    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a331e3af-23b3-4dd4-a427-8b1a93f9441c-kubelet-config\") pod \"global-pull-secret-syncer-2vpqw\" (UID: \"a331e3af-23b3-4dd4-a427-8b1a93f9441c\") " pod="kube-system/global-pull-secret-syncer-2vpqw"
Jul 29 14:35:30.262315 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.261612    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b15e08c3-042f-4cee-b09a-ac696b3a8c75-host-run-netns\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.262315 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.261637    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a331e3af-23b3-4dd4-a427-8b1a93f9441c-kubelet-config\") pod \"global-pull-secret-syncer-2vpqw\" (UID: \"a331e3af-23b3-4dd4-a427-8b1a93f9441c\") " pod="kube-system/global-pull-secret-syncer-2vpqw"
Jul 29 14:35:30.262315 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.261634    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5zf2\" (UniqueName: \"kubernetes.io/projected/3d750720-77d3-457c-91d0-a8638d494329-kube-api-access-p5zf2\") pod \"network-metrics-daemon-6mrz9\" (UID: \"3d750720-77d3-457c-91d0-a8638d494329\") " pod="openshift-multus/network-metrics-daemon-6mrz9"
Jul 29 14:35:30.262315 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.261657    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b15e08c3-042f-4cee-b09a-ac696b3a8c75-system-cni-dir\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.262315 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.261659    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b15e08c3-042f-4cee-b09a-ac696b3a8c75-host-run-multus-certs\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.262315 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.261684    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b15e08c3-042f-4cee-b09a-ac696b3a8c75-host-var-lib-kubelet\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.262315 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.261703    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b15e08c3-042f-4cee-b09a-ac696b3a8c75-hostroot\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.262315 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.261708    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b15e08c3-042f-4cee-b09a-ac696b3a8c75-multus-conf-dir\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.262315 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.261732    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt7wp\" (UniqueName: \"kubernetes.io/projected/b15e08c3-042f-4cee-b09a-ac696b3a8c75-kube-api-access-zt7wp\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.262315 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.261765    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zsbw\" (UniqueName: \"kubernetes.io/projected/c03c2192-7d27-4033-9f74-f91ae62dc072-kube-api-access-9zsbw\") pod \"network-check-target-nct6x\" (UID: \"c03c2192-7d27-4033-9f74-f91ae62dc072\") " pod="openshift-network-diagnostics/network-check-target-nct6x"
Jul 29 14:35:30.262315 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.261793    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/19ba33a6-9b54-4130-a3e0-950186199417-host\") pod \"node-ca-45d2s\" (UID: \"19ba33a6-9b54-4130-a3e0-950186199417\") " pod="openshift-image-registry/node-ca-45d2s"
Jul 29 14:35:30.262315 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.261805    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b15e08c3-042f-4cee-b09a-ac696b3a8c75-host-var-lib-cni-bin\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.262315 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.261824    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cc65f159-92b2-4ba1-ba56-9ebde361a37f-konnectivity-ca\") pod \"konnectivity-agent-fhxsx\" (UID: \"cc65f159-92b2-4ba1-ba56-9ebde361a37f\") " pod="kube-system/konnectivity-agent-fhxsx"
Jul 29 14:35:30.262315 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.261852    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b15e08c3-042f-4cee-b09a-ac696b3a8c75-multus-socket-dir-parent\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.262315 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.261874    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b15e08c3-042f-4cee-b09a-ac696b3a8c75-multus-daemon-config\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.262315 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.261895    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg64f\" (UniqueName: \"kubernetes.io/projected/19ba33a6-9b54-4130-a3e0-950186199417-kube-api-access-kg64f\") pod \"node-ca-45d2s\" (UID: \"19ba33a6-9b54-4130-a3e0-950186199417\") " pod="openshift-image-registry/node-ca-45d2s"
Jul 29 14:35:30.262315 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.261919    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b15e08c3-042f-4cee-b09a-ac696b3a8c75-host-var-lib-kubelet\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.262315 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.261955    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b15e08c3-042f-4cee-b09a-ac696b3a8c75-multus-cni-dir\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.263101 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.261964    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a331e3af-23b3-4dd4-a427-8b1a93f9441c-dbus\") pod \"global-pull-secret-syncer-2vpqw\" (UID: \"a331e3af-23b3-4dd4-a427-8b1a93f9441c\") " pod="kube-system/global-pull-secret-syncer-2vpqw"
Jul 29 14:35:30.263101 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.261978    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b15e08c3-042f-4cee-b09a-ac696b3a8c75-os-release\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.263101 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.261967    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/19ba33a6-9b54-4130-a3e0-950186199417-host\") pod \"node-ca-45d2s\" (UID: \"19ba33a6-9b54-4130-a3e0-950186199417\") " pod="openshift-image-registry/node-ca-45d2s"
Jul 29 14:35:30.263101 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.262015    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b15e08c3-042f-4cee-b09a-ac696b3a8c75-multus-conf-dir\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.263101 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.262063    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b15e08c3-042f-4cee-b09a-ac696b3a8c75-multus-cni-dir\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.263101 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.262128    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/19ba33a6-9b54-4130-a3e0-950186199417-serviceca\") pod \"node-ca-45d2s\" (UID: \"19ba33a6-9b54-4130-a3e0-950186199417\") " pod="openshift-image-registry/node-ca-45d2s"
Jul 29 14:35:30.263101 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.262140    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b15e08c3-042f-4cee-b09a-ac696b3a8c75-os-release\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.263101 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.262199    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b15e08c3-042f-4cee-b09a-ac696b3a8c75-multus-socket-dir-parent\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.263101 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.262517    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cc65f159-92b2-4ba1-ba56-9ebde361a37f-konnectivity-ca\") pod \"konnectivity-agent-fhxsx\" (UID: \"cc65f159-92b2-4ba1-ba56-9ebde361a37f\") " pod="kube-system/konnectivity-agent-fhxsx"
Jul 29 14:35:30.263101 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.262817    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b15e08c3-042f-4cee-b09a-ac696b3a8c75-cni-binary-copy\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.263101 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.262843    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b15e08c3-042f-4cee-b09a-ac696b3a8c75-multus-daemon-config\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.263846 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.263826    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cc65f159-92b2-4ba1-ba56-9ebde361a37f-agent-certs\") pod \"konnectivity-agent-fhxsx\" (UID: \"cc65f159-92b2-4ba1-ba56-9ebde361a37f\") " pod="kube-system/konnectivity-agent-fhxsx"
Jul 29 14:35:30.272569 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.272217    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5zf2\" (UniqueName: \"kubernetes.io/projected/3d750720-77d3-457c-91d0-a8638d494329-kube-api-access-p5zf2\") pod \"network-metrics-daemon-6mrz9\" (UID: \"3d750720-77d3-457c-91d0-a8638d494329\") " pod="openshift-multus/network-metrics-daemon-6mrz9"
Jul 29 14:35:30.273394 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:30.273193    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 14:35:30.273394 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:30.273226    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 14:35:30.273394 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:30.273257    2578 projected.go:196] Error preparing data for projected volume kube-api-access-9zsbw for pod openshift-network-diagnostics/network-check-target-nct6x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 14:35:30.273394 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:30.273355    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c03c2192-7d27-4033-9f74-f91ae62dc072-kube-api-access-9zsbw podName:c03c2192-7d27-4033-9f74-f91ae62dc072 nodeName:}" failed. No retries permitted until 2026-07-29 14:35:30.773335186 +0000 UTC m=+3.075801788 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9zsbw" (UniqueName: "kubernetes.io/projected/c03c2192-7d27-4033-9f74-f91ae62dc072-kube-api-access-9zsbw") pod "network-check-target-nct6x" (UID: "c03c2192-7d27-4033-9f74-f91ae62dc072") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 14:35:30.275560 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.275497    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt7wp\" (UniqueName: \"kubernetes.io/projected/b15e08c3-042f-4cee-b09a-ac696b3a8c75-kube-api-access-zt7wp\") pod \"multus-xzx26\" (UID: \"b15e08c3-042f-4cee-b09a-ac696b3a8c75\") " pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.275655 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.275617    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg64f\" (UniqueName: \"kubernetes.io/projected/19ba33a6-9b54-4130-a3e0-950186199417-kube-api-access-kg64f\") pod \"node-ca-45d2s\" (UID: \"19ba33a6-9b54-4130-a3e0-950186199417\") " pod="openshift-image-registry/node-ca-45d2s"
Jul 29 14:35:30.277877 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.277834    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-130.ec2.internal" event={"ID":"038bed7cc4edb557ac94333e7b84bbab","Type":"ContainerStarted","Data":"01bd023cd853ca0db54e337368c66c120d8e9b1b74f1b1dacff5865448267bda"}
Jul 29 14:35:30.279023 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.278995    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-130.ec2.internal" event={"ID":"694b68de4c8fb4483f79ff80c8121d75","Type":"ContainerStarted","Data":"01a245d989d47147cc036a06f5f9b1b7ec091eed7bc59dafe6e365860f1b70e7"}
Jul 29 14:35:30.351440 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.351414    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-snmxs"
Jul 29 14:35:30.359151 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.359132    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 14:35:30.359272 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.359229    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5ssbl"
Jul 29 14:35:30.368006 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.367989    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:30.373677 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.373659    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb6hf"
Jul 29 14:35:30.381268 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.381252    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wcj2h"
Jul 29 14:35:30.389729 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.389710    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7x2lq"
Jul 29 14:35:30.396165 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.396148    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-45d2s"
Jul 29 14:35:30.402612 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.402597    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xzx26"
Jul 29 14:35:30.409197 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.409178    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fhxsx"
Jul 29 14:35:30.765932 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.765855    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a331e3af-23b3-4dd4-a427-8b1a93f9441c-original-pull-secret\") pod \"global-pull-secret-syncer-2vpqw\" (UID: \"a331e3af-23b3-4dd4-a427-8b1a93f9441c\") " pod="kube-system/global-pull-secret-syncer-2vpqw"
Jul 29 14:35:30.765932 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.765902    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d750720-77d3-457c-91d0-a8638d494329-metrics-certs\") pod \"network-metrics-daemon-6mrz9\" (UID: \"3d750720-77d3-457c-91d0-a8638d494329\") " pod="openshift-multus/network-metrics-daemon-6mrz9"
Jul 29 14:35:30.766150 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:30.766016    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 14:35:30.766150 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:30.766041    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 14:35:30.766150 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:30.766090    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a331e3af-23b3-4dd4-a427-8b1a93f9441c-original-pull-secret podName:a331e3af-23b3-4dd4-a427-8b1a93f9441c nodeName:}" failed. No retries permitted until 2026-07-29 14:35:31.766068919 +0000 UTC m=+4.068535513 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a331e3af-23b3-4dd4-a427-8b1a93f9441c-original-pull-secret") pod "global-pull-secret-syncer-2vpqw" (UID: "a331e3af-23b3-4dd4-a427-8b1a93f9441c") : object "kube-system"/"original-pull-secret" not registered
Jul 29 14:35:30.766150 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:30.766108    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d750720-77d3-457c-91d0-a8638d494329-metrics-certs podName:3d750720-77d3-457c-91d0-a8638d494329 nodeName:}" failed. No retries permitted until 2026-07-29 14:35:31.766100419 +0000 UTC m=+4.068567004 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d750720-77d3-457c-91d0-a8638d494329-metrics-certs") pod "network-metrics-daemon-6mrz9" (UID: "3d750720-77d3-457c-91d0-a8638d494329") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 14:35:30.866536 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:30.866502    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zsbw\" (UniqueName: \"kubernetes.io/projected/c03c2192-7d27-4033-9f74-f91ae62dc072-kube-api-access-9zsbw\") pod \"network-check-target-nct6x\" (UID: \"c03c2192-7d27-4033-9f74-f91ae62dc072\") " pod="openshift-network-diagnostics/network-check-target-nct6x"
Jul 29 14:35:30.866676 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:30.866657    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 14:35:30.866728 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:30.866686    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 14:35:30.866728 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:30.866698    2578 projected.go:196] Error preparing data for projected volume kube-api-access-9zsbw for pod openshift-network-diagnostics/network-check-target-nct6x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 14:35:30.866795 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:30.866757    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c03c2192-7d27-4033-9f74-f91ae62dc072-kube-api-access-9zsbw podName:c03c2192-7d27-4033-9f74-f91ae62dc072 nodeName:}" failed. No retries permitted until 2026-07-29 14:35:31.866738303 +0000 UTC m=+4.169204902 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9zsbw" (UniqueName: "kubernetes.io/projected/c03c2192-7d27-4033-9f74-f91ae62dc072-kube-api-access-9zsbw") pod "network-check-target-nct6x" (UID: "c03c2192-7d27-4033-9f74-f91ae62dc072") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 14:35:31.087460 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:31.087319    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 14:30:30 +0000 UTC" deadline="2028-04-05 14:44:26.700361638 +0000 UTC"
Jul 29 14:35:31.087460 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:31.087410    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14784h8m55.612958075s"
Jul 29 14:35:31.187096 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:31.187054    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19ba33a6_9b54_4130_a3e0_950186199417.slice/crio-f49de98a54597991c33925d4a07d3b1fd1c58b2f60a0f52640238316b4ee4282 WatchSource:0}: Error finding container f49de98a54597991c33925d4a07d3b1fd1c58b2f60a0f52640238316b4ee4282: Status 404 returned error can't find the container with id f49de98a54597991c33925d4a07d3b1fd1c58b2f60a0f52640238316b4ee4282
Jul 29 14:35:31.189288 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:31.189261    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb15e08c3_042f_4cee_b09a_ac696b3a8c75.slice/crio-d4214ebcf93d63a60df4e5ff833f3464775ef79a0f2ebb5cdd464a2aad25cfc0 WatchSource:0}: Error finding container d4214ebcf93d63a60df4e5ff833f3464775ef79a0f2ebb5cdd464a2aad25cfc0: Status 404 returned error can't find the container with id d4214ebcf93d63a60df4e5ff833f3464775ef79a0f2ebb5cdd464a2aad25cfc0
Jul 29 14:35:31.195025 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:31.194945    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc65f159_92b2_4ba1_ba56_9ebde361a37f.slice/crio-be4c288723a3ca5e81afb44d70fff748dc1f80ef4c38867c95fc0d51dcf56c64 WatchSource:0}: Error finding container be4c288723a3ca5e81afb44d70fff748dc1f80ef4c38867c95fc0d51dcf56c64: Status 404 returned error can't find the container with id be4c288723a3ca5e81afb44d70fff748dc1f80ef4c38867c95fc0d51dcf56c64
Jul 29 14:35:31.196650 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:31.196629    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2522b73f_2f30_4989_95e2_e580353f3476.slice/crio-182c751e21664a526f3b1500ac2b8d4f52d4694254a500112a95c9084b8822fc WatchSource:0}: Error finding container 182c751e21664a526f3b1500ac2b8d4f52d4694254a500112a95c9084b8822fc: Status 404 returned error can't find the container with id 182c751e21664a526f3b1500ac2b8d4f52d4694254a500112a95c9084b8822fc
Jul 29 14:35:31.198214 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:31.198192    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bd27b85_9683_41c2_a03a_acdb420a89e2.slice/crio-164be78359f93d9931176af54b79cbe7a3eed96b0d1f8d8d7002cb48946f3e1c WatchSource:0}: Error finding container 164be78359f93d9931176af54b79cbe7a3eed96b0d1f8d8d7002cb48946f3e1c: Status 404 returned error can't find the container with id 164be78359f93d9931176af54b79cbe7a3eed96b0d1f8d8d7002cb48946f3e1c
Jul 29 14:35:31.198755 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:31.198735    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c25d1eb_eae7_472d_ab72_96a1c5b1c27b.slice/crio-1f744e281af9b373930c3f87f850f888b88401b16cff1620d9d54252ce57324f WatchSource:0}: Error finding container 1f744e281af9b373930c3f87f850f888b88401b16cff1620d9d54252ce57324f: Status 404 returned error can't find the container with id 1f744e281af9b373930c3f87f850f888b88401b16cff1620d9d54252ce57324f
Jul 29 14:35:31.199667 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:31.199641    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e1522ce_4233_4d55_9c6c_0cd5d33306de.slice/crio-67c3d66ef64dc42235af2b5826e3d2772ec6440377e38e968d57dfe6fd461821 WatchSource:0}: Error finding container 67c3d66ef64dc42235af2b5826e3d2772ec6440377e38e968d57dfe6fd461821: Status 404 returned error can't find the container with id 67c3d66ef64dc42235af2b5826e3d2772ec6440377e38e968d57dfe6fd461821
Jul 29 14:35:31.201651 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:31.201437    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07bd3568_fdc0_4b2b_968f_16a9798a8837.slice/crio-1287d5307a8991fd2d31b55f5be49d4686ec973742e71cf695c9ad21043ca48e WatchSource:0}: Error finding container 1287d5307a8991fd2d31b55f5be49d4686ec973742e71cf695c9ad21043ca48e: Status 404 returned error can't find the container with id 1287d5307a8991fd2d31b55f5be49d4686ec973742e71cf695c9ad21043ca48e
Jul 29 14:35:31.202231 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:35:31.202129    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83bcb626_fb26_45b7_8196_ed63201905b8.slice/crio-23055d81db12ac0faec5b1830aa0eb1e8e86ced85a0b7a4d0c9acda8d4a18dc0 WatchSource:0}: Error finding container 23055d81db12ac0faec5b1830aa0eb1e8e86ced85a0b7a4d0c9acda8d4a18dc0: Status 404 returned error can't find the container with id 23055d81db12ac0faec5b1830aa0eb1e8e86ced85a0b7a4d0c9acda8d4a18dc0
Jul 29 14:35:31.272815 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:31.272791    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nct6x"
Jul 29 14:35:31.272911 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:31.272894    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nct6x" podUID="c03c2192-7d27-4033-9f74-f91ae62dc072"
Jul 29 14:35:31.272960 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:31.272926    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6mrz9"
Jul 29 14:35:31.273011 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:31.272995    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6mrz9" podUID="3d750720-77d3-457c-91d0-a8638d494329"
Jul 29 14:35:31.286614 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:31.286592    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb6hf" event={"ID":"83bcb626-fb26-45b7-8196-ed63201905b8","Type":"ContainerStarted","Data":"23055d81db12ac0faec5b1830aa0eb1e8e86ced85a0b7a4d0c9acda8d4a18dc0"}
Jul 29 14:35:31.287766 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:31.287745    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-snmxs" event={"ID":"07bd3568-fdc0-4b2b-968f-16a9798a8837","Type":"ContainerStarted","Data":"1287d5307a8991fd2d31b55f5be49d4686ec973742e71cf695c9ad21043ca48e"}
Jul 29 14:35:31.289612 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:31.289590    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-988xj" event={"ID":"0e1522ce-4233-4d55-9c6c-0cd5d33306de","Type":"ContainerStarted","Data":"67c3d66ef64dc42235af2b5826e3d2772ec6440377e38e968d57dfe6fd461821"}
Jul 29 14:35:31.291519 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:31.291497    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5ssbl" event={"ID":"9c25d1eb-eae7-472d-ab72-96a1c5b1c27b","Type":"ContainerStarted","Data":"1f744e281af9b373930c3f87f850f888b88401b16cff1620d9d54252ce57324f"}
Jul 29 14:35:31.293320 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:31.293299    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7x2lq" event={"ID":"7bd27b85-9683-41c2-a03a-acdb420a89e2","Type":"ContainerStarted","Data":"164be78359f93d9931176af54b79cbe7a3eed96b0d1f8d8d7002cb48946f3e1c"}
Jul 29 14:35:31.294219 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:31.294197    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wcj2h" event={"ID":"2522b73f-2f30-4989-95e2-e580353f3476","Type":"ContainerStarted","Data":"182c751e21664a526f3b1500ac2b8d4f52d4694254a500112a95c9084b8822fc"}
Jul 29 14:35:31.295188 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:31.295171    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xzx26" event={"ID":"b15e08c3-042f-4cee-b09a-ac696b3a8c75","Type":"ContainerStarted","Data":"d4214ebcf93d63a60df4e5ff833f3464775ef79a0f2ebb5cdd464a2aad25cfc0"}
Jul 29 14:35:31.297019 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:31.296996    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-130.ec2.internal" event={"ID":"038bed7cc4edb557ac94333e7b84bbab","Type":"ContainerStarted","Data":"7f2699763d28e11863276067d53cf3e7a00674130fca52cc34e1662b74cd098f"}
Jul 29 14:35:31.298036 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:31.298011    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fhxsx" event={"ID":"cc65f159-92b2-4ba1-ba56-9ebde361a37f","Type":"ContainerStarted","Data":"be4c288723a3ca5e81afb44d70fff748dc1f80ef4c38867c95fc0d51dcf56c64"}
Jul 29 14:35:31.298907 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:31.298888    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-45d2s" event={"ID":"19ba33a6-9b54-4130-a3e0-950186199417","Type":"ContainerStarted","Data":"f49de98a54597991c33925d4a07d3b1fd1c58b2f60a0f52640238316b4ee4282"}
Jul 29 14:35:31.311507 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:31.311328    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-130.ec2.internal" podStartSLOduration=2.311316719 podStartE2EDuration="2.311316719s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 14:35:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 14:35:31.310823275 +0000 UTC m=+3.613289881" watchObservedRunningTime="2026-07-29 14:35:31.311316719 +0000 UTC m=+3.613783329"
Jul 29 14:35:31.772094 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:31.772006    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a331e3af-23b3-4dd4-a427-8b1a93f9441c-original-pull-secret\") pod \"global-pull-secret-syncer-2vpqw\" (UID: \"a331e3af-23b3-4dd4-a427-8b1a93f9441c\") " pod="kube-system/global-pull-secret-syncer-2vpqw"
Jul 29 14:35:31.772094 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:31.772056    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d750720-77d3-457c-91d0-a8638d494329-metrics-certs\") pod \"network-metrics-daemon-6mrz9\" (UID: \"3d750720-77d3-457c-91d0-a8638d494329\") " pod="openshift-multus/network-metrics-daemon-6mrz9"
Jul 29 14:35:31.772333 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:31.772185    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 14:35:31.772333 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:31.772260    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d750720-77d3-457c-91d0-a8638d494329-metrics-certs podName:3d750720-77d3-457c-91d0-a8638d494329 nodeName:}" failed. No retries permitted until 2026-07-29 14:35:33.77222596 +0000 UTC m=+6.074692557 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d750720-77d3-457c-91d0-a8638d494329-metrics-certs") pod "network-metrics-daemon-6mrz9" (UID: "3d750720-77d3-457c-91d0-a8638d494329") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 14:35:31.772672 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:31.772656    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 14:35:31.772736 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:31.772707    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a331e3af-23b3-4dd4-a427-8b1a93f9441c-original-pull-secret podName:a331e3af-23b3-4dd4-a427-8b1a93f9441c nodeName:}" failed. No retries permitted until 2026-07-29 14:35:33.772693018 +0000 UTC m=+6.075159606 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a331e3af-23b3-4dd4-a427-8b1a93f9441c-original-pull-secret") pod "global-pull-secret-syncer-2vpqw" (UID: "a331e3af-23b3-4dd4-a427-8b1a93f9441c") : object "kube-system"/"original-pull-secret" not registered
Jul 29 14:35:31.873730 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:31.873081    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zsbw\" (UniqueName: \"kubernetes.io/projected/c03c2192-7d27-4033-9f74-f91ae62dc072-kube-api-access-9zsbw\") pod \"network-check-target-nct6x\" (UID: \"c03c2192-7d27-4033-9f74-f91ae62dc072\") " pod="openshift-network-diagnostics/network-check-target-nct6x"
Jul 29 14:35:31.873730 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:31.873287    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 14:35:31.873730 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:31.873311    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 14:35:31.873730 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:31.873324    2578 projected.go:196] Error preparing data for projected volume kube-api-access-9zsbw for pod openshift-network-diagnostics/network-check-target-nct6x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 14:35:31.873730 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:31.873374    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c03c2192-7d27-4033-9f74-f91ae62dc072-kube-api-access-9zsbw podName:c03c2192-7d27-4033-9f74-f91ae62dc072 nodeName:}" failed. No retries permitted until 2026-07-29 14:35:33.873358237 +0000 UTC m=+6.175824827 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9zsbw" (UniqueName: "kubernetes.io/projected/c03c2192-7d27-4033-9f74-f91ae62dc072-kube-api-access-9zsbw") pod "network-check-target-nct6x" (UID: "c03c2192-7d27-4033-9f74-f91ae62dc072") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 14:35:32.087859 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:32.087755    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 14:30:30 +0000 UTC" deadline="2028-02-25 14:11:30.645554661 +0000 UTC"
Jul 29 14:35:32.087859 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:32.087812    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13823h35m58.557747079s"
Jul 29 14:35:32.275163 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:32.274702    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vpqw"
Jul 29 14:35:32.275163 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:32.274824    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vpqw" podUID="a331e3af-23b3-4dd4-a427-8b1a93f9441c"
Jul 29 14:35:32.306954 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:32.306921    2578 generic.go:356] "Generic (PLEG): container finished" podID="694b68de4c8fb4483f79ff80c8121d75" containerID="cb6390d9e7bdaadfd684ef3a5cf34b2d4cac3f64a957f17cbd822e80960a2d7b" exitCode=0
Jul 29 14:35:32.308129 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:32.307886    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-130.ec2.internal" event={"ID":"694b68de4c8fb4483f79ff80c8121d75","Type":"ContainerDied","Data":"cb6390d9e7bdaadfd684ef3a5cf34b2d4cac3f64a957f17cbd822e80960a2d7b"}
Jul 29 14:35:33.272770 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:33.272041    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nct6x"
Jul 29 14:35:33.272770 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:33.272159    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nct6x" podUID="c03c2192-7d27-4033-9f74-f91ae62dc072"
Jul 29 14:35:33.272770 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:33.272611    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6mrz9"
Jul 29 14:35:33.272770 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:33.272713    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6mrz9" podUID="3d750720-77d3-457c-91d0-a8638d494329"
Jul 29 14:35:33.324555 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:33.324495    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-130.ec2.internal" event={"ID":"694b68de4c8fb4483f79ff80c8121d75","Type":"ContainerStarted","Data":"32ce3f65c44834f54753fb1c1db49c17a9fdbd77b66e58a2c0c72ccfe880a698"}
Jul 29 14:35:33.374908 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:33.374855    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-130.ec2.internal" podStartSLOduration=4.374835865 podStartE2EDuration="4.374835865s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 14:35:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 14:35:33.37400625 +0000 UTC m=+5.676472859" watchObservedRunningTime="2026-07-29 14:35:33.374835865 +0000 UTC m=+5.677302474"
Jul 29 14:35:33.789450 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:33.789398    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a331e3af-23b3-4dd4-a427-8b1a93f9441c-original-pull-secret\") pod \"global-pull-secret-syncer-2vpqw\" (UID: \"a331e3af-23b3-4dd4-a427-8b1a93f9441c\") " pod="kube-system/global-pull-secret-syncer-2vpqw"
Jul 29 14:35:33.789450 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:33.789441    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d750720-77d3-457c-91d0-a8638d494329-metrics-certs\") pod \"network-metrics-daemon-6mrz9\" (UID: \"3d750720-77d3-457c-91d0-a8638d494329\") " pod="openshift-multus/network-metrics-daemon-6mrz9"
Jul 29 14:35:33.789682 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:33.789561    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 14:35:33.789682 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:33.789615    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d750720-77d3-457c-91d0-a8638d494329-metrics-certs podName:3d750720-77d3-457c-91d0-a8638d494329 nodeName:}" failed. No retries permitted until 2026-07-29 14:35:37.789596364 +0000 UTC m=+10.092062956 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d750720-77d3-457c-91d0-a8638d494329-metrics-certs") pod "network-metrics-daemon-6mrz9" (UID: "3d750720-77d3-457c-91d0-a8638d494329") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 14:35:33.791003 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:33.789970    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 14:35:33.791003 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:33.790013    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a331e3af-23b3-4dd4-a427-8b1a93f9441c-original-pull-secret podName:a331e3af-23b3-4dd4-a427-8b1a93f9441c nodeName:}" failed. No retries permitted until 2026-07-29 14:35:37.790000094 +0000 UTC m=+10.092466684 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a331e3af-23b3-4dd4-a427-8b1a93f9441c-original-pull-secret") pod "global-pull-secret-syncer-2vpqw" (UID: "a331e3af-23b3-4dd4-a427-8b1a93f9441c") : object "kube-system"/"original-pull-secret" not registered
Jul 29 14:35:33.890373 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:33.890342    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zsbw\" (UniqueName: \"kubernetes.io/projected/c03c2192-7d27-4033-9f74-f91ae62dc072-kube-api-access-9zsbw\") pod \"network-check-target-nct6x\" (UID: \"c03c2192-7d27-4033-9f74-f91ae62dc072\") " pod="openshift-network-diagnostics/network-check-target-nct6x"
Jul 29 14:35:33.890535 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:33.890521    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 14:35:33.890601 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:33.890545    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 14:35:33.890601 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:33.890556    2578 projected.go:196] Error preparing data for projected volume kube-api-access-9zsbw for pod openshift-network-diagnostics/network-check-target-nct6x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 14:35:33.890707 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:33.890606    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c03c2192-7d27-4033-9f74-f91ae62dc072-kube-api-access-9zsbw podName:c03c2192-7d27-4033-9f74-f91ae62dc072 nodeName:}" failed. No retries permitted until 2026-07-29 14:35:37.890588327 +0000 UTC m=+10.193054927 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9zsbw" (UniqueName: "kubernetes.io/projected/c03c2192-7d27-4033-9f74-f91ae62dc072-kube-api-access-9zsbw") pod "network-check-target-nct6x" (UID: "c03c2192-7d27-4033-9f74-f91ae62dc072") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 14:35:34.273476 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:34.273399    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vpqw"
Jul 29 14:35:34.273893 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:34.273534    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vpqw" podUID="a331e3af-23b3-4dd4-a427-8b1a93f9441c"
Jul 29 14:35:35.272723 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:35.272692    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nct6x"
Jul 29 14:35:35.272893 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:35.272725    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6mrz9"
Jul 29 14:35:35.272893 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:35.272815    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nct6x" podUID="c03c2192-7d27-4033-9f74-f91ae62dc072"
Jul 29 14:35:35.273301 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:35.273273    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6mrz9" podUID="3d750720-77d3-457c-91d0-a8638d494329"
Jul 29 14:35:36.272834 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:36.272805    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vpqw"
Jul 29 14:35:36.273223 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:36.272932    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vpqw" podUID="a331e3af-23b3-4dd4-a427-8b1a93f9441c"
Jul 29 14:35:37.272686 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:37.272382    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nct6x"
Jul 29 14:35:37.272686 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:37.272398    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6mrz9"
Jul 29 14:35:37.272686 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:37.272509    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nct6x" podUID="c03c2192-7d27-4033-9f74-f91ae62dc072"
Jul 29 14:35:37.273312 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:37.272736    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6mrz9" podUID="3d750720-77d3-457c-91d0-a8638d494329"
Jul 29 14:35:37.821703 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:37.821667    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a331e3af-23b3-4dd4-a427-8b1a93f9441c-original-pull-secret\") pod \"global-pull-secret-syncer-2vpqw\" (UID: \"a331e3af-23b3-4dd4-a427-8b1a93f9441c\") " pod="kube-system/global-pull-secret-syncer-2vpqw"
Jul 29 14:35:37.821878 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:37.821718    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d750720-77d3-457c-91d0-a8638d494329-metrics-certs\") pod \"network-metrics-daemon-6mrz9\" (UID: \"3d750720-77d3-457c-91d0-a8638d494329\") " pod="openshift-multus/network-metrics-daemon-6mrz9"
Jul 29 14:35:37.821878 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:37.821842    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 14:35:37.821991 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:37.821900    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d750720-77d3-457c-91d0-a8638d494329-metrics-certs podName:3d750720-77d3-457c-91d0-a8638d494329 nodeName:}" failed. No retries permitted until 2026-07-29 14:35:45.821881255 +0000 UTC m=+18.124347847 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d750720-77d3-457c-91d0-a8638d494329-metrics-certs") pod "network-metrics-daemon-6mrz9" (UID: "3d750720-77d3-457c-91d0-a8638d494329") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 14:35:37.822307 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:37.822289    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 14:35:37.822399 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:37.822338    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a331e3af-23b3-4dd4-a427-8b1a93f9441c-original-pull-secret podName:a331e3af-23b3-4dd4-a427-8b1a93f9441c nodeName:}" failed. No retries permitted until 2026-07-29 14:35:45.82232461 +0000 UTC m=+18.124791197 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a331e3af-23b3-4dd4-a427-8b1a93f9441c-original-pull-secret") pod "global-pull-secret-syncer-2vpqw" (UID: "a331e3af-23b3-4dd4-a427-8b1a93f9441c") : object "kube-system"/"original-pull-secret" not registered
Jul 29 14:35:37.922570 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:37.922537    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zsbw\" (UniqueName: \"kubernetes.io/projected/c03c2192-7d27-4033-9f74-f91ae62dc072-kube-api-access-9zsbw\") pod \"network-check-target-nct6x\" (UID: \"c03c2192-7d27-4033-9f74-f91ae62dc072\") " pod="openshift-network-diagnostics/network-check-target-nct6x"
Jul 29 14:35:37.922752 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:37.922735    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 14:35:37.922844 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:37.922768    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 14:35:37.922844 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:37.922781    2578 projected.go:196] Error preparing data for projected volume kube-api-access-9zsbw for pod openshift-network-diagnostics/network-check-target-nct6x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 14:35:37.922844 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:37.922835    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c03c2192-7d27-4033-9f74-f91ae62dc072-kube-api-access-9zsbw podName:c03c2192-7d27-4033-9f74-f91ae62dc072 nodeName:}" failed. No retries permitted until 2026-07-29 14:35:45.922819423 +0000 UTC m=+18.225286018 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9zsbw" (UniqueName: "kubernetes.io/projected/c03c2192-7d27-4033-9f74-f91ae62dc072-kube-api-access-9zsbw") pod "network-check-target-nct6x" (UID: "c03c2192-7d27-4033-9f74-f91ae62dc072") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 14:35:38.274075 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:38.274001    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vpqw"
Jul 29 14:35:38.274523 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:38.274104    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vpqw" podUID="a331e3af-23b3-4dd4-a427-8b1a93f9441c"
Jul 29 14:35:39.272123 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:39.272091    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nct6x"
Jul 29 14:35:39.272311 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:39.272214    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nct6x" podUID="c03c2192-7d27-4033-9f74-f91ae62dc072"
Jul 29 14:35:39.272311 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:39.272254    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6mrz9"
Jul 29 14:35:39.272437 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:39.272359    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6mrz9" podUID="3d750720-77d3-457c-91d0-a8638d494329"
Jul 29 14:35:40.272532 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:40.272498    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vpqw"
Jul 29 14:35:40.272964 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:40.272633    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vpqw" podUID="a331e3af-23b3-4dd4-a427-8b1a93f9441c"
Jul 29 14:35:41.272508 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:41.272480    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nct6x"
Jul 29 14:35:41.272648 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:41.272480    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6mrz9"
Jul 29 14:35:41.272648 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:41.272571    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nct6x" podUID="c03c2192-7d27-4033-9f74-f91ae62dc072"
Jul 29 14:35:41.272905 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:41.272653    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6mrz9" podUID="3d750720-77d3-457c-91d0-a8638d494329"
Jul 29 14:35:42.272627 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:42.272590    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vpqw"
Jul 29 14:35:42.272811 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:42.272726    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vpqw" podUID="a331e3af-23b3-4dd4-a427-8b1a93f9441c"
Jul 29 14:35:43.272583 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:43.272543    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nct6x"
Jul 29 14:35:43.272583 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:43.272564    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6mrz9"
Jul 29 14:35:43.272798 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:43.272662    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nct6x" podUID="c03c2192-7d27-4033-9f74-f91ae62dc072"
Jul 29 14:35:43.272798 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:43.272765    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6mrz9" podUID="3d750720-77d3-457c-91d0-a8638d494329"
Jul 29 14:35:44.272917 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:44.272889    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vpqw"
Jul 29 14:35:44.273352 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:44.273008    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vpqw" podUID="a331e3af-23b3-4dd4-a427-8b1a93f9441c"
Jul 29 14:35:45.272283 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:45.272255    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6mrz9"
Jul 29 14:35:45.272485 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:45.272319    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nct6x"
Jul 29 14:35:45.272485 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:45.272361    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6mrz9" podUID="3d750720-77d3-457c-91d0-a8638d494329"
Jul 29 14:35:45.272485 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:45.272393    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nct6x" podUID="c03c2192-7d27-4033-9f74-f91ae62dc072"
Jul 29 14:35:45.887031 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:45.887001    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a331e3af-23b3-4dd4-a427-8b1a93f9441c-original-pull-secret\") pod \"global-pull-secret-syncer-2vpqw\" (UID: \"a331e3af-23b3-4dd4-a427-8b1a93f9441c\") " pod="kube-system/global-pull-secret-syncer-2vpqw"
Jul 29 14:35:45.887466 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:45.887041    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d750720-77d3-457c-91d0-a8638d494329-metrics-certs\") pod \"network-metrics-daemon-6mrz9\" (UID: \"3d750720-77d3-457c-91d0-a8638d494329\") " pod="openshift-multus/network-metrics-daemon-6mrz9"
Jul 29 14:35:45.887466 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:45.887121    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 14:35:45.887466 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:45.887195    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a331e3af-23b3-4dd4-a427-8b1a93f9441c-original-pull-secret podName:a331e3af-23b3-4dd4-a427-8b1a93f9441c nodeName:}" failed. No retries permitted until 2026-07-29 14:36:01.887177292 +0000 UTC m=+34.189643881 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a331e3af-23b3-4dd4-a427-8b1a93f9441c-original-pull-secret") pod "global-pull-secret-syncer-2vpqw" (UID: "a331e3af-23b3-4dd4-a427-8b1a93f9441c") : object "kube-system"/"original-pull-secret" not registered
Jul 29 14:35:45.887466 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:45.887200    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 14:35:45.887466 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:45.887266    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d750720-77d3-457c-91d0-a8638d494329-metrics-certs podName:3d750720-77d3-457c-91d0-a8638d494329 nodeName:}" failed. No retries permitted until 2026-07-29 14:36:01.887249018 +0000 UTC m=+34.189715611 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d750720-77d3-457c-91d0-a8638d494329-metrics-certs") pod "network-metrics-daemon-6mrz9" (UID: "3d750720-77d3-457c-91d0-a8638d494329") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 14:35:45.988391 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:45.988363    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zsbw\" (UniqueName: \"kubernetes.io/projected/c03c2192-7d27-4033-9f74-f91ae62dc072-kube-api-access-9zsbw\") pod \"network-check-target-nct6x\" (UID: \"c03c2192-7d27-4033-9f74-f91ae62dc072\") " pod="openshift-network-diagnostics/network-check-target-nct6x"
Jul 29 14:35:45.988550 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:45.988530    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 14:35:45.988608 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:45.988553    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 14:35:45.988608 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:45.988566    2578 projected.go:196] Error preparing data for projected volume kube-api-access-9zsbw for pod openshift-network-diagnostics/network-check-target-nct6x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 14:35:45.988700 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:45.988622    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c03c2192-7d27-4033-9f74-f91ae62dc072-kube-api-access-9zsbw podName:c03c2192-7d27-4033-9f74-f91ae62dc072 nodeName:}" failed. No retries permitted until 2026-07-29 14:36:01.988604539 +0000 UTC m=+34.291071137 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9zsbw" (UniqueName: "kubernetes.io/projected/c03c2192-7d27-4033-9f74-f91ae62dc072-kube-api-access-9zsbw") pod "network-check-target-nct6x" (UID: "c03c2192-7d27-4033-9f74-f91ae62dc072") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 14:35:46.272565 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:46.272532    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vpqw"
Jul 29 14:35:46.272740 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:46.272668    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vpqw" podUID="a331e3af-23b3-4dd4-a427-8b1a93f9441c"
Jul 29 14:35:47.272778 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:47.272743    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nct6x"
Jul 29 14:35:47.273259 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:47.272752    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6mrz9"
Jul 29 14:35:47.273259 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:47.272850    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nct6x" podUID="c03c2192-7d27-4033-9f74-f91ae62dc072"
Jul 29 14:35:47.273259 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:47.272959    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6mrz9" podUID="3d750720-77d3-457c-91d0-a8638d494329"
Jul 29 14:35:48.273218 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:48.273182    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vpqw"
Jul 29 14:35:48.273671 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:48.273319    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vpqw" podUID="a331e3af-23b3-4dd4-a427-8b1a93f9441c"
Jul 29 14:35:49.273353 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:49.272595    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nct6x"
Jul 29 14:35:49.273353 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:49.272715    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nct6x" podUID="c03c2192-7d27-4033-9f74-f91ae62dc072"
Jul 29 14:35:49.273353 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:49.273085    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6mrz9"
Jul 29 14:35:49.273353 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:49.273192    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6mrz9" podUID="3d750720-77d3-457c-91d0-a8638d494329"
Jul 29 14:35:49.363015 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:49.362822    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb6hf" event={"ID":"83bcb626-fb26-45b7-8196-ed63201905b8","Type":"ContainerStarted","Data":"a7a601dce68eb273042a9eed8cb1431909e9ce94db90186aefeae74dc433db67"}
Jul 29 14:35:49.366592 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:49.366467    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wcj2h" event={"ID":"2522b73f-2f30-4989-95e2-e580353f3476","Type":"ContainerStarted","Data":"fbb83a2642075d2456865960129a0e3ba83407bc5b37aac0b30b3ab06b72c5d5"}
Jul 29 14:35:49.372189 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:49.371786    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fhxsx" event={"ID":"cc65f159-92b2-4ba1-ba56-9ebde361a37f","Type":"ContainerStarted","Data":"1e40a97cb2d6496893066ed84553fc10b9eb9f8ec7ce6f779f5b3214e6d0f6ab"}
Jul 29 14:35:49.386212 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:49.386169    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wcj2h" podStartSLOduration=3.412084459 podStartE2EDuration="21.386154015s" totalImagesPullingTime="17.974069556s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 14:35:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 14:35:49.385660711 +0000 UTC m=+21.688127319" watchObservedRunningTime="2026-07-29 14:35:49.386154015 +0000 UTC m=+21.688620621"
Jul 29 14:35:49.425193 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:49.425008    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-45d2s" podStartSLOduration=3.441283872 podStartE2EDuration="21.424988059s" totalImagesPullingTime="17.983704187s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 14:35:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 14:35:49.402792543 +0000 UTC m=+21.705259151" watchObservedRunningTime="2026-07-29 14:35:49.424988059 +0000 UTC m=+21.727454683"
Jul 29 14:35:49.425531 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:49.425502    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fhxsx" podStartSLOduration=3.449039875 podStartE2EDuration="21.425492152s" totalImagesPullingTime="17.976452277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 14:35:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 14:35:49.425071425 +0000 UTC m=+21.727538027" watchObservedRunningTime="2026-07-29 14:35:49.425492152 +0000 UTC m=+21.727958758"
Jul 29 14:35:49.448919 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:49.448757    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xzx26" podStartSLOduration=3.408098587 podStartE2EDuration="21.448742582s" totalImagesPullingTime="18.040643995s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 14:35:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 14:35:49.448403368 +0000 UTC m=+21.750869974" watchObservedRunningTime="2026-07-29 14:35:49.448742582 +0000 UTC m=+21.751209208"
Jul 29 14:35:50.272670 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:50.272640    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vpqw"
Jul 29 14:35:50.272816 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:50.272734    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vpqw" podUID="a331e3af-23b3-4dd4-a427-8b1a93f9441c"
Jul 29 14:35:50.377906 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:50.377878    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xzx26" event={"ID":"b15e08c3-042f-4cee-b09a-ac696b3a8c75","Type":"ContainerStarted","Data":"c5d652eaff1c90dc7772504c52658c39b8d015270547349fd18cb63d74854633"}
Jul 29 14:35:50.379441 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:50.379410    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-45d2s" event={"ID":"19ba33a6-9b54-4130-a3e0-950186199417","Type":"ContainerStarted","Data":"521c919984e9953c4998029c161255fae3bd61a10c3a6529c3277d5c8368a765"}
Jul 29 14:35:50.380906 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:50.380878    2578 generic.go:356] "Generic (PLEG): container finished" podID="07bd3568-fdc0-4b2b-968f-16a9798a8837" containerID="b6fcbe8266c55f0d934fed9b638448efd0ca1a41e4a801208edf5f15a0eb499c" exitCode=0
Jul 29 14:35:50.380985 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:50.380958    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-snmxs" event={"ID":"07bd3568-fdc0-4b2b-968f-16a9798a8837","Type":"ContainerDied","Data":"b6fcbe8266c55f0d934fed9b638448efd0ca1a41e4a801208edf5f15a0eb499c"}
Jul 29 14:35:50.384392 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:50.384365    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-988xj" event={"ID":"0e1522ce-4233-4d55-9c6c-0cd5d33306de","Type":"ContainerStarted","Data":"14e87f9a305f2871528bca3955c90ca2c40a5fffbc6f3f0ac2d1551faaa07a19"}
Jul 29 14:35:50.384494 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:50.384442    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-988xj" event={"ID":"0e1522ce-4233-4d55-9c6c-0cd5d33306de","Type":"ContainerStarted","Data":"2aa13457917319242b01b85b8d54c7c4ecfa1f57c5c372b6e920eb6ab1a07f31"}
Jul 29 14:35:50.384494 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:50.384485    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-988xj" event={"ID":"0e1522ce-4233-4d55-9c6c-0cd5d33306de","Type":"ContainerStarted","Data":"e528a098e160567e31ab2d9c3531bdf5e50aa0fdd0630bfeac94dd7788ed9ec6"}
Jul 29 14:35:50.384603 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:50.384526    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-988xj" event={"ID":"0e1522ce-4233-4d55-9c6c-0cd5d33306de","Type":"ContainerStarted","Data":"f8dc48687e2c59c2666f971f19e1e796c0c218f714de115fd7ef0817d7f9ef48"}
Jul 29 14:35:50.384603 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:50.384570    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-988xj" event={"ID":"0e1522ce-4233-4d55-9c6c-0cd5d33306de","Type":"ContainerStarted","Data":"80a3c7b2f200fa6a204385d64d56c93cdb7e341dbbadfd4b0501885b4452a6e6"}
Jul 29 14:35:50.384687 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:50.384612    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-988xj" event={"ID":"0e1522ce-4233-4d55-9c6c-0cd5d33306de","Type":"ContainerStarted","Data":"82a3de74a09e7514e015826935b3936741d161bf99e2e4449e026576faf8452e"}
Jul 29 14:35:50.385863 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:50.385827    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5ssbl" event={"ID":"9c25d1eb-eae7-472d-ab72-96a1c5b1c27b","Type":"ContainerStarted","Data":"6411392be16d86f9717480d993006c9fe3991268d28957dbadb4fab34c6726a3"}
Jul 29 14:35:50.387150 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:50.387132    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7x2lq" event={"ID":"7bd27b85-9683-41c2-a03a-acdb420a89e2","Type":"ContainerStarted","Data":"37a9bb2b6f6aa85fbe944833564cda5cc700839d7013570c5ca1a6b1ea24fbde"}
Jul 29 14:35:50.429475 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:50.429437    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7x2lq" podStartSLOduration=4.447652744 podStartE2EDuration="22.429425634s" totalImagesPullingTime="17.98177289s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 14:35:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 14:35:50.429068603 +0000 UTC m=+22.731535210" watchObservedRunningTime="2026-07-29 14:35:50.429425634 +0000 UTC m=+22.731892240"
Jul 29 14:35:50.437220 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:50.437201    2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 29 14:35:51.117323 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:51.117202    2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T14:35:50.437217698Z","UUID":"5285fa58-c871-4282-8d3c-5ebf0271863f","Handler":null,"Name":"","Endpoint":""}
Jul 29 14:35:51.119305 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:51.119282    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 29 14:35:51.119450 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:51.119329    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 29 14:35:51.272449 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:51.272419    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6mrz9"
Jul 29 14:35:51.272621 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:51.272420    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nct6x"
Jul 29 14:35:51.272621 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:51.272560    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6mrz9" podUID="3d750720-77d3-457c-91d0-a8638d494329"
Jul 29 14:35:51.272750 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:51.272692    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nct6x" podUID="c03c2192-7d27-4033-9f74-f91ae62dc072"
Jul 29 14:35:51.391872 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:51.391792    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb6hf" event={"ID":"83bcb626-fb26-45b7-8196-ed63201905b8","Type":"ContainerStarted","Data":"6a68a8c7ccd84cf69bf50450ebe95ac1c2932e4efdd314492edfead206a5ef54"}
Jul 29 14:35:51.943992 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:51.943967    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fhxsx"
Jul 29 14:35:51.944684 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:51.944662    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fhxsx"
Jul 29 14:35:51.947537 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:51.947512    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fhxsx"
Jul 29 14:35:51.948059 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:51.948027    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fhxsx"
Jul 29 14:35:51.960283 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:51.960215    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5ssbl" podStartSLOduration=5.983607216 podStartE2EDuration="23.960199773s" totalImagesPullingTime="17.976592557s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 14:35:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 14:35:50.446697687 +0000 UTC m=+22.749164295" watchObservedRunningTime="2026-07-29 14:35:51.960199773 +0000 UTC m=+24.262666380"
Jul 29 14:35:52.272195 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:52.272169    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vpqw"
Jul 29 14:35:52.272355 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:52.272337    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vpqw" podUID="a331e3af-23b3-4dd4-a427-8b1a93f9441c"
Jul 29 14:35:52.397954 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:52.397920    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb6hf" event={"ID":"83bcb626-fb26-45b7-8196-ed63201905b8","Type":"ContainerStarted","Data":"7fd4e42be5769a2226016420d189c38ebe2f9b6351d917d5c801036a71fe565c"}
Jul 29 14:35:52.401985 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:52.401957    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-988xj" event={"ID":"0e1522ce-4233-4d55-9c6c-0cd5d33306de","Type":"ContainerStarted","Data":"1d91c49f9d97a890fb2daabcd47e7548cbe46cb59c1e3dfb66de31a0a73bd754"}
Jul 29 14:35:52.417363 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:52.417319    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb6hf" podStartSLOduration=4.293926193 podStartE2EDuration="24.417306698s" totalImagesPullingTime="20.123380505s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 14:35:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 14:35:52.417171137 +0000 UTC m=+24.719637750" watchObservedRunningTime="2026-07-29 14:35:52.417306698 +0000 UTC m=+24.719773295"
Jul 29 14:35:53.272497 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:53.272254    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nct6x"
Jul 29 14:35:53.272766 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:53.272304    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6mrz9"
Jul 29 14:35:53.272766 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:53.272600    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nct6x" podUID="c03c2192-7d27-4033-9f74-f91ae62dc072"
Jul 29 14:35:53.272766 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:53.272688    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6mrz9" podUID="3d750720-77d3-457c-91d0-a8638d494329"
Jul 29 14:35:54.272296 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:54.272266    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vpqw"
Jul 29 14:35:54.272703 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:54.272406    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vpqw" podUID="a331e3af-23b3-4dd4-a427-8b1a93f9441c"
Jul 29 14:35:55.272473 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:55.272301    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6mrz9"
Jul 29 14:35:55.273077 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:55.272302    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nct6x"
Jul 29 14:35:55.273077 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:55.272543    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6mrz9" podUID="3d750720-77d3-457c-91d0-a8638d494329"
Jul 29 14:35:55.273077 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:55.272628    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nct6x" podUID="c03c2192-7d27-4033-9f74-f91ae62dc072"
Jul 29 14:35:55.408815 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:55.408786    2578 generic.go:356] "Generic (PLEG): container finished" podID="07bd3568-fdc0-4b2b-968f-16a9798a8837" containerID="81158fef8cf4bff672a67cbc18c9b8ebfa888a6a057d11eb301ca6265327a4ab" exitCode=0
Jul 29 14:35:55.408981 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:55.408852    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-snmxs" event={"ID":"07bd3568-fdc0-4b2b-968f-16a9798a8837","Type":"ContainerDied","Data":"81158fef8cf4bff672a67cbc18c9b8ebfa888a6a057d11eb301ca6265327a4ab"}
Jul 29 14:35:55.412462 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:55.412433    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-988xj" event={"ID":"0e1522ce-4233-4d55-9c6c-0cd5d33306de","Type":"ContainerStarted","Data":"521d2b676a3c8e894fce9cc9fff0520dc3b1c3e921fa706618a7734184dc7c92"}
Jul 29 14:35:55.412764 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:55.412745    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:55.412832 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:55.412810    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:55.427760 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:55.427742    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:55.454833 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:55.454797    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-988xj" podStartSLOduration=9.425552247 podStartE2EDuration="27.454785216s" totalImagesPullingTime="18.029232969s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 14:35:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 14:35:55.45447336 +0000 UTC m=+27.756939969" watchObservedRunningTime="2026-07-29 14:35:55.454785216 +0000 UTC m=+27.757251823"
Jul 29 14:35:56.272827 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:56.272797    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vpqw"
Jul 29 14:35:56.273209 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:56.272899    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vpqw" podUID="a331e3af-23b3-4dd4-a427-8b1a93f9441c"
Jul 29 14:35:56.414947 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:56.414889    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:56.428840 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:56.428818    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:35:57.272968 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:57.272944    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nct6x"
Jul 29 14:35:57.273280 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:57.272950    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6mrz9"
Jul 29 14:35:57.273280 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:57.273023    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nct6x" podUID="c03c2192-7d27-4033-9f74-f91ae62dc072"
Jul 29 14:35:57.273280 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:57.273110    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6mrz9" podUID="3d750720-77d3-457c-91d0-a8638d494329"
Jul 29 14:35:57.418498 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:57.418476    2578 generic.go:356] "Generic (PLEG): container finished" podID="07bd3568-fdc0-4b2b-968f-16a9798a8837" containerID="a670b708c7d2599f4357ccee66cecfd91a158c2334385a640bff3652f7cf2a51" exitCode=0
Jul 29 14:35:57.418618 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:57.418569    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-snmxs" event={"ID":"07bd3568-fdc0-4b2b-968f-16a9798a8837","Type":"ContainerDied","Data":"a670b708c7d2599f4357ccee66cecfd91a158c2334385a640bff3652f7cf2a51"}
Jul 29 14:35:58.273369 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:58.273340    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vpqw"
Jul 29 14:35:58.273734 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:58.273419    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vpqw" podUID="a331e3af-23b3-4dd4-a427-8b1a93f9441c"
Jul 29 14:35:59.272321 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:59.272293    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6mrz9"
Jul 29 14:35:59.272454 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:59.272293    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nct6x"
Jul 29 14:35:59.272454 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:59.272389    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6mrz9" podUID="3d750720-77d3-457c-91d0-a8638d494329"
Jul 29 14:35:59.272532 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:35:59.272457    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nct6x" podUID="c03c2192-7d27-4033-9f74-f91ae62dc072"
Jul 29 14:35:59.425832 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:59.425804    2578 generic.go:356] "Generic (PLEG): container finished" podID="07bd3568-fdc0-4b2b-968f-16a9798a8837" containerID="06850919bc49718030fe4753b09bc6a3e88ccc86ee0a6a8afae3656bddad61de" exitCode=0
Jul 29 14:35:59.426184 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:35:59.425855    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-snmxs" event={"ID":"07bd3568-fdc0-4b2b-968f-16a9798a8837","Type":"ContainerDied","Data":"06850919bc49718030fe4753b09bc6a3e88ccc86ee0a6a8afae3656bddad61de"}
Jul 29 14:36:00.272254 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:00.272219    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vpqw"
Jul 29 14:36:00.272418 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:36:00.272336    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vpqw" podUID="a331e3af-23b3-4dd4-a427-8b1a93f9441c"
Jul 29 14:36:01.272363 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:01.272331    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6mrz9"
Jul 29 14:36:01.272767 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:01.272331    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nct6x"
Jul 29 14:36:01.272767 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:36:01.272444    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6mrz9" podUID="3d750720-77d3-457c-91d0-a8638d494329"
Jul 29 14:36:01.272767 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:36:01.272492    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nct6x" podUID="c03c2192-7d27-4033-9f74-f91ae62dc072"
Jul 29 14:36:01.901433 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:01.901395    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a331e3af-23b3-4dd4-a427-8b1a93f9441c-original-pull-secret\") pod \"global-pull-secret-syncer-2vpqw\" (UID: \"a331e3af-23b3-4dd4-a427-8b1a93f9441c\") " pod="kube-system/global-pull-secret-syncer-2vpqw"
Jul 29 14:36:01.901433 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:01.901441    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d750720-77d3-457c-91d0-a8638d494329-metrics-certs\") pod \"network-metrics-daemon-6mrz9\" (UID: \"3d750720-77d3-457c-91d0-a8638d494329\") " pod="openshift-multus/network-metrics-daemon-6mrz9"
Jul 29 14:36:01.901683 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:36:01.901545    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 14:36:01.901683 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:36:01.901605    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d750720-77d3-457c-91d0-a8638d494329-metrics-certs podName:3d750720-77d3-457c-91d0-a8638d494329 nodeName:}" failed. No retries permitted until 2026-07-29 14:36:33.901587809 +0000 UTC m=+66.204054404 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d750720-77d3-457c-91d0-a8638d494329-metrics-certs") pod "network-metrics-daemon-6mrz9" (UID: "3d750720-77d3-457c-91d0-a8638d494329") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 14:36:01.901683 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:36:01.901545    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 14:36:01.901817 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:36:01.901711    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a331e3af-23b3-4dd4-a427-8b1a93f9441c-original-pull-secret podName:a331e3af-23b3-4dd4-a427-8b1a93f9441c nodeName:}" failed. No retries permitted until 2026-07-29 14:36:33.901685626 +0000 UTC m=+66.204152229 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a331e3af-23b3-4dd4-a427-8b1a93f9441c-original-pull-secret") pod "global-pull-secret-syncer-2vpqw" (UID: "a331e3af-23b3-4dd4-a427-8b1a93f9441c") : object "kube-system"/"original-pull-secret" not registered
Jul 29 14:36:02.001791 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:02.001757    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zsbw\" (UniqueName: \"kubernetes.io/projected/c03c2192-7d27-4033-9f74-f91ae62dc072-kube-api-access-9zsbw\") pod \"network-check-target-nct6x\" (UID: \"c03c2192-7d27-4033-9f74-f91ae62dc072\") " pod="openshift-network-diagnostics/network-check-target-nct6x"
Jul 29 14:36:02.001950 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:36:02.001886    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 14:36:02.001950 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:36:02.001902    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 14:36:02.001950 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:36:02.001910    2578 projected.go:196] Error preparing data for projected volume kube-api-access-9zsbw for pod openshift-network-diagnostics/network-check-target-nct6x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 14:36:02.002079 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:36:02.001957    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c03c2192-7d27-4033-9f74-f91ae62dc072-kube-api-access-9zsbw podName:c03c2192-7d27-4033-9f74-f91ae62dc072 nodeName:}" failed. No retries permitted until 2026-07-29 14:36:34.001943146 +0000 UTC m=+66.304409731 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9zsbw" (UniqueName: "kubernetes.io/projected/c03c2192-7d27-4033-9f74-f91ae62dc072-kube-api-access-9zsbw") pod "network-check-target-nct6x" (UID: "c03c2192-7d27-4033-9f74-f91ae62dc072") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 14:36:02.272511 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:02.272481    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vpqw"
Jul 29 14:36:02.272957 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:36:02.272604    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vpqw" podUID="a331e3af-23b3-4dd4-a427-8b1a93f9441c"
Jul 29 14:36:03.272337 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:03.272312    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6mrz9"
Jul 29 14:36:03.272439 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:03.272312    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nct6x"
Jul 29 14:36:03.272439 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:36:03.272423    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6mrz9" podUID="3d750720-77d3-457c-91d0-a8638d494329"
Jul 29 14:36:03.272559 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:36:03.272509    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nct6x" podUID="c03c2192-7d27-4033-9f74-f91ae62dc072"
Jul 29 14:36:03.439859 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:03.439830    2578 generic.go:356] "Generic (PLEG): container finished" podID="07bd3568-fdc0-4b2b-968f-16a9798a8837" containerID="aaa908357d12b4a15d1a272a7b33f8194aa7aea386b14f8ad2781f2fadcc6580" exitCode=0
Jul 29 14:36:03.439953 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:03.439876    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-snmxs" event={"ID":"07bd3568-fdc0-4b2b-968f-16a9798a8837","Type":"ContainerDied","Data":"aaa908357d12b4a15d1a272a7b33f8194aa7aea386b14f8ad2781f2fadcc6580"}
Jul 29 14:36:04.272158 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:04.272131    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vpqw"
Jul 29 14:36:04.272330 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:36:04.272223    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vpqw" podUID="a331e3af-23b3-4dd4-a427-8b1a93f9441c"
Jul 29 14:36:04.445016 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:04.444985    2578 generic.go:356] "Generic (PLEG): container finished" podID="07bd3568-fdc0-4b2b-968f-16a9798a8837" containerID="4f9e781bde97cf83e8c3e129df69c537684285d5d6f29c8ae2349aea5cffcaef" exitCode=0
Jul 29 14:36:04.445342 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:04.445030    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-snmxs" event={"ID":"07bd3568-fdc0-4b2b-968f-16a9798a8837","Type":"ContainerDied","Data":"4f9e781bde97cf83e8c3e129df69c537684285d5d6f29c8ae2349aea5cffcaef"}
Jul 29 14:36:05.272824 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:05.272793    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nct6x"
Jul 29 14:36:05.272982 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:05.272793    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6mrz9"
Jul 29 14:36:05.272982 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:36:05.272889    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nct6x" podUID="c03c2192-7d27-4033-9f74-f91ae62dc072"
Jul 29 14:36:05.272982 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:36:05.272972    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6mrz9" podUID="3d750720-77d3-457c-91d0-a8638d494329"
Jul 29 14:36:05.449580 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:05.449548    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-snmxs" event={"ID":"07bd3568-fdc0-4b2b-968f-16a9798a8837","Type":"ContainerStarted","Data":"5ff589c374964095fa2b99b61c40e7568dfdcac1d15030526619f24d895f8482"}
Jul 29 14:36:05.473422 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:05.473382    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-snmxs" podStartSLOduration=9.141224216 podStartE2EDuration="37.473364725s" totalImagesPullingTime="28.332140509s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 14:35:28 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 14:36:05.473359972 +0000 UTC m=+37.775826579" watchObservedRunningTime="2026-07-29 14:36:05.473364725 +0000 UTC m=+37.775831327"
Jul 29 14:36:06.272974 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:06.272945    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vpqw"
Jul 29 14:36:06.273153 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:36:06.273056    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vpqw" podUID="a331e3af-23b3-4dd4-a427-8b1a93f9441c"
Jul 29 14:36:07.272871 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:07.272844    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6mrz9"
Jul 29 14:36:07.273215 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:36:07.272939    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6mrz9" podUID="3d750720-77d3-457c-91d0-a8638d494329"
Jul 29 14:36:07.273215 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:07.272994    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nct6x"
Jul 29 14:36:07.273215 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:36:07.273076    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nct6x" podUID="c03c2192-7d27-4033-9f74-f91ae62dc072"
Jul 29 14:36:08.273560 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:08.273526    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vpqw"
Jul 29 14:36:08.273994 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:36:08.273609    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vpqw" podUID="a331e3af-23b3-4dd4-a427-8b1a93f9441c"
Jul 29 14:36:09.273094 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:09.272941    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6mrz9"
Jul 29 14:36:09.273253 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:09.272984    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nct6x"
Jul 29 14:36:09.273253 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:36:09.273172    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6mrz9" podUID="3d750720-77d3-457c-91d0-a8638d494329"
Jul 29 14:36:09.273332 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:36:09.273253    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nct6x" podUID="c03c2192-7d27-4033-9f74-f91ae62dc072"
Jul 29 14:36:09.860014 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:09.859856    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2vpqw"]
Jul 29 14:36:09.860014 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:09.859991    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vpqw"
Jul 29 14:36:09.860601 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:36:09.860089    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vpqw" podUID="a331e3af-23b3-4dd4-a427-8b1a93f9441c"
Jul 29 14:36:09.863337 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:09.863307    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nct6x"]
Jul 29 14:36:09.863465 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:09.863455    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nct6x"
Jul 29 14:36:09.863607 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:36:09.863584    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nct6x" podUID="c03c2192-7d27-4033-9f74-f91ae62dc072"
Jul 29 14:36:09.864084 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:09.864060    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6mrz9"]
Jul 29 14:36:09.864177 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:09.864152    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6mrz9"
Jul 29 14:36:09.864302 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:36:09.864282    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6mrz9" podUID="3d750720-77d3-457c-91d0-a8638d494329"
Jul 29 14:36:11.272737 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:11.272710    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nct6x"
Jul 29 14:36:11.273232 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:36:11.272815    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nct6x" podUID="c03c2192-7d27-4033-9f74-f91ae62dc072"
Jul 29 14:36:11.273232 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:11.272888    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vpqw"
Jul 29 14:36:11.273232 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:36:11.272967    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vpqw" podUID="a331e3af-23b3-4dd4-a427-8b1a93f9441c"
Jul 29 14:36:12.272073 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:12.272049    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6mrz9"
Jul 29 14:36:12.272273 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:36:12.272145    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6mrz9" podUID="3d750720-77d3-457c-91d0-a8638d494329"
Jul 29 14:36:13.272564 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:13.272540    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vpqw"
Jul 29 14:36:13.272920 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:13.272538    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nct6x"
Jul 29 14:36:13.272920 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:36:13.272635    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2vpqw" podUID="a331e3af-23b3-4dd4-a427-8b1a93f9441c"
Jul 29 14:36:13.272920 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:36:13.272714    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nct6x" podUID="c03c2192-7d27-4033-9f74-f91ae62dc072"
Jul 29 14:36:14.065216 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.065190    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-130.ec2.internal" event="NodeReady"
Jul 29 14:36:14.065366 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.065293    2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 29 14:36:14.113037 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.113016    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-f6wgr"]
Jul 29 14:36:14.133307 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.133286    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pxbfb"]
Jul 29 14:36:14.133447 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.133431    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f6wgr"
Jul 29 14:36:14.137848 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.137827    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 29 14:36:14.137938 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.137887    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 29 14:36:14.137938 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.137921    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pp4lb\""
Jul 29 14:36:14.151188 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.151171    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f6wgr"]
Jul 29 14:36:14.151283 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.151200    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pxbfb"]
Jul 29 14:36:14.151283 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.151220    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-v7v42"]
Jul 29 14:36:14.151351 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.151302    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pxbfb"
Jul 29 14:36:14.154652 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.154632    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 29 14:36:14.154748 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.154650    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zhf56\""
Jul 29 14:36:14.154748 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.154664    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 29 14:36:14.154748 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.154632    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 29 14:36:14.154901 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.154746    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 29 14:36:14.165268 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.165231    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v7v42"]
Jul 29 14:36:14.165339 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.165308    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v7v42"
Jul 29 14:36:14.167826 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.167807    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 29 14:36:14.167936 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.167921    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 29 14:36:14.168021 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.168006    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 29 14:36:14.168067 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.168035    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fb2k5\""
Jul 29 14:36:14.272487 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.272464    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6mrz9"
Jul 29 14:36:14.275358 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.275340    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 14:36:14.275736 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.275340    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nzccd\""
Jul 29 14:36:14.288652 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.288634    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/87cfbdb3-8e14-4362-9ff8-a85011328e5c-config-volume\") pod \"dns-default-f6wgr\" (UID: \"87cfbdb3-8e14-4362-9ff8-a85011328e5c\") " pod="openshift-dns/dns-default-f6wgr"
Jul 29 14:36:14.288735 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.288662    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/87cfbdb3-8e14-4362-9ff8-a85011328e5c-metrics-tls\") pod \"dns-default-f6wgr\" (UID: \"87cfbdb3-8e14-4362-9ff8-a85011328e5c\") " pod="openshift-dns/dns-default-f6wgr"
Jul 29 14:36:14.288735 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.288679    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3d7da1fa-df00-472a-8eeb-71bd340d3e0c-data-volume\") pod \"insights-runtime-extractor-pxbfb\" (UID: \"3d7da1fa-df00-472a-8eeb-71bd340d3e0c\") " pod="openshift-insights/insights-runtime-extractor-pxbfb"
Jul 29 14:36:14.288735 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.288694    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d7da1fa-df00-472a-8eeb-71bd340d3e0c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pxbfb\" (UID: \"3d7da1fa-df00-472a-8eeb-71bd340d3e0c\") " pod="openshift-insights/insights-runtime-extractor-pxbfb"
Jul 29 14:36:14.288860 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.288780    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87cfbdb3-8e14-4362-9ff8-a85011328e5c-tmp-dir\") pod \"dns-default-f6wgr\" (UID: \"87cfbdb3-8e14-4362-9ff8-a85011328e5c\") " pod="openshift-dns/dns-default-f6wgr"
Jul 29 14:36:14.288860 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.288827    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8d5cdf58-6ba5-4f67-b365-f6bf6e641880-cert\") pod \"ingress-canary-v7v42\" (UID: \"8d5cdf58-6ba5-4f67-b365-f6bf6e641880\") " pod="openshift-ingress-canary/ingress-canary-v7v42"
Jul 29 14:36:14.288860 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.288856    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr96s\" (UniqueName: \"kubernetes.io/projected/8d5cdf58-6ba5-4f67-b365-f6bf6e641880-kube-api-access-jr96s\") pod \"ingress-canary-v7v42\" (UID: \"8d5cdf58-6ba5-4f67-b365-f6bf6e641880\") " pod="openshift-ingress-canary/ingress-canary-v7v42"
Jul 29 14:36:14.288948 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.288899    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xg2xl\" (UniqueName: \"kubernetes.io/projected/3d7da1fa-df00-472a-8eeb-71bd340d3e0c-kube-api-access-xg2xl\") pod \"insights-runtime-extractor-pxbfb\" (UID: \"3d7da1fa-df00-472a-8eeb-71bd340d3e0c\") " pod="openshift-insights/insights-runtime-extractor-pxbfb"
Jul 29 14:36:14.288948 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.288924    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3d7da1fa-df00-472a-8eeb-71bd340d3e0c-crio-socket\") pod \"insights-runtime-extractor-pxbfb\" (UID: \"3d7da1fa-df00-472a-8eeb-71bd340d3e0c\") " pod="openshift-insights/insights-runtime-extractor-pxbfb"
Jul 29 14:36:14.288948 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.288941    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d2kb\" (UniqueName: \"kubernetes.io/projected/87cfbdb3-8e14-4362-9ff8-a85011328e5c-kube-api-access-8d2kb\") pod \"dns-default-f6wgr\" (UID: \"87cfbdb3-8e14-4362-9ff8-a85011328e5c\") " pod="openshift-dns/dns-default-f6wgr"
Jul 29 14:36:14.289031 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.288955    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d7da1fa-df00-472a-8eeb-71bd340d3e0c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pxbfb\" (UID: \"3d7da1fa-df00-472a-8eeb-71bd340d3e0c\") " pod="openshift-insights/insights-runtime-extractor-pxbfb"
Jul 29 14:36:14.389414 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.389366    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr96s\" (UniqueName: \"kubernetes.io/projected/8d5cdf58-6ba5-4f67-b365-f6bf6e641880-kube-api-access-jr96s\") pod \"ingress-canary-v7v42\" (UID: \"8d5cdf58-6ba5-4f67-b365-f6bf6e641880\") " pod="openshift-ingress-canary/ingress-canary-v7v42"
Jul 29 14:36:14.389414 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.389409    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xg2xl\" (UniqueName: \"kubernetes.io/projected/3d7da1fa-df00-472a-8eeb-71bd340d3e0c-kube-api-access-xg2xl\") pod \"insights-runtime-extractor-pxbfb\" (UID: \"3d7da1fa-df00-472a-8eeb-71bd340d3e0c\") " pod="openshift-insights/insights-runtime-extractor-pxbfb"
Jul 29 14:36:14.389535 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.389435    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3d7da1fa-df00-472a-8eeb-71bd340d3e0c-crio-socket\") pod \"insights-runtime-extractor-pxbfb\" (UID: \"3d7da1fa-df00-472a-8eeb-71bd340d3e0c\") " pod="openshift-insights/insights-runtime-extractor-pxbfb"
Jul 29 14:36:14.389535 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.389457    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d2kb\" (UniqueName: \"kubernetes.io/projected/87cfbdb3-8e14-4362-9ff8-a85011328e5c-kube-api-access-8d2kb\") pod \"dns-default-f6wgr\" (UID: \"87cfbdb3-8e14-4362-9ff8-a85011328e5c\") " pod="openshift-dns/dns-default-f6wgr"
Jul 29 14:36:14.389535 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.389479    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d7da1fa-df00-472a-8eeb-71bd340d3e0c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pxbfb\" (UID: \"3d7da1fa-df00-472a-8eeb-71bd340d3e0c\") " pod="openshift-insights/insights-runtime-extractor-pxbfb"
Jul 29 14:36:14.389535 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.389511    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/87cfbdb3-8e14-4362-9ff8-a85011328e5c-config-volume\") pod \"dns-default-f6wgr\" (UID: \"87cfbdb3-8e14-4362-9ff8-a85011328e5c\") " pod="openshift-dns/dns-default-f6wgr"
Jul 29 14:36:14.389724 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.389702    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/87cfbdb3-8e14-4362-9ff8-a85011328e5c-metrics-tls\") pod \"dns-default-f6wgr\" (UID: \"87cfbdb3-8e14-4362-9ff8-a85011328e5c\") " pod="openshift-dns/dns-default-f6wgr"
Jul 29 14:36:14.389778 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.389726    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3d7da1fa-df00-472a-8eeb-71bd340d3e0c-crio-socket\") pod \"insights-runtime-extractor-pxbfb\" (UID: \"3d7da1fa-df00-472a-8eeb-71bd340d3e0c\") " pod="openshift-insights/insights-runtime-extractor-pxbfb"
Jul 29 14:36:14.389778 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.389751    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3d7da1fa-df00-472a-8eeb-71bd340d3e0c-data-volume\") pod \"insights-runtime-extractor-pxbfb\" (UID: \"3d7da1fa-df00-472a-8eeb-71bd340d3e0c\") " pod="openshift-insights/insights-runtime-extractor-pxbfb"
Jul 29 14:36:14.389878 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.389779    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d7da1fa-df00-472a-8eeb-71bd340d3e0c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pxbfb\" (UID: \"3d7da1fa-df00-472a-8eeb-71bd340d3e0c\") " pod="openshift-insights/insights-runtime-extractor-pxbfb"
Jul 29 14:36:14.389878 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.389858    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87cfbdb3-8e14-4362-9ff8-a85011328e5c-tmp-dir\") pod \"dns-default-f6wgr\" (UID: \"87cfbdb3-8e14-4362-9ff8-a85011328e5c\") " pod="openshift-dns/dns-default-f6wgr"
Jul 29 14:36:14.389972 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.389886    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8d5cdf58-6ba5-4f67-b365-f6bf6e641880-cert\") pod \"ingress-canary-v7v42\" (UID: \"8d5cdf58-6ba5-4f67-b365-f6bf6e641880\") " pod="openshift-ingress-canary/ingress-canary-v7v42"
Jul 29 14:36:14.390111 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.390085    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3d7da1fa-df00-472a-8eeb-71bd340d3e0c-data-volume\") pod \"insights-runtime-extractor-pxbfb\" (UID: \"3d7da1fa-df00-472a-8eeb-71bd340d3e0c\") " pod="openshift-insights/insights-runtime-extractor-pxbfb"
Jul 29 14:36:14.390177 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.390163    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/87cfbdb3-8e14-4362-9ff8-a85011328e5c-config-volume\") pod \"dns-default-f6wgr\" (UID: \"87cfbdb3-8e14-4362-9ff8-a85011328e5c\") " pod="openshift-dns/dns-default-f6wgr"
Jul 29 14:36:14.390223 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.390176    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d7da1fa-df00-472a-8eeb-71bd340d3e0c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pxbfb\" (UID: \"3d7da1fa-df00-472a-8eeb-71bd340d3e0c\") " pod="openshift-insights/insights-runtime-extractor-pxbfb"
Jul 29 14:36:14.390283 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.390222    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87cfbdb3-8e14-4362-9ff8-a85011328e5c-tmp-dir\") pod \"dns-default-f6wgr\" (UID: \"87cfbdb3-8e14-4362-9ff8-a85011328e5c\") " pod="openshift-dns/dns-default-f6wgr"
Jul 29 14:36:14.393607 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.393579    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/87cfbdb3-8e14-4362-9ff8-a85011328e5c-metrics-tls\") pod \"dns-default-f6wgr\" (UID: \"87cfbdb3-8e14-4362-9ff8-a85011328e5c\") " pod="openshift-dns/dns-default-f6wgr"
Jul 29 14:36:14.393691 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.393606    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d7da1fa-df00-472a-8eeb-71bd340d3e0c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pxbfb\" (UID: \"3d7da1fa-df00-472a-8eeb-71bd340d3e0c\") " pod="openshift-insights/insights-runtime-extractor-pxbfb"
Jul 29 14:36:14.393691 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.393633    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8d5cdf58-6ba5-4f67-b365-f6bf6e641880-cert\") pod \"ingress-canary-v7v42\" (UID: \"8d5cdf58-6ba5-4f67-b365-f6bf6e641880\") " pod="openshift-ingress-canary/ingress-canary-v7v42"
Jul 29 14:36:14.398200 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.398146    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d2kb\" (UniqueName: \"kubernetes.io/projected/87cfbdb3-8e14-4362-9ff8-a85011328e5c-kube-api-access-8d2kb\") pod \"dns-default-f6wgr\" (UID: \"87cfbdb3-8e14-4362-9ff8-a85011328e5c\") " pod="openshift-dns/dns-default-f6wgr"
Jul 29 14:36:14.398200 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.398170    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr96s\" (UniqueName: \"kubernetes.io/projected/8d5cdf58-6ba5-4f67-b365-f6bf6e641880-kube-api-access-jr96s\") pod \"ingress-canary-v7v42\" (UID: \"8d5cdf58-6ba5-4f67-b365-f6bf6e641880\") " pod="openshift-ingress-canary/ingress-canary-v7v42"
Jul 29 14:36:14.398371 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.398356    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xg2xl\" (UniqueName: \"kubernetes.io/projected/3d7da1fa-df00-472a-8eeb-71bd340d3e0c-kube-api-access-xg2xl\") pod \"insights-runtime-extractor-pxbfb\" (UID: \"3d7da1fa-df00-472a-8eeb-71bd340d3e0c\") " pod="openshift-insights/insights-runtime-extractor-pxbfb"
Jul 29 14:36:14.442309 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.442287    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f6wgr"
Jul 29 14:36:14.459442 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.459424    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pxbfb"
Jul 29 14:36:14.473373 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.473353    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v7v42"
Jul 29 14:36:14.666700 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.665894    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v7v42"]
Jul 29 14:36:14.666937 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.666917    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f6wgr"]
Jul 29 14:36:14.667627 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:14.667599    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pxbfb"]
Jul 29 14:36:14.669919 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:36:14.669898    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87cfbdb3_8e14_4362_9ff8_a85011328e5c.slice/crio-bc3e13370982f43bd382e76ea600b54e614ae0b6c1f05898dab72bd23ad68932 WatchSource:0}: Error finding container bc3e13370982f43bd382e76ea600b54e614ae0b6c1f05898dab72bd23ad68932: Status 404 returned error can't find the container with id bc3e13370982f43bd382e76ea600b54e614ae0b6c1f05898dab72bd23ad68932
Jul 29 14:36:14.670445 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:36:14.670422    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d5cdf58_6ba5_4f67_b365_f6bf6e641880.slice/crio-a8a1d597a9eae81bd15601f7ae8ecd59e346e395bbd21890d7ae129beed48a32 WatchSource:0}: Error finding container a8a1d597a9eae81bd15601f7ae8ecd59e346e395bbd21890d7ae129beed48a32: Status 404 returned error can't find the container with id a8a1d597a9eae81bd15601f7ae8ecd59e346e395bbd21890d7ae129beed48a32
Jul 29 14:36:14.671055 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:36:14.671024    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d7da1fa_df00_472a_8eeb_71bd340d3e0c.slice/crio-58fec1d1c59c00c3bbd3d5c0ee269677d644d9cc049d6d8bb8319eb4bb28df0a WatchSource:0}: Error finding container 58fec1d1c59c00c3bbd3d5c0ee269677d644d9cc049d6d8bb8319eb4bb28df0a: Status 404 returned error can't find the container with id 58fec1d1c59c00c3bbd3d5c0ee269677d644d9cc049d6d8bb8319eb4bb28df0a
Jul 29 14:36:15.233466 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:15.233441    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-vxwws"]
Jul 29 14:36:15.245814 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:15.245764    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-vxwws"
Jul 29 14:36:15.246730 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:15.246702    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-vxwws"]
Jul 29 14:36:15.248535 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:15.248381    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 29 14:36:15.248535 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:15.248385    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-mk5sk\""
Jul 29 14:36:15.272979 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:15.272948    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vpqw"
Jul 29 14:36:15.272979 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:15.272966    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nct6x"
Jul 29 14:36:15.275908 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:15.275883    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 14:36:15.276263 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:15.275932    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 14:36:15.276263 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:15.275993    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ht8tz\""
Jul 29 14:36:15.276444 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:15.276425    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 14:36:15.396829 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:15.396803    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1f4507aa-711d-42bf-a236-7e17db4b2857-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-vxwws\" (UID: \"1f4507aa-711d-42bf-a236-7e17db4b2857\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-vxwws"
Jul 29 14:36:15.472474 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:15.472441    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v7v42" event={"ID":"8d5cdf58-6ba5-4f67-b365-f6bf6e641880","Type":"ContainerStarted","Data":"a8a1d597a9eae81bd15601f7ae8ecd59e346e395bbd21890d7ae129beed48a32"}
Jul 29 14:36:15.473832 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:15.473802    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pxbfb" event={"ID":"3d7da1fa-df00-472a-8eeb-71bd340d3e0c","Type":"ContainerStarted","Data":"58fec1d1c59c00c3bbd3d5c0ee269677d644d9cc049d6d8bb8319eb4bb28df0a"}
Jul 29 14:36:15.474914 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:15.474887    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f6wgr" event={"ID":"87cfbdb3-8e14-4362-9ff8-a85011328e5c","Type":"ContainerStarted","Data":"bc3e13370982f43bd382e76ea600b54e614ae0b6c1f05898dab72bd23ad68932"}
Jul 29 14:36:15.498132 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:15.498108    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1f4507aa-711d-42bf-a236-7e17db4b2857-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-vxwws\" (UID: \"1f4507aa-711d-42bf-a236-7e17db4b2857\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-vxwws"
Jul 29 14:36:15.501855 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:15.501830    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1f4507aa-711d-42bf-a236-7e17db4b2857-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-vxwws\" (UID: \"1f4507aa-711d-42bf-a236-7e17db4b2857\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-vxwws"
Jul 29 14:36:15.556807 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:15.556784    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-vxwws"
Jul 29 14:36:15.729768 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:15.729736    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-vxwws"]
Jul 29 14:36:15.733860 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:36:15.733832    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f4507aa_711d_42bf_a236_7e17db4b2857.slice/crio-3904aec3ab67a072b68b142d27fe9970abc29dbbdfcef9f4307a4a324598aa1f WatchSource:0}: Error finding container 3904aec3ab67a072b68b142d27fe9970abc29dbbdfcef9f4307a4a324598aa1f: Status 404 returned error can't find the container with id 3904aec3ab67a072b68b142d27fe9970abc29dbbdfcef9f4307a4a324598aa1f
Jul 29 14:36:16.480903 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:16.480863    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-vxwws" event={"ID":"1f4507aa-711d-42bf-a236-7e17db4b2857","Type":"ContainerStarted","Data":"3904aec3ab67a072b68b142d27fe9970abc29dbbdfcef9f4307a4a324598aa1f"}
Jul 29 14:36:22.498199 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:22.497863    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-vxwws" event={"ID":"1f4507aa-711d-42bf-a236-7e17db4b2857","Type":"ContainerStarted","Data":"89846943954c1d2cfa6c9b4ba8ea464a53fb84f912500c670a7da0c1bc85a21e"}
Jul 29 14:36:22.498995 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:22.498250    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-vxwws"
Jul 29 14:36:22.501656 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:22.501630    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v7v42" event={"ID":"8d5cdf58-6ba5-4f67-b365-f6bf6e641880","Type":"ContainerStarted","Data":"162ca644de3db225b909ec0ef8d2cc685ae7c6ef6d7c797910143ad5a8133127"}
Jul 29 14:36:22.503658 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:22.503634    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f6wgr" event={"ID":"87cfbdb3-8e14-4362-9ff8-a85011328e5c","Type":"ContainerStarted","Data":"00eeacd2368959264fcd8df97e1aa5fefd79e141981862e12dcb7008a47e7797"}
Jul 29 14:36:22.503783 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:22.503679    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f6wgr" event={"ID":"87cfbdb3-8e14-4362-9ff8-a85011328e5c","Type":"ContainerStarted","Data":"23212825b3fb4f1f657b8ec920d65a66eaba29b56bb7dc72fd8fa6103846028f"}
Jul 29 14:36:22.503783 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:22.503712    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-f6wgr"
Jul 29 14:36:22.504497 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:22.504478    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-vxwws"
Jul 29 14:36:22.505025 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:22.505009    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pxbfb" event={"ID":"3d7da1fa-df00-472a-8eeb-71bd340d3e0c","Type":"ContainerStarted","Data":"bc3f018455ee0410e9a6d76ab3071ee2479cd91afe1c2700148024ad45e15df7"}
Jul 29 14:36:22.514494 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:22.514457    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-vxwws" podStartSLOduration=1.437573683 podStartE2EDuration="7.514446278s" totalImagesPullingTime="6.076872595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 14:36:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 14:36:22.514149204 +0000 UTC m=+54.816615811" watchObservedRunningTime="2026-07-29 14:36:22.514446278 +0000 UTC m=+54.816912879"
Jul 29 14:36:22.532760 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:22.532725    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-v7v42" podStartSLOduration=1.3901656949999999 podStartE2EDuration="8.53271442s" totalImagesPullingTime="7.142548725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 14:36:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 14:36:22.532475767 +0000 UTC m=+54.834942378" watchObservedRunningTime="2026-07-29 14:36:22.53271442 +0000 UTC m=+54.835181037"
Jul 29 14:36:22.565823 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:22.565789    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-f6wgr" podStartSLOduration=1.423873222 podStartE2EDuration="8.565778907s" totalImagesPullingTime="7.141905685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 14:36:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 14:36:22.565354267 +0000 UTC m=+54.867820874" watchObservedRunningTime="2026-07-29 14:36:22.565778907 +0000 UTC m=+54.868245513"
Jul 29 14:36:23.310125 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:23.310093    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-58qjn"]
Jul 29 14:36:23.312192 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:23.312130    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-58qjn"
Jul 29 14:36:23.314901 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:23.314863    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 29 14:36:23.315053 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:23.315027    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 29 14:36:23.316218 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:23.316198    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-dsxxx\""
Jul 29 14:36:23.316314 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:23.316215    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 29 14:36:23.316314 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:23.316231    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 29 14:36:23.316572 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:23.316553    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 29 14:36:23.326547 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:23.326449    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-58qjn"]
Jul 29 14:36:23.460968 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:23.460938    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/88f100c9-c3a6-4896-bab2-7d019a4b9142-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-58qjn\" (UID: \"88f100c9-c3a6-4896-bab2-7d019a4b9142\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-58qjn"
Jul 29 14:36:23.461125 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:23.460988    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/88f100c9-c3a6-4896-bab2-7d019a4b9142-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-58qjn\" (UID: \"88f100c9-c3a6-4896-bab2-7d019a4b9142\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-58qjn"
Jul 29 14:36:23.461125 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:23.461038    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88f100c9-c3a6-4896-bab2-7d019a4b9142-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-58qjn\" (UID: \"88f100c9-c3a6-4896-bab2-7d019a4b9142\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-58qjn"
Jul 29 14:36:23.461125 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:23.461062    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rchqm\" (UniqueName: \"kubernetes.io/projected/88f100c9-c3a6-4896-bab2-7d019a4b9142-kube-api-access-rchqm\") pod \"prometheus-operator-84d69f794d-58qjn\" (UID: \"88f100c9-c3a6-4896-bab2-7d019a4b9142\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-58qjn"
Jul 29 14:36:23.561502 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:23.561429    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88f100c9-c3a6-4896-bab2-7d019a4b9142-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-58qjn\" (UID: \"88f100c9-c3a6-4896-bab2-7d019a4b9142\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-58qjn"
Jul 29 14:36:23.561502 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:23.561455    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rchqm\" (UniqueName: \"kubernetes.io/projected/88f100c9-c3a6-4896-bab2-7d019a4b9142-kube-api-access-rchqm\") pod \"prometheus-operator-84d69f794d-58qjn\" (UID: \"88f100c9-c3a6-4896-bab2-7d019a4b9142\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-58qjn"
Jul 29 14:36:23.561502 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:23.561502    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/88f100c9-c3a6-4896-bab2-7d019a4b9142-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-58qjn\" (UID: \"88f100c9-c3a6-4896-bab2-7d019a4b9142\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-58qjn"
Jul 29 14:36:23.562023 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:23.561524    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/88f100c9-c3a6-4896-bab2-7d019a4b9142-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-58qjn\" (UID: \"88f100c9-c3a6-4896-bab2-7d019a4b9142\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-58qjn"
Jul 29 14:36:23.562023 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:36:23.561653    2578 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 29 14:36:23.562023 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:36:23.561728    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88f100c9-c3a6-4896-bab2-7d019a4b9142-prometheus-operator-tls podName:88f100c9-c3a6-4896-bab2-7d019a4b9142 nodeName:}" failed. No retries permitted until 2026-07-29 14:36:24.061702727 +0000 UTC m=+56.364169318 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/88f100c9-c3a6-4896-bab2-7d019a4b9142-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-58qjn" (UID: "88f100c9-c3a6-4896-bab2-7d019a4b9142") : secret "prometheus-operator-tls" not found
Jul 29 14:36:23.562280 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:23.562259    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88f100c9-c3a6-4896-bab2-7d019a4b9142-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-58qjn\" (UID: \"88f100c9-c3a6-4896-bab2-7d019a4b9142\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-58qjn"
Jul 29 14:36:23.565665 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:23.565637    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/88f100c9-c3a6-4896-bab2-7d019a4b9142-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-58qjn\" (UID: \"88f100c9-c3a6-4896-bab2-7d019a4b9142\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-58qjn"
Jul 29 14:36:23.573163 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:23.573140    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rchqm\" (UniqueName: \"kubernetes.io/projected/88f100c9-c3a6-4896-bab2-7d019a4b9142-kube-api-access-rchqm\") pod \"prometheus-operator-84d69f794d-58qjn\" (UID: \"88f100c9-c3a6-4896-bab2-7d019a4b9142\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-58qjn"
Jul 29 14:36:24.065850 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:24.065814    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/88f100c9-c3a6-4896-bab2-7d019a4b9142-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-58qjn\" (UID: \"88f100c9-c3a6-4896-bab2-7d019a4b9142\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-58qjn"
Jul 29 14:36:24.068261 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:24.068214    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/88f100c9-c3a6-4896-bab2-7d019a4b9142-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-58qjn\" (UID: \"88f100c9-c3a6-4896-bab2-7d019a4b9142\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-58qjn"
Jul 29 14:36:24.225346 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:24.225312    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-58qjn"
Jul 29 14:36:25.917384 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:25.917361    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-58qjn"]
Jul 29 14:36:25.920175 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:36:25.920153    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88f100c9_c3a6_4896_bab2_7d019a4b9142.slice/crio-039ce52b6d9d03df299e0e9c4130de81edb57139283c7c571118c8e834a8594d WatchSource:0}: Error finding container 039ce52b6d9d03df299e0e9c4130de81edb57139283c7c571118c8e834a8594d: Status 404 returned error can't find the container with id 039ce52b6d9d03df299e0e9c4130de81edb57139283c7c571118c8e834a8594d
Jul 29 14:36:26.517069 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:26.517035    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pxbfb" event={"ID":"3d7da1fa-df00-472a-8eeb-71bd340d3e0c","Type":"ContainerStarted","Data":"2d206095719642f1b6694e80397d2acf8997eddf1e1ee03c3d3fa7406124b3b0"}
Jul 29 14:36:26.518040 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:26.518015    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-58qjn" event={"ID":"88f100c9-c3a6-4896-bab2-7d019a4b9142","Type":"ContainerStarted","Data":"039ce52b6d9d03df299e0e9c4130de81edb57139283c7c571118c8e834a8594d"}
Jul 29 14:36:26.567394 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:26.567370    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74584c6658-6vdwd"]
Jul 29 14:36:26.569338 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:26.569323    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74584c6658-6vdwd"
Jul 29 14:36:26.571997 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:26.571980    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 29 14:36:26.573164 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:26.573142    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 29 14:36:26.573164 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:26.573151    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 29 14:36:26.573328 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:26.573171    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 29 14:36:26.573328 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:26.573186    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-fxbjz\""
Jul 29 14:36:26.573328 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:26.573271    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 29 14:36:26.573460 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:26.573447    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 29 14:36:26.573516 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:26.573456    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 29 14:36:26.580935 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:26.580915    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74584c6658-6vdwd"]
Jul 29 14:36:26.583555 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:26.583536    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25d3846d-f20e-402d-b546-6713b6ac235d-console-oauth-config\") pod \"console-74584c6658-6vdwd\" (UID: \"25d3846d-f20e-402d-b546-6713b6ac235d\") " pod="openshift-console/console-74584c6658-6vdwd"
Jul 29 14:36:26.583661 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:26.583561    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25d3846d-f20e-402d-b546-6713b6ac235d-console-config\") pod \"console-74584c6658-6vdwd\" (UID: \"25d3846d-f20e-402d-b546-6713b6ac235d\") " pod="openshift-console/console-74584c6658-6vdwd"
Jul 29 14:36:26.583661 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:26.583590    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25d3846d-f20e-402d-b546-6713b6ac235d-service-ca\") pod \"console-74584c6658-6vdwd\" (UID: \"25d3846d-f20e-402d-b546-6713b6ac235d\") " pod="openshift-console/console-74584c6658-6vdwd"
Jul 29 14:36:26.583661 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:26.583613    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25d3846d-f20e-402d-b546-6713b6ac235d-oauth-serving-cert\") pod \"console-74584c6658-6vdwd\" (UID: \"25d3846d-f20e-402d-b546-6713b6ac235d\") " pod="openshift-console/console-74584c6658-6vdwd"
Jul 29 14:36:26.583804 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:26.583695    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25d3846d-f20e-402d-b546-6713b6ac235d-console-serving-cert\") pod \"console-74584c6658-6vdwd\" (UID: \"25d3846d-f20e-402d-b546-6713b6ac235d\") " pod="openshift-console/console-74584c6658-6vdwd"
Jul 29 14:36:26.583804 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:26.583750    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnnc8\" (UniqueName: \"kubernetes.io/projected/25d3846d-f20e-402d-b546-6713b6ac235d-kube-api-access-wnnc8\") pod \"console-74584c6658-6vdwd\" (UID: \"25d3846d-f20e-402d-b546-6713b6ac235d\") " pod="openshift-console/console-74584c6658-6vdwd"
Jul 29 14:36:26.684980 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:26.684947    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25d3846d-f20e-402d-b546-6713b6ac235d-service-ca\") pod \"console-74584c6658-6vdwd\" (UID: \"25d3846d-f20e-402d-b546-6713b6ac235d\") " pod="openshift-console/console-74584c6658-6vdwd"
Jul 29 14:36:26.685102 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:26.684987    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25d3846d-f20e-402d-b546-6713b6ac235d-oauth-serving-cert\") pod \"console-74584c6658-6vdwd\" (UID: \"25d3846d-f20e-402d-b546-6713b6ac235d\") " pod="openshift-console/console-74584c6658-6vdwd"
Jul 29 14:36:26.685102 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:26.685035    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25d3846d-f20e-402d-b546-6713b6ac235d-console-serving-cert\") pod \"console-74584c6658-6vdwd\" (UID: \"25d3846d-f20e-402d-b546-6713b6ac235d\") " pod="openshift-console/console-74584c6658-6vdwd"
Jul 29 14:36:26.685102 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:26.685090    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnnc8\" (UniqueName: \"kubernetes.io/projected/25d3846d-f20e-402d-b546-6713b6ac235d-kube-api-access-wnnc8\") pod \"console-74584c6658-6vdwd\" (UID: \"25d3846d-f20e-402d-b546-6713b6ac235d\") " pod="openshift-console/console-74584c6658-6vdwd"
Jul 29 14:36:26.685282 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:26.685139    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25d3846d-f20e-402d-b546-6713b6ac235d-console-oauth-config\") pod \"console-74584c6658-6vdwd\" (UID: \"25d3846d-f20e-402d-b546-6713b6ac235d\") " pod="openshift-console/console-74584c6658-6vdwd"
Jul 29 14:36:26.685282 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:26.685162    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25d3846d-f20e-402d-b546-6713b6ac235d-console-config\") pod \"console-74584c6658-6vdwd\" (UID: \"25d3846d-f20e-402d-b546-6713b6ac235d\") " pod="openshift-console/console-74584c6658-6vdwd"
Jul 29 14:36:26.685703 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:26.685681    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25d3846d-f20e-402d-b546-6713b6ac235d-service-ca\") pod \"console-74584c6658-6vdwd\" (UID: \"25d3846d-f20e-402d-b546-6713b6ac235d\") " pod="openshift-console/console-74584c6658-6vdwd"
Jul 29 14:36:26.685819 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:26.685706    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25d3846d-f20e-402d-b546-6713b6ac235d-oauth-serving-cert\") pod \"console-74584c6658-6vdwd\" (UID: \"25d3846d-f20e-402d-b546-6713b6ac235d\") " pod="openshift-console/console-74584c6658-6vdwd"
Jul 29 14:36:26.685819 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:26.685812    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25d3846d-f20e-402d-b546-6713b6ac235d-console-config\") pod \"console-74584c6658-6vdwd\" (UID: \"25d3846d-f20e-402d-b546-6713b6ac235d\") " pod="openshift-console/console-74584c6658-6vdwd"
Jul 29 14:36:26.687928 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:26.687893    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25d3846d-f20e-402d-b546-6713b6ac235d-console-oauth-config\") pod \"console-74584c6658-6vdwd\" (UID: \"25d3846d-f20e-402d-b546-6713b6ac235d\") " pod="openshift-console/console-74584c6658-6vdwd"
Jul 29 14:36:26.688007 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:26.687968    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25d3846d-f20e-402d-b546-6713b6ac235d-console-serving-cert\") pod \"console-74584c6658-6vdwd\" (UID: \"25d3846d-f20e-402d-b546-6713b6ac235d\") " pod="openshift-console/console-74584c6658-6vdwd"
Jul 29 14:36:26.694530 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:26.694511    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnnc8\" (UniqueName: \"kubernetes.io/projected/25d3846d-f20e-402d-b546-6713b6ac235d-kube-api-access-wnnc8\") pod \"console-74584c6658-6vdwd\" (UID: \"25d3846d-f20e-402d-b546-6713b6ac235d\") " pod="openshift-console/console-74584c6658-6vdwd"
Jul 29 14:36:26.878113 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:26.878028    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74584c6658-6vdwd"
Jul 29 14:36:27.025089 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:27.024992    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74584c6658-6vdwd"]
Jul 29 14:36:27.028027 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:36:27.027995    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25d3846d_f20e_402d_b546_6713b6ac235d.slice/crio-eddc88e2e9155ad93d2ceec880b39159f7b7363169893dffed9a7370168362d2 WatchSource:0}: Error finding container eddc88e2e9155ad93d2ceec880b39159f7b7363169893dffed9a7370168362d2: Status 404 returned error can't find the container with id eddc88e2e9155ad93d2ceec880b39159f7b7363169893dffed9a7370168362d2
Jul 29 14:36:27.524485 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:27.524452    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74584c6658-6vdwd" event={"ID":"25d3846d-f20e-402d-b546-6713b6ac235d","Type":"ContainerStarted","Data":"eddc88e2e9155ad93d2ceec880b39159f7b7363169893dffed9a7370168362d2"}
Jul 29 14:36:28.441714 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:28.441671    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-988xj"
Jul 29 14:36:28.532874 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:28.532821    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-58qjn" event={"ID":"88f100c9-c3a6-4896-bab2-7d019a4b9142","Type":"ContainerStarted","Data":"9b1da3774fcb5f460d10d501ad1e9fb3399b8b7092ae1648e2269fc116a8d576"}
Jul 29 14:36:28.533046 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:28.532936    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-58qjn" event={"ID":"88f100c9-c3a6-4896-bab2-7d019a4b9142","Type":"ContainerStarted","Data":"b611dfe2bbf23dc4309782072b48a9a3b73fd474b6ff41b833adc48c4342d30f"}
Jul 29 14:36:30.543070 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.543032    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pxbfb" event={"ID":"3d7da1fa-df00-472a-8eeb-71bd340d3e0c","Type":"ContainerStarted","Data":"e1acb8b8d0803e203a77d2335f530ef9eec82d23f6b80a4749dbdfd165b09d66"}
Jul 29 14:36:30.570522 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.570475    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-58qjn" podStartSLOduration=6.021327355 podStartE2EDuration="7.570461895s" totalImagesPullingTime="1.54913454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 14:36:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 14:36:28.549065873 +0000 UTC m=+60.851532482" watchObservedRunningTime="2026-07-29 14:36:30.570461895 +0000 UTC m=+62.872928502"
Jul 29 14:36:30.570832 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.570788    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pxbfb" podStartSLOduration=1.312619776 podStartE2EDuration="16.570773196s" totalImagesPullingTime="15.25815342s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 14:36:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 14:36:30.56888829 +0000 UTC m=+62.871354911" watchObservedRunningTime="2026-07-29 14:36:30.570773196 +0000 UTC m=+62.873239803"
Jul 29 14:36:30.733056 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.733029    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-jzs6j"]
Jul 29 14:36:30.735732 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.735716    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-jzs6j"
Jul 29 14:36:30.738763 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.738725    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 29 14:36:30.738885 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.738818    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 29 14:36:30.739050 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.739011    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gn6fx"]
Jul 29 14:36:30.739200 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.739186    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-t8rl4\""
Jul 29 14:36:30.739293 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.739199    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 29 14:36:30.742303 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.742285    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gn6fx"
Jul 29 14:36:30.746639 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.746622    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5nz5x\""
Jul 29 14:36:30.746881 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.746866    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 29 14:36:30.746944 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.746896    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 29 14:36:30.747208 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.747192    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 29 14:36:30.758387 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.758350    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-jzs6j"]
Jul 29 14:36:30.819267 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.819177    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1af5883d-41e6-4dbb-a3ef-53f2a9937964-node-exporter-wtmp\") pod \"node-exporter-gn6fx\" (UID: \"1af5883d-41e6-4dbb-a3ef-53f2a9937964\") " pod="openshift-monitoring/node-exporter-gn6fx"
Jul 29 14:36:30.819267 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.819209    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqlsc\" (UniqueName: \"kubernetes.io/projected/3374b2f4-b82c-49f8-a75a-29d044c45a30-kube-api-access-kqlsc\") pod \"kube-state-metrics-56d9f944b4-jzs6j\" (UID: \"3374b2f4-b82c-49f8-a75a-29d044c45a30\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-jzs6j"
Jul 29 14:36:30.819267 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.819257    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1af5883d-41e6-4dbb-a3ef-53f2a9937964-root\") pod \"node-exporter-gn6fx\" (UID: \"1af5883d-41e6-4dbb-a3ef-53f2a9937964\") " pod="openshift-monitoring/node-exporter-gn6fx"
Jul 29 14:36:30.819506 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.819330    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1af5883d-41e6-4dbb-a3ef-53f2a9937964-node-exporter-tls\") pod \"node-exporter-gn6fx\" (UID: \"1af5883d-41e6-4dbb-a3ef-53f2a9937964\") " pod="openshift-monitoring/node-exporter-gn6fx"
Jul 29 14:36:30.819506 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.819390    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3374b2f4-b82c-49f8-a75a-29d044c45a30-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-jzs6j\" (UID: \"3374b2f4-b82c-49f8-a75a-29d044c45a30\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-jzs6j"
Jul 29 14:36:30.819506 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.819421    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3374b2f4-b82c-49f8-a75a-29d044c45a30-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-jzs6j\" (UID: \"3374b2f4-b82c-49f8-a75a-29d044c45a30\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-jzs6j"
Jul 29 14:36:30.819506 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.819455    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1af5883d-41e6-4dbb-a3ef-53f2a9937964-node-exporter-textfile\") pod \"node-exporter-gn6fx\" (UID: \"1af5883d-41e6-4dbb-a3ef-53f2a9937964\") " pod="openshift-monitoring/node-exporter-gn6fx"
Jul 29 14:36:30.819506 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.819480    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1af5883d-41e6-4dbb-a3ef-53f2a9937964-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gn6fx\" (UID: \"1af5883d-41e6-4dbb-a3ef-53f2a9937964\") " pod="openshift-monitoring/node-exporter-gn6fx"
Jul 29 14:36:30.819748 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.819531    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3374b2f4-b82c-49f8-a75a-29d044c45a30-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-jzs6j\" (UID: \"3374b2f4-b82c-49f8-a75a-29d044c45a30\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-jzs6j"
Jul 29 14:36:30.819748 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.819574    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1af5883d-41e6-4dbb-a3ef-53f2a9937964-sys\") pod \"node-exporter-gn6fx\" (UID: \"1af5883d-41e6-4dbb-a3ef-53f2a9937964\") " pod="openshift-monitoring/node-exporter-gn6fx"
Jul 29 14:36:30.819748 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.819597    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjfmg\" (UniqueName: \"kubernetes.io/projected/1af5883d-41e6-4dbb-a3ef-53f2a9937964-kube-api-access-sjfmg\") pod \"node-exporter-gn6fx\" (UID: \"1af5883d-41e6-4dbb-a3ef-53f2a9937964\") " pod="openshift-monitoring/node-exporter-gn6fx"
Jul 29 14:36:30.819748 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.819616    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1af5883d-41e6-4dbb-a3ef-53f2a9937964-node-exporter-accelerators-collector-config\") pod \"node-exporter-gn6fx\" (UID: \"1af5883d-41e6-4dbb-a3ef-53f2a9937964\") " pod="openshift-monitoring/node-exporter-gn6fx"
Jul 29 14:36:30.819748 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.819652    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3374b2f4-b82c-49f8-a75a-29d044c45a30-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-jzs6j\" (UID: \"3374b2f4-b82c-49f8-a75a-29d044c45a30\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-jzs6j"
Jul 29 14:36:30.819748 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.819693    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1af5883d-41e6-4dbb-a3ef-53f2a9937964-metrics-client-ca\") pod \"node-exporter-gn6fx\" (UID: \"1af5883d-41e6-4dbb-a3ef-53f2a9937964\") " pod="openshift-monitoring/node-exporter-gn6fx"
Jul 29 14:36:30.819748 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.819747    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3374b2f4-b82c-49f8-a75a-29d044c45a30-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-jzs6j\" (UID: \"3374b2f4-b82c-49f8-a75a-29d044c45a30\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-jzs6j"
Jul 29 14:36:30.921010 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.920980    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1af5883d-41e6-4dbb-a3ef-53f2a9937964-root\") pod \"node-exporter-gn6fx\" (UID: \"1af5883d-41e6-4dbb-a3ef-53f2a9937964\") " pod="openshift-monitoring/node-exporter-gn6fx"
Jul 29 14:36:30.921147 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.921039    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1af5883d-41e6-4dbb-a3ef-53f2a9937964-node-exporter-tls\") pod \"node-exporter-gn6fx\" (UID: \"1af5883d-41e6-4dbb-a3ef-53f2a9937964\") " pod="openshift-monitoring/node-exporter-gn6fx"
Jul 29 14:36:30.921147 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.921064    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1af5883d-41e6-4dbb-a3ef-53f2a9937964-root\") pod \"node-exporter-gn6fx\" (UID: \"1af5883d-41e6-4dbb-a3ef-53f2a9937964\") " pod="openshift-monitoring/node-exporter-gn6fx"
Jul 29 14:36:30.921147 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.921080    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3374b2f4-b82c-49f8-a75a-29d044c45a30-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-jzs6j\" (UID: \"3374b2f4-b82c-49f8-a75a-29d044c45a30\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-jzs6j"
Jul 29 14:36:30.921147 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.921124    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3374b2f4-b82c-49f8-a75a-29d044c45a30-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-jzs6j\" (UID: \"3374b2f4-b82c-49f8-a75a-29d044c45a30\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-jzs6j"
Jul 29 14:36:30.921380 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:36:30.921208    2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 29 14:36:30.921380 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:36:30.921277    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1af5883d-41e6-4dbb-a3ef-53f2a9937964-node-exporter-tls podName:1af5883d-41e6-4dbb-a3ef-53f2a9937964 nodeName:}" failed. No retries permitted until 2026-07-29 14:36:31.421256329 +0000 UTC m=+63.723722927 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/1af5883d-41e6-4dbb-a3ef-53f2a9937964-node-exporter-tls") pod "node-exporter-gn6fx" (UID: "1af5883d-41e6-4dbb-a3ef-53f2a9937964") : secret "node-exporter-tls" not found
Jul 29 14:36:30.921380 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.921296    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1af5883d-41e6-4dbb-a3ef-53f2a9937964-node-exporter-textfile\") pod \"node-exporter-gn6fx\" (UID: \"1af5883d-41e6-4dbb-a3ef-53f2a9937964\") " pod="openshift-monitoring/node-exporter-gn6fx"
Jul 29 14:36:30.921380 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.921325    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1af5883d-41e6-4dbb-a3ef-53f2a9937964-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gn6fx\" (UID: \"1af5883d-41e6-4dbb-a3ef-53f2a9937964\") " pod="openshift-monitoring/node-exporter-gn6fx"
Jul 29 14:36:30.921380 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.921352    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3374b2f4-b82c-49f8-a75a-29d044c45a30-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-jzs6j\" (UID: \"3374b2f4-b82c-49f8-a75a-29d044c45a30\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-jzs6j"
Jul 29 14:36:30.921380 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.921376    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1af5883d-41e6-4dbb-a3ef-53f2a9937964-sys\") pod \"node-exporter-gn6fx\" (UID: \"1af5883d-41e6-4dbb-a3ef-53f2a9937964\") " pod="openshift-monitoring/node-exporter-gn6fx"
Jul 29 14:36:30.921674 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.921400    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjfmg\" (UniqueName: \"kubernetes.io/projected/1af5883d-41e6-4dbb-a3ef-53f2a9937964-kube-api-access-sjfmg\") pod \"node-exporter-gn6fx\" (UID: \"1af5883d-41e6-4dbb-a3ef-53f2a9937964\") " pod="openshift-monitoring/node-exporter-gn6fx"
Jul 29 14:36:30.921674 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.921428    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1af5883d-41e6-4dbb-a3ef-53f2a9937964-node-exporter-accelerators-collector-config\") pod \"node-exporter-gn6fx\" (UID: \"1af5883d-41e6-4dbb-a3ef-53f2a9937964\") " pod="openshift-monitoring/node-exporter-gn6fx"
Jul 29 14:36:30.921674 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.921462    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3374b2f4-b82c-49f8-a75a-29d044c45a30-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-jzs6j\" (UID: \"3374b2f4-b82c-49f8-a75a-29d044c45a30\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-jzs6j"
Jul 29 14:36:30.921674 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.921466    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3374b2f4-b82c-49f8-a75a-29d044c45a30-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-jzs6j\" (UID: \"3374b2f4-b82c-49f8-a75a-29d044c45a30\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-jzs6j"
Jul 29 14:36:30.921674 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.921493    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1af5883d-41e6-4dbb-a3ef-53f2a9937964-metrics-client-ca\") pod \"node-exporter-gn6fx\" (UID: \"1af5883d-41e6-4dbb-a3ef-53f2a9937964\") " pod="openshift-monitoring/node-exporter-gn6fx"
Jul 29 14:36:30.921913 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.921840    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3374b2f4-b82c-49f8-a75a-29d044c45a30-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-jzs6j\" (UID: \"3374b2f4-b82c-49f8-a75a-29d044c45a30\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-jzs6j"
Jul 29 14:36:30.922266 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.922025    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3374b2f4-b82c-49f8-a75a-29d044c45a30-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-jzs6j\" (UID: \"3374b2f4-b82c-49f8-a75a-29d044c45a30\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-jzs6j"
Jul 29 14:36:30.922266 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.922091    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1af5883d-41e6-4dbb-a3ef-53f2a9937964-node-exporter-wtmp\") pod \"node-exporter-gn6fx\" (UID: \"1af5883d-41e6-4dbb-a3ef-53f2a9937964\") " pod="openshift-monitoring/node-exporter-gn6fx"
Jul 29 14:36:30.922266 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.922101    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1af5883d-41e6-4dbb-a3ef-53f2a9937964-sys\") pod \"node-exporter-gn6fx\" (UID: \"1af5883d-41e6-4dbb-a3ef-53f2a9937964\") " pod="openshift-monitoring/node-exporter-gn6fx"
Jul 29 14:36:30.922266 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.922121    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqlsc\" (UniqueName: \"kubernetes.io/projected/3374b2f4-b82c-49f8-a75a-29d044c45a30-kube-api-access-kqlsc\") pod \"kube-state-metrics-56d9f944b4-jzs6j\" (UID: \"3374b2f4-b82c-49f8-a75a-29d044c45a30\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-jzs6j"
Jul 29 14:36:30.922266 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.922106    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1af5883d-41e6-4dbb-a3ef-53f2a9937964-node-exporter-textfile\") pod \"node-exporter-gn6fx\" (UID: \"1af5883d-41e6-4dbb-a3ef-53f2a9937964\") " pod="openshift-monitoring/node-exporter-gn6fx"
Jul 29 14:36:30.922266 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.922136    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1af5883d-41e6-4dbb-a3ef-53f2a9937964-metrics-client-ca\") pod \"node-exporter-gn6fx\" (UID: \"1af5883d-41e6-4dbb-a3ef-53f2a9937964\") " pod="openshift-monitoring/node-exporter-gn6fx"
Jul 29 14:36:30.922266 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.922192    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3374b2f4-b82c-49f8-a75a-29d044c45a30-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-jzs6j\" (UID: \"3374b2f4-b82c-49f8-a75a-29d044c45a30\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-jzs6j"
Jul 29 14:36:30.922593 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.922300    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1af5883d-41e6-4dbb-a3ef-53f2a9937964-node-exporter-wtmp\") pod \"node-exporter-gn6fx\" (UID: \"1af5883d-41e6-4dbb-a3ef-53f2a9937964\") " pod="openshift-monitoring/node-exporter-gn6fx"
Jul 29 14:36:30.922593 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.922405    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1af5883d-41e6-4dbb-a3ef-53f2a9937964-node-exporter-accelerators-collector-config\") pod \"node-exporter-gn6fx\" (UID: \"1af5883d-41e6-4dbb-a3ef-53f2a9937964\") " pod="openshift-monitoring/node-exporter-gn6fx"
Jul 29 14:36:30.924355 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.924325    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1af5883d-41e6-4dbb-a3ef-53f2a9937964-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gn6fx\" (UID: \"1af5883d-41e6-4dbb-a3ef-53f2a9937964\") " pod="openshift-monitoring/node-exporter-gn6fx"
Jul 29 14:36:30.924498 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.924467    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3374b2f4-b82c-49f8-a75a-29d044c45a30-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-jzs6j\" (UID: \"3374b2f4-b82c-49f8-a75a-29d044c45a30\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-jzs6j"
Jul 29 14:36:30.924606 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.924559    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3374b2f4-b82c-49f8-a75a-29d044c45a30-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-jzs6j\" (UID: \"3374b2f4-b82c-49f8-a75a-29d044c45a30\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-jzs6j"
Jul 29 14:36:30.937008 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.936984    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjfmg\" (UniqueName: \"kubernetes.io/projected/1af5883d-41e6-4dbb-a3ef-53f2a9937964-kube-api-access-sjfmg\") pod \"node-exporter-gn6fx\" (UID: \"1af5883d-41e6-4dbb-a3ef-53f2a9937964\") " pod="openshift-monitoring/node-exporter-gn6fx"
Jul 29 14:36:30.937229 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:30.937213    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqlsc\" (UniqueName: \"kubernetes.io/projected/3374b2f4-b82c-49f8-a75a-29d044c45a30-kube-api-access-kqlsc\") pod \"kube-state-metrics-56d9f944b4-jzs6j\" (UID: \"3374b2f4-b82c-49f8-a75a-29d044c45a30\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-jzs6j"
Jul 29 14:36:31.046647 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:31.046622    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-jzs6j"
Jul 29 14:36:31.426077 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:31.426045    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1af5883d-41e6-4dbb-a3ef-53f2a9937964-node-exporter-tls\") pod \"node-exporter-gn6fx\" (UID: \"1af5883d-41e6-4dbb-a3ef-53f2a9937964\") " pod="openshift-monitoring/node-exporter-gn6fx"
Jul 29 14:36:31.428451 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:31.428424    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1af5883d-41e6-4dbb-a3ef-53f2a9937964-node-exporter-tls\") pod \"node-exporter-gn6fx\" (UID: \"1af5883d-41e6-4dbb-a3ef-53f2a9937964\") " pod="openshift-monitoring/node-exporter-gn6fx"
Jul 29 14:36:31.655391 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:31.655364    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gn6fx"
Jul 29 14:36:31.752062 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:36:31.752034    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1af5883d_41e6_4dbb_a3ef_53f2a9937964.slice/crio-0c80ac0b8f01884e17e8b5e64d073b774a89b9b6d678e61792bec958c7d14e2f WatchSource:0}: Error finding container 0c80ac0b8f01884e17e8b5e64d073b774a89b9b6d678e61792bec958c7d14e2f: Status 404 returned error can't find the container with id 0c80ac0b8f01884e17e8b5e64d073b774a89b9b6d678e61792bec958c7d14e2f
Jul 29 14:36:31.874361 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:31.874334    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-jzs6j"]
Jul 29 14:36:31.878539 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:36:31.878511    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3374b2f4_b82c_49f8_a75a_29d044c45a30.slice/crio-f36c0ea0fd735b10a5df716518f52fb51e524a4a00906de63f44c8bf06f2ea39 WatchSource:0}: Error finding container f36c0ea0fd735b10a5df716518f52fb51e524a4a00906de63f44c8bf06f2ea39: Status 404 returned error can't find the container with id f36c0ea0fd735b10a5df716518f52fb51e524a4a00906de63f44c8bf06f2ea39
Jul 29 14:36:32.509639 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:32.509605    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-f6wgr"
Jul 29 14:36:32.554016 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:32.553978    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74584c6658-6vdwd" event={"ID":"25d3846d-f20e-402d-b546-6713b6ac235d","Type":"ContainerStarted","Data":"bc20afc385b925fc6b6cd34460a2f2a35d877aaa24a6ca1f91fe52c4c88dfd5d"}
Jul 29 14:36:32.556299 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:32.556272    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gn6fx" event={"ID":"1af5883d-41e6-4dbb-a3ef-53f2a9937964","Type":"ContainerStarted","Data":"0c80ac0b8f01884e17e8b5e64d073b774a89b9b6d678e61792bec958c7d14e2f"}
Jul 29 14:36:32.557580 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:32.557514    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-jzs6j" event={"ID":"3374b2f4-b82c-49f8-a75a-29d044c45a30","Type":"ContainerStarted","Data":"f36c0ea0fd735b10a5df716518f52fb51e524a4a00906de63f44c8bf06f2ea39"}
Jul 29 14:36:32.579193 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:32.579003    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74584c6658-6vdwd" podStartSLOduration=1.806934214 podStartE2EDuration="6.578983343s" totalImagesPullingTime="4.772049129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 14:36:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 14:36:32.577717256 +0000 UTC m=+64.880183863" watchObservedRunningTime="2026-07-29 14:36:32.578983343 +0000 UTC m=+64.881449951"
Jul 29 14:36:32.774653 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:32.774574    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-69c4bf449-6w46j"]
Jul 29 14:36:32.777943 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:32.777920    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-69c4bf449-6w46j"
Jul 29 14:36:32.781576 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:32.781555    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-9kjzb\""
Jul 29 14:36:32.781696 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:32.781554    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-6go17bccfjnao\""
Jul 29 14:36:32.781696 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:32.781607    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 29 14:36:32.781696 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:32.781572    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 29 14:36:32.781867 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:32.781835    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 29 14:36:32.782669 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:32.782645    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 29 14:36:32.782909 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:32.782884    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 29 14:36:32.792512 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:32.792490    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-69c4bf449-6w46j"]
Jul 29 14:36:32.838530 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:32.838511    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0575e2d0-cace-4000-b93c-f3cddbf2fbc1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-69c4bf449-6w46j\" (UID: \"0575e2d0-cace-4000-b93c-f3cddbf2fbc1\") " pod="openshift-monitoring/thanos-querier-69c4bf449-6w46j"
Jul 29 14:36:32.838614 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:32.838562    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0575e2d0-cace-4000-b93c-f3cddbf2fbc1-secret-grpc-tls\") pod \"thanos-querier-69c4bf449-6w46j\" (UID: \"0575e2d0-cace-4000-b93c-f3cddbf2fbc1\") " pod="openshift-monitoring/thanos-querier-69c4bf449-6w46j"
Jul 29 14:36:32.838614 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:32.838581    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0575e2d0-cace-4000-b93c-f3cddbf2fbc1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-69c4bf449-6w46j\" (UID: \"0575e2d0-cace-4000-b93c-f3cddbf2fbc1\") " pod="openshift-monitoring/thanos-querier-69c4bf449-6w46j"
Jul 29 14:36:32.838721 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:32.838668    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk7ld\" (UniqueName: \"kubernetes.io/projected/0575e2d0-cace-4000-b93c-f3cddbf2fbc1-kube-api-access-fk7ld\") pod \"thanos-querier-69c4bf449-6w46j\" (UID: \"0575e2d0-cace-4000-b93c-f3cddbf2fbc1\") " pod="openshift-monitoring/thanos-querier-69c4bf449-6w46j"
Jul 29 14:36:32.838721 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:32.838703    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0575e2d0-cace-4000-b93c-f3cddbf2fbc1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-69c4bf449-6w46j\" (UID: \"0575e2d0-cace-4000-b93c-f3cddbf2fbc1\") " pod="openshift-monitoring/thanos-querier-69c4bf449-6w46j"
Jul 29 14:36:32.838820 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:32.838735    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0575e2d0-cace-4000-b93c-f3cddbf2fbc1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-69c4bf449-6w46j\" (UID: \"0575e2d0-cace-4000-b93c-f3cddbf2fbc1\") " pod="openshift-monitoring/thanos-querier-69c4bf449-6w46j"
Jul 29 14:36:32.838820 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:32.838788    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0575e2d0-cace-4000-b93c-f3cddbf2fbc1-metrics-client-ca\") pod \"thanos-querier-69c4bf449-6w46j\" (UID: \"0575e2d0-cace-4000-b93c-f3cddbf2fbc1\") " pod="openshift-monitoring/thanos-querier-69c4bf449-6w46j"
Jul 29 14:36:32.838880 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:32.838825    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0575e2d0-cace-4000-b93c-f3cddbf2fbc1-secret-thanos-querier-tls\") pod \"thanos-querier-69c4bf449-6w46j\" (UID: \"0575e2d0-cace-4000-b93c-f3cddbf2fbc1\") " pod="openshift-monitoring/thanos-querier-69c4bf449-6w46j"
Jul 29 14:36:32.939467 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:32.939440    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0575e2d0-cace-4000-b93c-f3cddbf2fbc1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-69c4bf449-6w46j\" (UID: \"0575e2d0-cace-4000-b93c-f3cddbf2fbc1\") " pod="openshift-monitoring/thanos-querier-69c4bf449-6w46j"
Jul 29 14:36:32.939572 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:32.939510    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0575e2d0-cace-4000-b93c-f3cddbf2fbc1-secret-grpc-tls\") pod \"thanos-querier-69c4bf449-6w46j\" (UID: \"0575e2d0-cace-4000-b93c-f3cddbf2fbc1\") " pod="openshift-monitoring/thanos-querier-69c4bf449-6w46j"
Jul 29 14:36:32.939572 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:32.939534    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0575e2d0-cace-4000-b93c-f3cddbf2fbc1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-69c4bf449-6w46j\" (UID: \"0575e2d0-cace-4000-b93c-f3cddbf2fbc1\") " pod="openshift-monitoring/thanos-querier-69c4bf449-6w46j"
Jul 29 14:36:32.939681 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:32.939582    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk7ld\" (UniqueName: \"kubernetes.io/projected/0575e2d0-cace-4000-b93c-f3cddbf2fbc1-kube-api-access-fk7ld\") pod \"thanos-querier-69c4bf449-6w46j\" (UID: \"0575e2d0-cace-4000-b93c-f3cddbf2fbc1\") " pod="openshift-monitoring/thanos-querier-69c4bf449-6w46j"
Jul 29 14:36:32.939681 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:32.939608    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0575e2d0-cace-4000-b93c-f3cddbf2fbc1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-69c4bf449-6w46j\" (UID: \"0575e2d0-cace-4000-b93c-f3cddbf2fbc1\") " pod="openshift-monitoring/thanos-querier-69c4bf449-6w46j"
Jul 29 14:36:32.939681 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:32.939626    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0575e2d0-cace-4000-b93c-f3cddbf2fbc1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-69c4bf449-6w46j\" (UID: \"0575e2d0-cace-4000-b93c-f3cddbf2fbc1\") " pod="openshift-monitoring/thanos-querier-69c4bf449-6w46j"
Jul 29 14:36:32.939681 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:32.939660    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0575e2d0-cace-4000-b93c-f3cddbf2fbc1-metrics-client-ca\") pod \"thanos-querier-69c4bf449-6w46j\" (UID: \"0575e2d0-cace-4000-b93c-f3cddbf2fbc1\") " pod="openshift-monitoring/thanos-querier-69c4bf449-6w46j"
Jul 29 14:36:32.939867 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:32.939693    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0575e2d0-cace-4000-b93c-f3cddbf2fbc1-secret-thanos-querier-tls\") pod \"thanos-querier-69c4bf449-6w46j\" (UID: \"0575e2d0-cace-4000-b93c-f3cddbf2fbc1\") " pod="openshift-monitoring/thanos-querier-69c4bf449-6w46j"
Jul 29 14:36:32.940887 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:32.940860    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0575e2d0-cace-4000-b93c-f3cddbf2fbc1-metrics-client-ca\") pod \"thanos-querier-69c4bf449-6w46j\" (UID: \"0575e2d0-cace-4000-b93c-f3cddbf2fbc1\") " pod="openshift-monitoring/thanos-querier-69c4bf449-6w46j"
Jul 29 14:36:32.942076 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:32.942055    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0575e2d0-cace-4000-b93c-f3cddbf2fbc1-secret-thanos-querier-tls\") pod \"thanos-querier-69c4bf449-6w46j\" (UID: \"0575e2d0-cace-4000-b93c-f3cddbf2fbc1\") " pod="openshift-monitoring/thanos-querier-69c4bf449-6w46j"
Jul 29 14:36:32.942274 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:32.942253    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0575e2d0-cace-4000-b93c-f3cddbf2fbc1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-69c4bf449-6w46j\" (UID: \"0575e2d0-cace-4000-b93c-f3cddbf2fbc1\") " pod="openshift-monitoring/thanos-querier-69c4bf449-6w46j"
Jul 29 14:36:32.942461 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:32.942437    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0575e2d0-cace-4000-b93c-f3cddbf2fbc1-secret-grpc-tls\") pod \"thanos-querier-69c4bf449-6w46j\" (UID: \"0575e2d0-cace-4000-b93c-f3cddbf2fbc1\") " pod="openshift-monitoring/thanos-querier-69c4bf449-6w46j"
Jul 29 14:36:32.942663 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:32.942640    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0575e2d0-cace-4000-b93c-f3cddbf2fbc1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-69c4bf449-6w46j\" (UID: \"0575e2d0-cace-4000-b93c-f3cddbf2fbc1\") " pod="openshift-monitoring/thanos-querier-69c4bf449-6w46j"
Jul 29 14:36:32.943323 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:32.943300    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0575e2d0-cace-4000-b93c-f3cddbf2fbc1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-69c4bf449-6w46j\" (UID: \"0575e2d0-cace-4000-b93c-f3cddbf2fbc1\") " pod="openshift-monitoring/thanos-querier-69c4bf449-6w46j"
Jul 29 14:36:32.943541 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:32.943522    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0575e2d0-cace-4000-b93c-f3cddbf2fbc1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-69c4bf449-6w46j\" (UID: \"0575e2d0-cace-4000-b93c-f3cddbf2fbc1\") " pod="openshift-monitoring/thanos-querier-69c4bf449-6w46j"
Jul 29 14:36:32.949895 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:32.949876    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk7ld\" (UniqueName: \"kubernetes.io/projected/0575e2d0-cace-4000-b93c-f3cddbf2fbc1-kube-api-access-fk7ld\") pod \"thanos-querier-69c4bf449-6w46j\" (UID: \"0575e2d0-cace-4000-b93c-f3cddbf2fbc1\") " pod="openshift-monitoring/thanos-querier-69c4bf449-6w46j"
Jul 29 14:36:33.089950 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:33.089906    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-69c4bf449-6w46j"
Jul 29 14:36:33.215389 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:33.215295    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-69c4bf449-6w46j"]
Jul 29 14:36:33.217286 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:36:33.217262    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0575e2d0_cace_4000_b93c_f3cddbf2fbc1.slice/crio-60678410398b9e4a357cc53bbee6a76bc151f706830ef2572c76c5959b3155b1 WatchSource:0}: Error finding container 60678410398b9e4a357cc53bbee6a76bc151f706830ef2572c76c5959b3155b1: Status 404 returned error can't find the container with id 60678410398b9e4a357cc53bbee6a76bc151f706830ef2572c76c5959b3155b1
Jul 29 14:36:33.561663 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:33.561636    2578 generic.go:356] "Generic (PLEG): container finished" podID="1af5883d-41e6-4dbb-a3ef-53f2a9937964" containerID="1739a0c88225716b3e380c0c5f53629db87551fa6a4c1a84fab119ee55c10d7b" exitCode=0
Jul 29 14:36:33.561842 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:33.561737    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gn6fx" event={"ID":"1af5883d-41e6-4dbb-a3ef-53f2a9937964","Type":"ContainerDied","Data":"1739a0c88225716b3e380c0c5f53629db87551fa6a4c1a84fab119ee55c10d7b"}
Jul 29 14:36:33.562913 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:33.562895    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69c4bf449-6w46j" event={"ID":"0575e2d0-cace-4000-b93c-f3cddbf2fbc1","Type":"ContainerStarted","Data":"60678410398b9e4a357cc53bbee6a76bc151f706830ef2572c76c5959b3155b1"}
Jul 29 14:36:33.946225 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:33.946139    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a331e3af-23b3-4dd4-a427-8b1a93f9441c-original-pull-secret\") pod \"global-pull-secret-syncer-2vpqw\" (UID: \"a331e3af-23b3-4dd4-a427-8b1a93f9441c\") " pod="kube-system/global-pull-secret-syncer-2vpqw"
Jul 29 14:36:33.946626 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:33.946225    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d750720-77d3-457c-91d0-a8638d494329-metrics-certs\") pod \"network-metrics-daemon-6mrz9\" (UID: \"3d750720-77d3-457c-91d0-a8638d494329\") " pod="openshift-multus/network-metrics-daemon-6mrz9"
Jul 29 14:36:33.949432 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:33.949405    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 14:36:33.949432 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:33.949412    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 14:36:33.959161 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:33.959135    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d750720-77d3-457c-91d0-a8638d494329-metrics-certs\") pod \"network-metrics-daemon-6mrz9\" (UID: \"3d750720-77d3-457c-91d0-a8638d494329\") " pod="openshift-multus/network-metrics-daemon-6mrz9"
Jul 29 14:36:33.959290 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:33.959200    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a331e3af-23b3-4dd4-a427-8b1a93f9441c-original-pull-secret\") pod \"global-pull-secret-syncer-2vpqw\" (UID: \"a331e3af-23b3-4dd4-a427-8b1a93f9441c\") " pod="kube-system/global-pull-secret-syncer-2vpqw"
Jul 29 14:36:34.046815 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:34.046793    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zsbw\" (UniqueName: \"kubernetes.io/projected/c03c2192-7d27-4033-9f74-f91ae62dc072-kube-api-access-9zsbw\") pod \"network-check-target-nct6x\" (UID: \"c03c2192-7d27-4033-9f74-f91ae62dc072\") " pod="openshift-network-diagnostics/network-check-target-nct6x"
Jul 29 14:36:34.049670 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:34.049651    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 14:36:34.065778 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:34.065757    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 14:36:34.070479 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:34.070456    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zsbw\" (UniqueName: \"kubernetes.io/projected/c03c2192-7d27-4033-9f74-f91ae62dc072-kube-api-access-9zsbw\") pod \"network-check-target-nct6x\" (UID: \"c03c2192-7d27-4033-9f74-f91ae62dc072\") " pod="openshift-network-diagnostics/network-check-target-nct6x"
Jul 29 14:36:34.083326 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:34.083299    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nzccd\""
Jul 29 14:36:34.091295 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:34.091224    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6mrz9"
Jul 29 14:36:34.184011 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:34.183899    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2vpqw"
Jul 29 14:36:34.192845 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:34.192638    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ht8tz\""
Jul 29 14:36:34.199509 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:34.199275    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nct6x"
Jul 29 14:36:34.238855 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:34.238826    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6mrz9"]
Jul 29 14:36:34.243916 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:36:34.243854    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d750720_77d3_457c_91d0_a8638d494329.slice/crio-7e6f7b49338a06da095d205c057b3ab9621d1ea7e060a416dd31cd570fa0561d WatchSource:0}: Error finding container 7e6f7b49338a06da095d205c057b3ab9621d1ea7e060a416dd31cd570fa0561d: Status 404 returned error can't find the container with id 7e6f7b49338a06da095d205c057b3ab9621d1ea7e060a416dd31cd570fa0561d
Jul 29 14:36:34.367057 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:34.367016    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2vpqw"]
Jul 29 14:36:34.370604 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:36:34.370575    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda331e3af_23b3_4dd4_a427_8b1a93f9441c.slice/crio-90296f4e634c7299f17170a0cbea0c778bcd5ae67400aad818bcd44217b85574 WatchSource:0}: Error finding container 90296f4e634c7299f17170a0cbea0c778bcd5ae67400aad818bcd44217b85574: Status 404 returned error can't find the container with id 90296f4e634c7299f17170a0cbea0c778bcd5ae67400aad818bcd44217b85574
Jul 29 14:36:34.383340 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:34.383317    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nct6x"]
Jul 29 14:36:34.386536 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:36:34.386511    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc03c2192_7d27_4033_9f74_f91ae62dc072.slice/crio-8c551e56f673058425723b3e9565e06622d6cabaaa4370faa12fb5ca10a56eb8 WatchSource:0}: Error finding container 8c551e56f673058425723b3e9565e06622d6cabaaa4370faa12fb5ca10a56eb8: Status 404 returned error can't find the container with id 8c551e56f673058425723b3e9565e06622d6cabaaa4370faa12fb5ca10a56eb8
Jul 29 14:36:34.569314 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:34.569276    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gn6fx" event={"ID":"1af5883d-41e6-4dbb-a3ef-53f2a9937964","Type":"ContainerStarted","Data":"49bab262df74b39b4b52741889c43efcb8cd1527c213b050730f5bced790b1e7"}
Jul 29 14:36:34.569473 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:34.569342    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gn6fx" event={"ID":"1af5883d-41e6-4dbb-a3ef-53f2a9937964","Type":"ContainerStarted","Data":"bf8a8024a30806e71f19e659289f21cb36ace2eb3c556c558a7bec0ca3f67f63"}
Jul 29 14:36:34.571566 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:34.571536    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-jzs6j" event={"ID":"3374b2f4-b82c-49f8-a75a-29d044c45a30","Type":"ContainerStarted","Data":"8a2387847780046df024bd4a4f52e3bd9d8ca731ec96afc27d5fe834aff3ea9e"}
Jul 29 14:36:34.571681 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:34.571586    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-jzs6j" event={"ID":"3374b2f4-b82c-49f8-a75a-29d044c45a30","Type":"ContainerStarted","Data":"da003aa9b65c957e52b7b3f936719ab49b832adf2b1e3b65626ed6cf8115007f"}
Jul 29 14:36:34.571681 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:34.571611    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-jzs6j" event={"ID":"3374b2f4-b82c-49f8-a75a-29d044c45a30","Type":"ContainerStarted","Data":"cdd7d6b83d790b0734483d1c3c22eb613f5f5094571d7852049dec673b841449"}
Jul 29 14:36:34.572894 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:34.572847    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nct6x" event={"ID":"c03c2192-7d27-4033-9f74-f91ae62dc072","Type":"ContainerStarted","Data":"8c551e56f673058425723b3e9565e06622d6cabaaa4370faa12fb5ca10a56eb8"}
Jul 29 14:36:34.574094 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:34.574062    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2vpqw" event={"ID":"a331e3af-23b3-4dd4-a427-8b1a93f9441c","Type":"ContainerStarted","Data":"90296f4e634c7299f17170a0cbea0c778bcd5ae67400aad818bcd44217b85574"}
Jul 29 14:36:34.575464 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:34.575433    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6mrz9" event={"ID":"3d750720-77d3-457c-91d0-a8638d494329","Type":"ContainerStarted","Data":"7e6f7b49338a06da095d205c057b3ab9621d1ea7e060a416dd31cd570fa0561d"}
Jul 29 14:36:34.592299 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:34.592252    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gn6fx" podStartSLOduration=3.500581036 podStartE2EDuration="4.592228932s" totalImagesPullingTime="1.032535032s" totalInitContainerRuntime="59.112864ms" isStatefulPod=true podCreationTimestamp="2026-07-29 14:36:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 14:36:34.591570112 +0000 UTC m=+66.894036717" watchObservedRunningTime="2026-07-29 14:36:34.592228932 +0000 UTC m=+66.894695541"
Jul 29 14:36:34.615256 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:34.615198    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-jzs6j" podStartSLOduration=2.893581176 podStartE2EDuration="4.615181322s" totalImagesPullingTime="1.721600146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 14:36:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 14:36:34.613735471 +0000 UTC m=+66.916202078" watchObservedRunningTime="2026-07-29 14:36:34.615181322 +0000 UTC m=+66.917647930"
Jul 29 14:36:35.130489 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.130454    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5f54f66665-cnc72"]
Jul 29 14:36:35.134609 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.134585    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5f54f66665-cnc72"
Jul 29 14:36:35.138005 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.137981    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 29 14:36:35.138138 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.138076    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-ea3q33vrthfak\""
Jul 29 14:36:35.139772 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.139599    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-9d4qw\""
Jul 29 14:36:35.139772 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.139621    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 29 14:36:35.139772 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.139688    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 29 14:36:35.140012 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.139906    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 29 14:36:35.154404 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.154378    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b633136e-5c4d-430a-a6da-3c6756a71e29-client-ca-bundle\") pod \"metrics-server-5f54f66665-cnc72\" (UID: \"b633136e-5c4d-430a-a6da-3c6756a71e29\") " pod="openshift-monitoring/metrics-server-5f54f66665-cnc72"
Jul 29 14:36:35.154517 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.154438    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b633136e-5c4d-430a-a6da-3c6756a71e29-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f54f66665-cnc72\" (UID: \"b633136e-5c4d-430a-a6da-3c6756a71e29\") " pod="openshift-monitoring/metrics-server-5f54f66665-cnc72"
Jul 29 14:36:35.154517 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.154469    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b633136e-5c4d-430a-a6da-3c6756a71e29-audit-log\") pod \"metrics-server-5f54f66665-cnc72\" (UID: \"b633136e-5c4d-430a-a6da-3c6756a71e29\") " pod="openshift-monitoring/metrics-server-5f54f66665-cnc72"
Jul 29 14:36:35.154517 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.154491    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b633136e-5c4d-430a-a6da-3c6756a71e29-metrics-server-audit-profiles\") pod \"metrics-server-5f54f66665-cnc72\" (UID: \"b633136e-5c4d-430a-a6da-3c6756a71e29\") " pod="openshift-monitoring/metrics-server-5f54f66665-cnc72"
Jul 29 14:36:35.154681 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.154522    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b633136e-5c4d-430a-a6da-3c6756a71e29-secret-metrics-server-client-certs\") pod \"metrics-server-5f54f66665-cnc72\" (UID: \"b633136e-5c4d-430a-a6da-3c6756a71e29\") " pod="openshift-monitoring/metrics-server-5f54f66665-cnc72"
Jul 29 14:36:35.154681 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.154546    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scbqx\" (UniqueName: \"kubernetes.io/projected/b633136e-5c4d-430a-a6da-3c6756a71e29-kube-api-access-scbqx\") pod \"metrics-server-5f54f66665-cnc72\" (UID: \"b633136e-5c4d-430a-a6da-3c6756a71e29\") " pod="openshift-monitoring/metrics-server-5f54f66665-cnc72"
Jul 29 14:36:35.154681 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.154593    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b633136e-5c4d-430a-a6da-3c6756a71e29-secret-metrics-server-tls\") pod \"metrics-server-5f54f66665-cnc72\" (UID: \"b633136e-5c4d-430a-a6da-3c6756a71e29\") " pod="openshift-monitoring/metrics-server-5f54f66665-cnc72"
Jul 29 14:36:35.155661 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.155641    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5f54f66665-cnc72"]
Jul 29 14:36:35.188478 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.188207    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66c5b5dd6c-9ps6k"]
Jul 29 14:36:35.201659 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.201637    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66c5b5dd6c-9ps6k"
Jul 29 14:36:35.210603 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.210553    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66c5b5dd6c-9ps6k"]
Jul 29 14:36:35.215802 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.215784    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 29 14:36:35.255752 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.255719    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a30d2007-9f6a-414f-82af-e7edc96c3400-oauth-serving-cert\") pod \"console-66c5b5dd6c-9ps6k\" (UID: \"a30d2007-9f6a-414f-82af-e7edc96c3400\") " pod="openshift-console/console-66c5b5dd6c-9ps6k"
Jul 29 14:36:35.255878 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.255765    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b633136e-5c4d-430a-a6da-3c6756a71e29-secret-metrics-server-tls\") pod \"metrics-server-5f54f66665-cnc72\" (UID: \"b633136e-5c4d-430a-a6da-3c6756a71e29\") " pod="openshift-monitoring/metrics-server-5f54f66665-cnc72"
Jul 29 14:36:35.255878 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.255790    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a30d2007-9f6a-414f-82af-e7edc96c3400-console-config\") pod \"console-66c5b5dd6c-9ps6k\" (UID: \"a30d2007-9f6a-414f-82af-e7edc96c3400\") " pod="openshift-console/console-66c5b5dd6c-9ps6k"
Jul 29 14:36:35.255963 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.255909    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b633136e-5c4d-430a-a6da-3c6756a71e29-client-ca-bundle\") pod \"metrics-server-5f54f66665-cnc72\" (UID: \"b633136e-5c4d-430a-a6da-3c6756a71e29\") " pod="openshift-monitoring/metrics-server-5f54f66665-cnc72"
Jul 29 14:36:35.255963 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.255947    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a30d2007-9f6a-414f-82af-e7edc96c3400-console-serving-cert\") pod \"console-66c5b5dd6c-9ps6k\" (UID: \"a30d2007-9f6a-414f-82af-e7edc96c3400\") " pod="openshift-console/console-66c5b5dd6c-9ps6k"
Jul 29 14:36:35.256054 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.255972    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a30d2007-9f6a-414f-82af-e7edc96c3400-service-ca\") pod \"console-66c5b5dd6c-9ps6k\" (UID: \"a30d2007-9f6a-414f-82af-e7edc96c3400\") " pod="openshift-console/console-66c5b5dd6c-9ps6k"
Jul 29 14:36:35.256054 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.256014    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b633136e-5c4d-430a-a6da-3c6756a71e29-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f54f66665-cnc72\" (UID: \"b633136e-5c4d-430a-a6da-3c6756a71e29\") " pod="openshift-monitoring/metrics-server-5f54f66665-cnc72"
Jul 29 14:36:35.256054 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.256046    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b633136e-5c4d-430a-a6da-3c6756a71e29-audit-log\") pod \"metrics-server-5f54f66665-cnc72\" (UID: \"b633136e-5c4d-430a-a6da-3c6756a71e29\") " pod="openshift-monitoring/metrics-server-5f54f66665-cnc72"
Jul 29 14:36:35.256197 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.256071    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b633136e-5c4d-430a-a6da-3c6756a71e29-metrics-server-audit-profiles\") pod \"metrics-server-5f54f66665-cnc72\" (UID: \"b633136e-5c4d-430a-a6da-3c6756a71e29\") " pod="openshift-monitoring/metrics-server-5f54f66665-cnc72"
Jul 29 14:36:35.256197 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.256094    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a30d2007-9f6a-414f-82af-e7edc96c3400-console-oauth-config\") pod \"console-66c5b5dd6c-9ps6k\" (UID: \"a30d2007-9f6a-414f-82af-e7edc96c3400\") " pod="openshift-console/console-66c5b5dd6c-9ps6k"
Jul 29 14:36:35.256775 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.256370    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b633136e-5c4d-430a-a6da-3c6756a71e29-secret-metrics-server-client-certs\") pod \"metrics-server-5f54f66665-cnc72\" (UID: \"b633136e-5c4d-430a-a6da-3c6756a71e29\") " pod="openshift-monitoring/metrics-server-5f54f66665-cnc72"
Jul 29 14:36:35.256775 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.256408    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a30d2007-9f6a-414f-82af-e7edc96c3400-trusted-ca-bundle\") pod \"console-66c5b5dd6c-9ps6k\" (UID: \"a30d2007-9f6a-414f-82af-e7edc96c3400\") " pod="openshift-console/console-66c5b5dd6c-9ps6k"
Jul 29 14:36:35.256775 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.256443    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scbqx\" (UniqueName: \"kubernetes.io/projected/b633136e-5c4d-430a-a6da-3c6756a71e29-kube-api-access-scbqx\") pod \"metrics-server-5f54f66665-cnc72\" (UID: \"b633136e-5c4d-430a-a6da-3c6756a71e29\") " pod="openshift-monitoring/metrics-server-5f54f66665-cnc72"
Jul 29 14:36:35.256775 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.256476    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b633136e-5c4d-430a-a6da-3c6756a71e29-audit-log\") pod \"metrics-server-5f54f66665-cnc72\" (UID: \"b633136e-5c4d-430a-a6da-3c6756a71e29\") " pod="openshift-monitoring/metrics-server-5f54f66665-cnc72"
Jul 29 14:36:35.256775 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.256486    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrqlw\" (UniqueName: \"kubernetes.io/projected/a30d2007-9f6a-414f-82af-e7edc96c3400-kube-api-access-mrqlw\") pod \"console-66c5b5dd6c-9ps6k\" (UID: \"a30d2007-9f6a-414f-82af-e7edc96c3400\") " pod="openshift-console/console-66c5b5dd6c-9ps6k"
Jul 29 14:36:35.257117 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.256875    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b633136e-5c4d-430a-a6da-3c6756a71e29-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f54f66665-cnc72\" (UID: \"b633136e-5c4d-430a-a6da-3c6756a71e29\") " pod="openshift-monitoring/metrics-server-5f54f66665-cnc72"
Jul 29 14:36:35.257198 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.257180    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b633136e-5c4d-430a-a6da-3c6756a71e29-metrics-server-audit-profiles\") pod \"metrics-server-5f54f66665-cnc72\" (UID: \"b633136e-5c4d-430a-a6da-3c6756a71e29\") " pod="openshift-monitoring/metrics-server-5f54f66665-cnc72"
Jul 29 14:36:35.258637 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.258610    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b633136e-5c4d-430a-a6da-3c6756a71e29-secret-metrics-server-tls\") pod \"metrics-server-5f54f66665-cnc72\" (UID: \"b633136e-5c4d-430a-a6da-3c6756a71e29\") " pod="openshift-monitoring/metrics-server-5f54f66665-cnc72"
Jul 29 14:36:35.259648 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.259595    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b633136e-5c4d-430a-a6da-3c6756a71e29-secret-metrics-server-client-certs\") pod \"metrics-server-5f54f66665-cnc72\" (UID: \"b633136e-5c4d-430a-a6da-3c6756a71e29\") " pod="openshift-monitoring/metrics-server-5f54f66665-cnc72"
Jul 29 14:36:35.259648 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.259627    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b633136e-5c4d-430a-a6da-3c6756a71e29-client-ca-bundle\") pod \"metrics-server-5f54f66665-cnc72\" (UID: \"b633136e-5c4d-430a-a6da-3c6756a71e29\") " pod="openshift-monitoring/metrics-server-5f54f66665-cnc72"
Jul 29 14:36:35.269321 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.269298    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scbqx\" (UniqueName: \"kubernetes.io/projected/b633136e-5c4d-430a-a6da-3c6756a71e29-kube-api-access-scbqx\") pod \"metrics-server-5f54f66665-cnc72\" (UID: \"b633136e-5c4d-430a-a6da-3c6756a71e29\") " pod="openshift-monitoring/metrics-server-5f54f66665-cnc72"
Jul 29 14:36:35.357576 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.357544    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a30d2007-9f6a-414f-82af-e7edc96c3400-oauth-serving-cert\") pod \"console-66c5b5dd6c-9ps6k\" (UID: \"a30d2007-9f6a-414f-82af-e7edc96c3400\") " pod="openshift-console/console-66c5b5dd6c-9ps6k"
Jul 29 14:36:35.357738 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.357592    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a30d2007-9f6a-414f-82af-e7edc96c3400-console-config\") pod \"console-66c5b5dd6c-9ps6k\" (UID: \"a30d2007-9f6a-414f-82af-e7edc96c3400\") " pod="openshift-console/console-66c5b5dd6c-9ps6k"
Jul 29 14:36:35.357738 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.357638    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a30d2007-9f6a-414f-82af-e7edc96c3400-console-serving-cert\") pod \"console-66c5b5dd6c-9ps6k\" (UID: \"a30d2007-9f6a-414f-82af-e7edc96c3400\") " pod="openshift-console/console-66c5b5dd6c-9ps6k"
Jul 29 14:36:35.357738 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.357662    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a30d2007-9f6a-414f-82af-e7edc96c3400-service-ca\") pod \"console-66c5b5dd6c-9ps6k\" (UID: \"a30d2007-9f6a-414f-82af-e7edc96c3400\") " pod="openshift-console/console-66c5b5dd6c-9ps6k"
Jul 29 14:36:35.357738 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.357707    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a30d2007-9f6a-414f-82af-e7edc96c3400-console-oauth-config\") pod \"console-66c5b5dd6c-9ps6k\" (UID: \"a30d2007-9f6a-414f-82af-e7edc96c3400\") " pod="openshift-console/console-66c5b5dd6c-9ps6k"
Jul 29 14:36:35.357940 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.357750    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a30d2007-9f6a-414f-82af-e7edc96c3400-trusted-ca-bundle\") pod \"console-66c5b5dd6c-9ps6k\" (UID: \"a30d2007-9f6a-414f-82af-e7edc96c3400\") " pod="openshift-console/console-66c5b5dd6c-9ps6k"
Jul 29 14:36:35.357940 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.357787    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrqlw\" (UniqueName: \"kubernetes.io/projected/a30d2007-9f6a-414f-82af-e7edc96c3400-kube-api-access-mrqlw\") pod \"console-66c5b5dd6c-9ps6k\" (UID: \"a30d2007-9f6a-414f-82af-e7edc96c3400\") " pod="openshift-console/console-66c5b5dd6c-9ps6k"
Jul 29 14:36:35.358797 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.358773    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a30d2007-9f6a-414f-82af-e7edc96c3400-oauth-serving-cert\") pod \"console-66c5b5dd6c-9ps6k\" (UID: \"a30d2007-9f6a-414f-82af-e7edc96c3400\") " pod="openshift-console/console-66c5b5dd6c-9ps6k"
Jul 29 14:36:35.358977 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.358954    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a30d2007-9f6a-414f-82af-e7edc96c3400-service-ca\") pod \"console-66c5b5dd6c-9ps6k\" (UID: \"a30d2007-9f6a-414f-82af-e7edc96c3400\") " pod="openshift-console/console-66c5b5dd6c-9ps6k"
Jul 29 14:36:35.359425 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.359374    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a30d2007-9f6a-414f-82af-e7edc96c3400-trusted-ca-bundle\") pod \"console-66c5b5dd6c-9ps6k\" (UID: \"a30d2007-9f6a-414f-82af-e7edc96c3400\") " pod="openshift-console/console-66c5b5dd6c-9ps6k"
Jul 29 14:36:35.359425 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.359380    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a30d2007-9f6a-414f-82af-e7edc96c3400-console-config\") pod \"console-66c5b5dd6c-9ps6k\" (UID: \"a30d2007-9f6a-414f-82af-e7edc96c3400\") " pod="openshift-console/console-66c5b5dd6c-9ps6k"
Jul 29 14:36:35.362178 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.362138    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a30d2007-9f6a-414f-82af-e7edc96c3400-console-oauth-config\") pod \"console-66c5b5dd6c-9ps6k\" (UID: \"a30d2007-9f6a-414f-82af-e7edc96c3400\") " pod="openshift-console/console-66c5b5dd6c-9ps6k"
Jul 29 14:36:35.363910 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.363871    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a30d2007-9f6a-414f-82af-e7edc96c3400-console-serving-cert\") pod \"console-66c5b5dd6c-9ps6k\" (UID: \"a30d2007-9f6a-414f-82af-e7edc96c3400\") " pod="openshift-console/console-66c5b5dd6c-9ps6k"
Jul 29 14:36:35.367507 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.367467    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrqlw\" (UniqueName: \"kubernetes.io/projected/a30d2007-9f6a-414f-82af-e7edc96c3400-kube-api-access-mrqlw\") pod \"console-66c5b5dd6c-9ps6k\" (UID: \"a30d2007-9f6a-414f-82af-e7edc96c3400\") " pod="openshift-console/console-66c5b5dd6c-9ps6k"
Jul 29 14:36:35.449492 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.449419    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5f54f66665-cnc72"
Jul 29 14:36:35.517617 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:35.517588    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66c5b5dd6c-9ps6k"
Jul 29 14:36:36.858007 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:36.857936    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66c5b5dd6c-9ps6k"]
Jul 29 14:36:36.886218 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:36.886191    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74584c6658-6vdwd"
Jul 29 14:36:36.887440 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:36.887421    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74584c6658-6vdwd"
Jul 29 14:36:36.894697 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:36.894513    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5f54f66665-cnc72"]
Jul 29 14:36:36.908301 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:36.898226    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74584c6658-6vdwd"
Jul 29 14:36:36.908301 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:36:36.906138    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb633136e_5c4d_430a_a6da_3c6756a71e29.slice/crio-af31a86c72c87c02ee783ecfbd5c3ad107d74ae1f7e7e2df693218152a469c71 WatchSource:0}: Error finding container af31a86c72c87c02ee783ecfbd5c3ad107d74ae1f7e7e2df693218152a469c71: Status 404 returned error can't find the container with id af31a86c72c87c02ee783ecfbd5c3ad107d74ae1f7e7e2df693218152a469c71
Jul 29 14:36:37.117518 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.116156    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 14:36:37.121563 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.121537    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.125325 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.125230    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 29 14:36:37.125458 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.125342    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 29 14:36:37.125664 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.125642    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-x7wvq\""
Jul 29 14:36:37.125915 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.125756    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6rrbenv8nglhb\""
Jul 29 14:36:37.126074 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.125977    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 29 14:36:37.126128 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.126090    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 29 14:36:37.126185 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.126158    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 29 14:36:37.128276 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.128201    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 29 14:36:37.128276 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.128220    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 29 14:36:37.128439 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.128334    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 29 14:36:37.128494 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.128443    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 29 14:36:37.128769 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.128535    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 29 14:36:37.128769 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.128443    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 29 14:36:37.128769 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.128671    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 29 14:36:37.134265 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.133808    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 29 14:36:37.137287 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.137189    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 14:36:37.140277 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.139384    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 29 14:36:37.178475 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.178442    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-config\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.178611 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.178483    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.178611 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.178515    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/85529c21-3161-455b-a3cc-7f5a981a9ebc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.178611 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.178540    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.178611 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.178568    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85529c21-3161-455b-a3cc-7f5a981a9ebc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.178611 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.178593    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.178752 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.178619    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/85529c21-3161-455b-a3cc-7f5a981a9ebc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.178752 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.178648    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/85529c21-3161-455b-a3cc-7f5a981a9ebc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.178752 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.178671    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/85529c21-3161-455b-a3cc-7f5a981a9ebc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.178752 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.178699    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/85529c21-3161-455b-a3cc-7f5a981a9ebc-config-out\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.178752 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.178721    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.178884 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.178754    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.178884 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.178796    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.178884 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.178830    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.178884 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.178852    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85529c21-3161-455b-a3cc-7f5a981a9ebc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.178884 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.178875    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85529c21-3161-455b-a3cc-7f5a981a9ebc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.179063 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.178901    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx9cf\" (UniqueName: \"kubernetes.io/projected/85529c21-3161-455b-a3cc-7f5a981a9ebc-kube-api-access-tx9cf\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.179063 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.178926    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85529c21-3161-455b-a3cc-7f5a981a9ebc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.179063 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.178957    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/85529c21-3161-455b-a3cc-7f5a981a9ebc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.179063 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.178978    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-web-config\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.279722 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.279683    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-config\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.279908 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.279729    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.279908 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.279759    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/85529c21-3161-455b-a3cc-7f5a981a9ebc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.279908 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.279782    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.279908 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.279814    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85529c21-3161-455b-a3cc-7f5a981a9ebc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.279908 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.279836    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.279908 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.279853    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/85529c21-3161-455b-a3cc-7f5a981a9ebc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.279908 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.279873    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/85529c21-3161-455b-a3cc-7f5a981a9ebc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.279908 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.279887    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/85529c21-3161-455b-a3cc-7f5a981a9ebc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.279908 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.279906    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/85529c21-3161-455b-a3cc-7f5a981a9ebc-config-out\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.280334 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.279919    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.280334 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.279940    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.280334 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.279973    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.280334 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.279998    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.280334 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.280013    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85529c21-3161-455b-a3cc-7f5a981a9ebc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.280334 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.280033    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85529c21-3161-455b-a3cc-7f5a981a9ebc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.280334 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.280054    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx9cf\" (UniqueName: \"kubernetes.io/projected/85529c21-3161-455b-a3cc-7f5a981a9ebc-kube-api-access-tx9cf\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.280334 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.280069    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85529c21-3161-455b-a3cc-7f5a981a9ebc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.280334 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.280089    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/85529c21-3161-455b-a3cc-7f5a981a9ebc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.280334 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.280104    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-web-config\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.280963 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.280940    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85529c21-3161-455b-a3cc-7f5a981a9ebc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.282891 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.281353    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85529c21-3161-455b-a3cc-7f5a981a9ebc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.282891 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.281669    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85529c21-3161-455b-a3cc-7f5a981a9ebc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.282891 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.282470    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/85529c21-3161-455b-a3cc-7f5a981a9ebc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.282891 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.282564    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/85529c21-3161-455b-a3cc-7f5a981a9ebc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.283201 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.282986    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/85529c21-3161-455b-a3cc-7f5a981a9ebc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.283617 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.283593    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85529c21-3161-455b-a3cc-7f5a981a9ebc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.285033 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.285005    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/85529c21-3161-455b-a3cc-7f5a981a9ebc-config-out\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.285507 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.285467    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-config\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.285635 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.285613    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.285945 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.285924    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-web-config\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.286025 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.285990    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.286108 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.286085    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.286280 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.286261    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.287882 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.286897    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.288337 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.288296    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.288421 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.288377    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/85529c21-3161-455b-a3cc-7f5a981a9ebc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.289165 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.289126    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.289767 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.289718    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/85529c21-3161-455b-a3cc-7f5a981a9ebc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.291370 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.291332    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx9cf\" (UniqueName: \"kubernetes.io/projected/85529c21-3161-455b-a3cc-7f5a981a9ebc-kube-api-access-tx9cf\") pod \"prometheus-k8s-0\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.441080 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.440942    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:37.595731 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.595694    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69c4bf449-6w46j" event={"ID":"0575e2d0-cace-4000-b93c-f3cddbf2fbc1","Type":"ContainerStarted","Data":"6772e34d051708db75eb3913e8a3d8bb7a1faedd6971f25e8da9dffd17025b1f"}
Jul 29 14:36:37.595903 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.595812    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69c4bf449-6w46j" event={"ID":"0575e2d0-cace-4000-b93c-f3cddbf2fbc1","Type":"ContainerStarted","Data":"37f2df778aa3fa7ce79c2151ece3ca7bd635273e490201a6aa95ae8a6e7eedf9"}
Jul 29 14:36:37.595903 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.595863    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69c4bf449-6w46j" event={"ID":"0575e2d0-cace-4000-b93c-f3cddbf2fbc1","Type":"ContainerStarted","Data":"05123276c2a484a0fdaea328f7d61cb48c8bba920361f49bb98ba100019b9f69"}
Jul 29 14:36:37.598621 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.598070    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6mrz9" event={"ID":"3d750720-77d3-457c-91d0-a8638d494329","Type":"ContainerStarted","Data":"7c3433319f981c29650d515d4eefe26f7f15ffa493bddddba665a41a5ae9cb95"}
Jul 29 14:36:37.598621 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.598117    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6mrz9" event={"ID":"3d750720-77d3-457c-91d0-a8638d494329","Type":"ContainerStarted","Data":"8bae27d2d0f3c19c38862301494b8cd1f714c8be92ff3f05c6885712befdc1fc"}
Jul 29 14:36:37.601653 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.601602    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66c5b5dd6c-9ps6k" event={"ID":"a30d2007-9f6a-414f-82af-e7edc96c3400","Type":"ContainerStarted","Data":"1c30a568ffc329d341e1b124fec53f90256be04e99e2810f8b816d90781b97d5"}
Jul 29 14:36:37.601653 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.601642    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66c5b5dd6c-9ps6k" event={"ID":"a30d2007-9f6a-414f-82af-e7edc96c3400","Type":"ContainerStarted","Data":"016154290f6b031f590894d9f34ec06da5900920efe5efa04ebec1102ed39821"}
Jul 29 14:36:37.605137 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.604616    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5f54f66665-cnc72" event={"ID":"b633136e-5c4d-430a-a6da-3c6756a71e29","Type":"ContainerStarted","Data":"af31a86c72c87c02ee783ecfbd5c3ad107d74ae1f7e7e2df693218152a469c71"}
Jul 29 14:36:37.609923 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.609900    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74584c6658-6vdwd"
Jul 29 14:36:37.614714 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.614668    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6mrz9" podStartSLOduration=67.222602236 podStartE2EDuration="1m9.614651644s" totalImagesPullingTime="2.392049408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 14:35:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 14:36:37.614199138 +0000 UTC m=+69.916665746" watchObservedRunningTime="2026-07-29 14:36:37.614651644 +0000 UTC m=+69.917118253"
Jul 29 14:36:37.655445 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:37.655331    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66c5b5dd6c-9ps6k" podStartSLOduration=2.655315194 podStartE2EDuration="2.655315194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 14:36:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 14:36:37.654795759 +0000 UTC m=+69.957262368" watchObservedRunningTime="2026-07-29 14:36:37.655315194 +0000 UTC m=+69.957781803"
Jul 29 14:36:39.989542 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:39.989416    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 14:36:39.991274 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:36:39.991226    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85529c21_3161_455b_a3cc_7f5a981a9ebc.slice/crio-e93d8ba1bd18c58dc81b9dfe1696ebe00d92a1473a8391f1d4ae5fc4d13e3f79 WatchSource:0}: Error finding container e93d8ba1bd18c58dc81b9dfe1696ebe00d92a1473a8391f1d4ae5fc4d13e3f79: Status 404 returned error can't find the container with id e93d8ba1bd18c58dc81b9dfe1696ebe00d92a1473a8391f1d4ae5fc4d13e3f79
Jul 29 14:36:40.624122 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:40.624072    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69c4bf449-6w46j" event={"ID":"0575e2d0-cace-4000-b93c-f3cddbf2fbc1","Type":"ContainerStarted","Data":"1bdc2b6a23f2f85133ff6629a5d5f3eb6d234ab0b586ca04282fb36043a1c3d1"}
Jul 29 14:36:40.624320 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:40.624162    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69c4bf449-6w46j" event={"ID":"0575e2d0-cace-4000-b93c-f3cddbf2fbc1","Type":"ContainerStarted","Data":"783b0b7199dd5f61b8d555becad68d8d8ae6f448ef5fe5fdca263c515333c0d3"}
Jul 29 14:36:40.624320 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:40.624203    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69c4bf449-6w46j" event={"ID":"0575e2d0-cace-4000-b93c-f3cddbf2fbc1","Type":"ContainerStarted","Data":"859d6f9f2752870eadc0c0291ca3a784c2643106564b9137bdf22a11586ac81b"}
Jul 29 14:36:40.624320 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:40.624263    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-69c4bf449-6w46j"
Jul 29 14:36:40.625649 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:40.625626    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nct6x" event={"ID":"c03c2192-7d27-4033-9f74-f91ae62dc072","Type":"ContainerStarted","Data":"0d36421e59278e960d53d9eadc799df220ab202892cea3fa41e59b5746f6169c"}
Jul 29 14:36:40.625768 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:40.625751    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nct6x"
Jul 29 14:36:40.627187 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:40.627160    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2vpqw" event={"ID":"a331e3af-23b3-4dd4-a427-8b1a93f9441c","Type":"ContainerStarted","Data":"65f556582dd92729f85e4b2ffb6eebc23a1affbad7e890ca829f58971c981595"}
Jul 29 14:36:40.628344 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:40.628321    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85529c21-3161-455b-a3cc-7f5a981a9ebc","Type":"ContainerStarted","Data":"e93d8ba1bd18c58dc81b9dfe1696ebe00d92a1473a8391f1d4ae5fc4d13e3f79"}
Jul 29 14:36:40.659079 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:40.658881    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-69c4bf449-6w46j" podStartSLOduration=2.357163712 podStartE2EDuration="8.65886603s" totalImagesPullingTime="6.301702318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 14:36:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 14:36:40.657130157 +0000 UTC m=+72.959596765" watchObservedRunningTime="2026-07-29 14:36:40.65886603 +0000 UTC m=+72.961332637"
Jul 29 14:36:40.679545 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:40.679504    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nct6x" podStartSLOduration=67.200845312 podStartE2EDuration="1m12.679490969s" totalImagesPullingTime="5.478645657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 14:35:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 14:36:40.679017203 +0000 UTC m=+72.981483811" watchObservedRunningTime="2026-07-29 14:36:40.679490969 +0000 UTC m=+72.981957578"
Jul 29 14:36:40.724518 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:40.724476    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2vpqw" podStartSLOduration=67.265940522 podStartE2EDuration="1m12.724458289s" totalImagesPullingTime="5.458517767s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 14:35:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 14:36:40.724122354 +0000 UTC m=+73.026588963" watchObservedRunningTime="2026-07-29 14:36:40.724458289 +0000 UTC m=+73.026924898"
Jul 29 14:36:41.234691 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:41.234661    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66c5b5dd6c-9ps6k"]
Jul 29 14:36:41.634353 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:41.634286    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5f54f66665-cnc72" event={"ID":"b633136e-5c4d-430a-a6da-3c6756a71e29","Type":"ContainerStarted","Data":"867a35488305d594e31d734f61048c785bdfb9c9f31dcd84d83864d3b3f5c339"}
Jul 29 14:36:41.641108 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:41.641088    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-69c4bf449-6w46j"
Jul 29 14:36:41.654691 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:41.654649    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5f54f66665-cnc72" podStartSLOduration=2.7530709399999997 podStartE2EDuration="6.654635573s" totalImagesPullingTime="3.901564633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 14:36:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 14:36:41.654323848 +0000 UTC m=+73.956790456" watchObservedRunningTime="2026-07-29 14:36:41.654635573 +0000 UTC m=+73.957102186"
Jul 29 14:36:42.638822 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:42.638792    2578 generic.go:356] "Generic (PLEG): container finished" podID="85529c21-3161-455b-a3cc-7f5a981a9ebc" containerID="5ea3e784cfe2df8d91ba10930b837a6bdd25efa543f7265daf8cd77bffa75f04" exitCode=0
Jul 29 14:36:42.639181 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:42.638881    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85529c21-3161-455b-a3cc-7f5a981a9ebc","Type":"ContainerDied","Data":"5ea3e784cfe2df8d91ba10930b837a6bdd25efa543f7265daf8cd77bffa75f04"}
Jul 29 14:36:45.518210 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:45.518172    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66c5b5dd6c-9ps6k"
Jul 29 14:36:46.665248 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:46.665202    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85529c21-3161-455b-a3cc-7f5a981a9ebc","Type":"ContainerStarted","Data":"d8093418714428053402a5b7b6e67e6dac6f2ba65480b4de192a375ca93bea6e"}
Jul 29 14:36:46.665610 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:46.665300    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85529c21-3161-455b-a3cc-7f5a981a9ebc","Type":"ContainerStarted","Data":"2e8b53e1b93249122c2c135712e5262304393c887859ae5f490382f06a40efae"}
Jul 29 14:36:46.665610 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:46.665340    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85529c21-3161-455b-a3cc-7f5a981a9ebc","Type":"ContainerStarted","Data":"4511957dc39c3b6a76fdcd16353334902f49e022c1f7a490f13ee821dbff75af"}
Jul 29 14:36:46.665610 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:46.665383    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85529c21-3161-455b-a3cc-7f5a981a9ebc","Type":"ContainerStarted","Data":"d7414b1fc521260eaffdf4b961b0fe2caf397049b400f732c9b40be7810ce747"}
Jul 29 14:36:46.665610 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:46.665423    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85529c21-3161-455b-a3cc-7f5a981a9ebc","Type":"ContainerStarted","Data":"81bc45227f15db84b4a3195c3688705e2214386dc771554beb598b8f6f944b2f"}
Jul 29 14:36:46.665610 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:46.665460    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85529c21-3161-455b-a3cc-7f5a981a9ebc","Type":"ContainerStarted","Data":"f7b391d5777be8e1802e467c4a359ed0a5228d4f058b334761cffc9cbdb6cfe1"}
Jul 29 14:36:46.700620 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:46.700569    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.240762549 podStartE2EDuration="9.700550025s" totalImagesPullingTime="5.44286498s" totalInitContainerRuntime="16.922496ms" isStatefulPod=false podCreationTimestamp="2026-07-29 14:36:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 14:36:46.698397423 +0000 UTC m=+79.000864031" watchObservedRunningTime="2026-07-29 14:36:46.700550025 +0000 UTC m=+79.003016631"
Jul 29 14:36:47.441406 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:47.441366    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:36:52.310684 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:52.310555    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74584c6658-6vdwd"]
Jul 29 14:36:55.450464 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:55.450437    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5f54f66665-cnc72"
Jul 29 14:36:55.450892 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:36:55.450498    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5f54f66665-cnc72"
Jul 29 14:37:06.252950 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:06.252912    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-66c5b5dd6c-9ps6k" podUID="a30d2007-9f6a-414f-82af-e7edc96c3400" containerName="console" containerID="cri-o://1c30a568ffc329d341e1b124fec53f90256be04e99e2810f8b816d90781b97d5" gracePeriod=15
Jul 29 14:37:06.492626 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:06.492603    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66c5b5dd6c-9ps6k"
Jul 29 14:37:06.625087 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:06.625022    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a30d2007-9f6a-414f-82af-e7edc96c3400-service-ca\") pod \"a30d2007-9f6a-414f-82af-e7edc96c3400\" (UID: \"a30d2007-9f6a-414f-82af-e7edc96c3400\") "
Jul 29 14:37:06.625087 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:06.625052    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a30d2007-9f6a-414f-82af-e7edc96c3400-console-serving-cert\") pod \"a30d2007-9f6a-414f-82af-e7edc96c3400\" (UID: \"a30d2007-9f6a-414f-82af-e7edc96c3400\") "
Jul 29 14:37:06.625087 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:06.625073    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a30d2007-9f6a-414f-82af-e7edc96c3400-console-oauth-config\") pod \"a30d2007-9f6a-414f-82af-e7edc96c3400\" (UID: \"a30d2007-9f6a-414f-82af-e7edc96c3400\") "
Jul 29 14:37:06.625345 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:06.625091    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a30d2007-9f6a-414f-82af-e7edc96c3400-console-config\") pod \"a30d2007-9f6a-414f-82af-e7edc96c3400\" (UID: \"a30d2007-9f6a-414f-82af-e7edc96c3400\") "
Jul 29 14:37:06.625345 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:06.625108    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrqlw\" (UniqueName: \"kubernetes.io/projected/a30d2007-9f6a-414f-82af-e7edc96c3400-kube-api-access-mrqlw\") pod \"a30d2007-9f6a-414f-82af-e7edc96c3400\" (UID: \"a30d2007-9f6a-414f-82af-e7edc96c3400\") "
Jul 29 14:37:06.625345 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:06.625162    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a30d2007-9f6a-414f-82af-e7edc96c3400-oauth-serving-cert\") pod \"a30d2007-9f6a-414f-82af-e7edc96c3400\" (UID: \"a30d2007-9f6a-414f-82af-e7edc96c3400\") "
Jul 29 14:37:06.625345 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:06.625211    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a30d2007-9f6a-414f-82af-e7edc96c3400-trusted-ca-bundle\") pod \"a30d2007-9f6a-414f-82af-e7edc96c3400\" (UID: \"a30d2007-9f6a-414f-82af-e7edc96c3400\") "
Jul 29 14:37:06.625577 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:06.625530    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a30d2007-9f6a-414f-82af-e7edc96c3400-service-ca" (OuterVolumeSpecName: "service-ca") pod "a30d2007-9f6a-414f-82af-e7edc96c3400" (UID: "a30d2007-9f6a-414f-82af-e7edc96c3400"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 14:37:06.625693 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:06.625592    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a30d2007-9f6a-414f-82af-e7edc96c3400-console-config" (OuterVolumeSpecName: "console-config") pod "a30d2007-9f6a-414f-82af-e7edc96c3400" (UID: "a30d2007-9f6a-414f-82af-e7edc96c3400"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 14:37:06.625693 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:06.625610    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a30d2007-9f6a-414f-82af-e7edc96c3400-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a30d2007-9f6a-414f-82af-e7edc96c3400" (UID: "a30d2007-9f6a-414f-82af-e7edc96c3400"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 14:37:06.625693 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:06.625664    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a30d2007-9f6a-414f-82af-e7edc96c3400-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a30d2007-9f6a-414f-82af-e7edc96c3400" (UID: "a30d2007-9f6a-414f-82af-e7edc96c3400"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 14:37:06.627301 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:06.627282    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a30d2007-9f6a-414f-82af-e7edc96c3400-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a30d2007-9f6a-414f-82af-e7edc96c3400" (UID: "a30d2007-9f6a-414f-82af-e7edc96c3400"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 14:37:06.627649 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:06.627629    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a30d2007-9f6a-414f-82af-e7edc96c3400-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a30d2007-9f6a-414f-82af-e7edc96c3400" (UID: "a30d2007-9f6a-414f-82af-e7edc96c3400"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 14:37:06.627708 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:06.627657    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a30d2007-9f6a-414f-82af-e7edc96c3400-kube-api-access-mrqlw" (OuterVolumeSpecName: "kube-api-access-mrqlw") pod "a30d2007-9f6a-414f-82af-e7edc96c3400" (UID: "a30d2007-9f6a-414f-82af-e7edc96c3400"). InnerVolumeSpecName "kube-api-access-mrqlw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 14:37:06.726083 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:06.726058    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a30d2007-9f6a-414f-82af-e7edc96c3400-oauth-serving-cert\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:37:06.726083 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:06.726082    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a30d2007-9f6a-414f-82af-e7edc96c3400-trusted-ca-bundle\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:37:06.726214 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:06.726096    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a30d2007-9f6a-414f-82af-e7edc96c3400-service-ca\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:37:06.726214 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:06.726109    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a30d2007-9f6a-414f-82af-e7edc96c3400-console-serving-cert\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:37:06.726214 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:06.726120    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a30d2007-9f6a-414f-82af-e7edc96c3400-console-oauth-config\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:37:06.726214 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:06.726133    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a30d2007-9f6a-414f-82af-e7edc96c3400-console-config\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:37:06.726214 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:06.726145    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrqlw\" (UniqueName: \"kubernetes.io/projected/a30d2007-9f6a-414f-82af-e7edc96c3400-kube-api-access-mrqlw\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:37:06.739256 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:06.739211    2578 generic.go:356] "Generic (PLEG): container finished" podID="a30d2007-9f6a-414f-82af-e7edc96c3400" containerID="1c30a568ffc329d341e1b124fec53f90256be04e99e2810f8b816d90781b97d5" exitCode=0
Jul 29 14:37:06.739357 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:06.739283    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66c5b5dd6c-9ps6k"
Jul 29 14:37:06.739418 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:06.739283    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66c5b5dd6c-9ps6k" event={"ID":"a30d2007-9f6a-414f-82af-e7edc96c3400","Type":"ContainerDied","Data":"1c30a568ffc329d341e1b124fec53f90256be04e99e2810f8b816d90781b97d5"}
Jul 29 14:37:06.739418 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:06.739395    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66c5b5dd6c-9ps6k" event={"ID":"a30d2007-9f6a-414f-82af-e7edc96c3400","Type":"ContainerDied","Data":"016154290f6b031f590894d9f34ec06da5900920efe5efa04ebec1102ed39821"}
Jul 29 14:37:06.739418 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:06.739415    2578 scope.go:117] "RemoveContainer" containerID="1c30a568ffc329d341e1b124fec53f90256be04e99e2810f8b816d90781b97d5"
Jul 29 14:37:06.747466 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:06.747448    2578 scope.go:117] "RemoveContainer" containerID="1c30a568ffc329d341e1b124fec53f90256be04e99e2810f8b816d90781b97d5"
Jul 29 14:37:06.747702 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:37:06.747684    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c30a568ffc329d341e1b124fec53f90256be04e99e2810f8b816d90781b97d5\": container with ID starting with 1c30a568ffc329d341e1b124fec53f90256be04e99e2810f8b816d90781b97d5 not found: ID does not exist" containerID="1c30a568ffc329d341e1b124fec53f90256be04e99e2810f8b816d90781b97d5"
Jul 29 14:37:06.747764 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:06.747714    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c30a568ffc329d341e1b124fec53f90256be04e99e2810f8b816d90781b97d5"} err="failed to get container status \"1c30a568ffc329d341e1b124fec53f90256be04e99e2810f8b816d90781b97d5\": rpc error: code = NotFound desc = could not find container \"1c30a568ffc329d341e1b124fec53f90256be04e99e2810f8b816d90781b97d5\": container with ID starting with 1c30a568ffc329d341e1b124fec53f90256be04e99e2810f8b816d90781b97d5 not found: ID does not exist"
Jul 29 14:37:06.760956 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:06.760934    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66c5b5dd6c-9ps6k"]
Jul 29 14:37:06.765016 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:06.764996    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66c5b5dd6c-9ps6k"]
Jul 29 14:37:08.280456 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:08.278374    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a30d2007-9f6a-414f-82af-e7edc96c3400" path="/var/lib/kubelet/pods/a30d2007-9f6a-414f-82af-e7edc96c3400/volumes"
Jul 29 14:37:11.636853 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:11.636822    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nct6x"
Jul 29 14:37:15.454985 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:15.454954    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5f54f66665-cnc72"
Jul 29 14:37:15.458653 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:15.458623    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5f54f66665-cnc72"
Jul 29 14:37:17.329229 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:17.329157    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-74584c6658-6vdwd" podUID="25d3846d-f20e-402d-b546-6713b6ac235d" containerName="console" containerID="cri-o://bc20afc385b925fc6b6cd34460a2f2a35d877aaa24a6ca1f91fe52c4c88dfd5d" gracePeriod=15
Jul 29 14:37:17.588906 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:17.588852    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74584c6658-6vdwd"
Jul 29 14:37:17.613616 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:17.613578    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnnc8\" (UniqueName: \"kubernetes.io/projected/25d3846d-f20e-402d-b546-6713b6ac235d-kube-api-access-wnnc8\") pod \"25d3846d-f20e-402d-b546-6713b6ac235d\" (UID: \"25d3846d-f20e-402d-b546-6713b6ac235d\") "
Jul 29 14:37:17.613779 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:17.613640    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25d3846d-f20e-402d-b546-6713b6ac235d-oauth-serving-cert\") pod \"25d3846d-f20e-402d-b546-6713b6ac235d\" (UID: \"25d3846d-f20e-402d-b546-6713b6ac235d\") "
Jul 29 14:37:17.613779 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:17.613694    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25d3846d-f20e-402d-b546-6713b6ac235d-service-ca\") pod \"25d3846d-f20e-402d-b546-6713b6ac235d\" (UID: \"25d3846d-f20e-402d-b546-6713b6ac235d\") "
Jul 29 14:37:17.613779 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:17.613717    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25d3846d-f20e-402d-b546-6713b6ac235d-console-serving-cert\") pod \"25d3846d-f20e-402d-b546-6713b6ac235d\" (UID: \"25d3846d-f20e-402d-b546-6713b6ac235d\") "
Jul 29 14:37:17.613779 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:17.613748    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25d3846d-f20e-402d-b546-6713b6ac235d-console-oauth-config\") pod \"25d3846d-f20e-402d-b546-6713b6ac235d\" (UID: \"25d3846d-f20e-402d-b546-6713b6ac235d\") "
Jul 29 14:37:17.613980 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:17.613798    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25d3846d-f20e-402d-b546-6713b6ac235d-console-config\") pod \"25d3846d-f20e-402d-b546-6713b6ac235d\" (UID: \"25d3846d-f20e-402d-b546-6713b6ac235d\") "
Jul 29 14:37:17.614336 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:17.614304    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25d3846d-f20e-402d-b546-6713b6ac235d-console-config" (OuterVolumeSpecName: "console-config") pod "25d3846d-f20e-402d-b546-6713b6ac235d" (UID: "25d3846d-f20e-402d-b546-6713b6ac235d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 14:37:17.615211 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:17.614914    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25d3846d-f20e-402d-b546-6713b6ac235d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "25d3846d-f20e-402d-b546-6713b6ac235d" (UID: "25d3846d-f20e-402d-b546-6713b6ac235d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 14:37:17.615211 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:17.614933    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25d3846d-f20e-402d-b546-6713b6ac235d-service-ca" (OuterVolumeSpecName: "service-ca") pod "25d3846d-f20e-402d-b546-6713b6ac235d" (UID: "25d3846d-f20e-402d-b546-6713b6ac235d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 14:37:17.617769 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:17.617732    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25d3846d-f20e-402d-b546-6713b6ac235d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "25d3846d-f20e-402d-b546-6713b6ac235d" (UID: "25d3846d-f20e-402d-b546-6713b6ac235d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 14:37:17.617997 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:17.617887    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25d3846d-f20e-402d-b546-6713b6ac235d-kube-api-access-wnnc8" (OuterVolumeSpecName: "kube-api-access-wnnc8") pod "25d3846d-f20e-402d-b546-6713b6ac235d" (UID: "25d3846d-f20e-402d-b546-6713b6ac235d"). InnerVolumeSpecName "kube-api-access-wnnc8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 14:37:17.617997 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:17.617913    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25d3846d-f20e-402d-b546-6713b6ac235d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "25d3846d-f20e-402d-b546-6713b6ac235d" (UID: "25d3846d-f20e-402d-b546-6713b6ac235d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 14:37:17.714620 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:17.714492    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25d3846d-f20e-402d-b546-6713b6ac235d-console-config\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:37:17.714620 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:17.714525    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnnc8\" (UniqueName: \"kubernetes.io/projected/25d3846d-f20e-402d-b546-6713b6ac235d-kube-api-access-wnnc8\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:37:17.714620 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:17.714540    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25d3846d-f20e-402d-b546-6713b6ac235d-oauth-serving-cert\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:37:17.714620 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:17.714553    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25d3846d-f20e-402d-b546-6713b6ac235d-service-ca\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:37:17.714620 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:17.714566    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25d3846d-f20e-402d-b546-6713b6ac235d-console-serving-cert\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:37:17.714620 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:17.714580    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25d3846d-f20e-402d-b546-6713b6ac235d-console-oauth-config\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:37:17.787137 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:17.787098    2578 generic.go:356] "Generic (PLEG): container finished" podID="25d3846d-f20e-402d-b546-6713b6ac235d" containerID="bc20afc385b925fc6b6cd34460a2f2a35d877aaa24a6ca1f91fe52c4c88dfd5d" exitCode=0
Jul 29 14:37:17.787339 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:17.787184    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74584c6658-6vdwd" event={"ID":"25d3846d-f20e-402d-b546-6713b6ac235d","Type":"ContainerDied","Data":"bc20afc385b925fc6b6cd34460a2f2a35d877aaa24a6ca1f91fe52c4c88dfd5d"}
Jul 29 14:37:17.787339 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:17.787229    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74584c6658-6vdwd" event={"ID":"25d3846d-f20e-402d-b546-6713b6ac235d","Type":"ContainerDied","Data":"eddc88e2e9155ad93d2ceec880b39159f7b7363169893dffed9a7370168362d2"}
Jul 29 14:37:17.787339 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:17.787273    2578 scope.go:117] "RemoveContainer" containerID="bc20afc385b925fc6b6cd34460a2f2a35d877aaa24a6ca1f91fe52c4c88dfd5d"
Jul 29 14:37:17.787480 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:17.787429    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74584c6658-6vdwd"
Jul 29 14:37:17.802774 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:17.802752    2578 scope.go:117] "RemoveContainer" containerID="bc20afc385b925fc6b6cd34460a2f2a35d877aaa24a6ca1f91fe52c4c88dfd5d"
Jul 29 14:37:17.803035 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:37:17.803016    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc20afc385b925fc6b6cd34460a2f2a35d877aaa24a6ca1f91fe52c4c88dfd5d\": container with ID starting with bc20afc385b925fc6b6cd34460a2f2a35d877aaa24a6ca1f91fe52c4c88dfd5d not found: ID does not exist" containerID="bc20afc385b925fc6b6cd34460a2f2a35d877aaa24a6ca1f91fe52c4c88dfd5d"
Jul 29 14:37:17.803107 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:17.803049    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc20afc385b925fc6b6cd34460a2f2a35d877aaa24a6ca1f91fe52c4c88dfd5d"} err="failed to get container status \"bc20afc385b925fc6b6cd34460a2f2a35d877aaa24a6ca1f91fe52c4c88dfd5d\": rpc error: code = NotFound desc = could not find container \"bc20afc385b925fc6b6cd34460a2f2a35d877aaa24a6ca1f91fe52c4c88dfd5d\": container with ID starting with bc20afc385b925fc6b6cd34460a2f2a35d877aaa24a6ca1f91fe52c4c88dfd5d not found: ID does not exist"
Jul 29 14:37:17.811920 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:17.811897    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74584c6658-6vdwd"]
Jul 29 14:37:17.816025 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:17.816002    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74584c6658-6vdwd"]
Jul 29 14:37:18.279964 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:18.279921    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25d3846d-f20e-402d-b546-6713b6ac235d" path="/var/lib/kubelet/pods/25d3846d-f20e-402d-b546-6713b6ac235d/volumes"
Jul 29 14:37:37.441719 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:37.441672    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:37.460450 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:37.460422    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:37.874393 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:37.874358    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:55.363412 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.363379    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 14:37:55.363920 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.363671    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="85529c21-3161-455b-a3cc-7f5a981a9ebc" containerName="prometheus" containerID="cri-o://f7b391d5777be8e1802e467c4a359ed0a5228d4f058b334761cffc9cbdb6cfe1" gracePeriod=600
Jul 29 14:37:55.363920 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.363710    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="85529c21-3161-455b-a3cc-7f5a981a9ebc" containerName="thanos-sidecar" containerID="cri-o://d7414b1fc521260eaffdf4b961b0fe2caf397049b400f732c9b40be7810ce747" gracePeriod=600
Jul 29 14:37:55.363920 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.363734    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="85529c21-3161-455b-a3cc-7f5a981a9ebc" containerName="kube-rbac-proxy-thanos" containerID="cri-o://d8093418714428053402a5b7b6e67e6dac6f2ba65480b4de192a375ca93bea6e" gracePeriod=600
Jul 29 14:37:55.363920 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.363704    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="85529c21-3161-455b-a3cc-7f5a981a9ebc" containerName="kube-rbac-proxy" containerID="cri-o://2e8b53e1b93249122c2c135712e5262304393c887859ae5f490382f06a40efae" gracePeriod=600
Jul 29 14:37:55.363920 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.363761    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="85529c21-3161-455b-a3cc-7f5a981a9ebc" containerName="config-reloader" containerID="cri-o://81bc45227f15db84b4a3195c3688705e2214386dc771554beb598b8f6f944b2f" gracePeriod=600
Jul 29 14:37:55.363920 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.363756    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="85529c21-3161-455b-a3cc-7f5a981a9ebc" containerName="kube-rbac-proxy-web" containerID="cri-o://4511957dc39c3b6a76fdcd16353334902f49e022c1f7a490f13ee821dbff75af" gracePeriod=600
Jul 29 14:37:55.616761 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.616693    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:55.701327 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.701293    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-secret-metrics-client-certs\") pod \"85529c21-3161-455b-a3cc-7f5a981a9ebc\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") "
Jul 29 14:37:55.701327 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.701334    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/85529c21-3161-455b-a3cc-7f5a981a9ebc-prometheus-k8s-rulefiles-1\") pod \"85529c21-3161-455b-a3cc-7f5a981a9ebc\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") "
Jul 29 14:37:55.701548 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.701352    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-secret-prometheus-k8s-tls\") pod \"85529c21-3161-455b-a3cc-7f5a981a9ebc\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") "
Jul 29 14:37:55.701548 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.701479    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"85529c21-3161-455b-a3cc-7f5a981a9ebc\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") "
Jul 29 14:37:55.701548 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.701519    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/85529c21-3161-455b-a3cc-7f5a981a9ebc-tls-assets\") pod \"85529c21-3161-455b-a3cc-7f5a981a9ebc\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") "
Jul 29 14:37:55.701698 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.701546    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-secret-kube-rbac-proxy\") pod \"85529c21-3161-455b-a3cc-7f5a981a9ebc\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") "
Jul 29 14:37:55.701698 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.701577    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-thanos-prometheus-http-client-file\") pod \"85529c21-3161-455b-a3cc-7f5a981a9ebc\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") "
Jul 29 14:37:55.701698 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.701610    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tx9cf\" (UniqueName: \"kubernetes.io/projected/85529c21-3161-455b-a3cc-7f5a981a9ebc-kube-api-access-tx9cf\") pod \"85529c21-3161-455b-a3cc-7f5a981a9ebc\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") "
Jul 29 14:37:55.701698 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.701646    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85529c21-3161-455b-a3cc-7f5a981a9ebc-configmap-serving-certs-ca-bundle\") pod \"85529c21-3161-455b-a3cc-7f5a981a9ebc\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") "
Jul 29 14:37:55.701698 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.701669    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/85529c21-3161-455b-a3cc-7f5a981a9ebc-prometheus-k8s-db\") pod \"85529c21-3161-455b-a3cc-7f5a981a9ebc\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") "
Jul 29 14:37:55.702006 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.701690    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85529c21-3161-455b-a3cc-7f5a981a9ebc-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "85529c21-3161-455b-a3cc-7f5a981a9ebc" (UID: "85529c21-3161-455b-a3cc-7f5a981a9ebc"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 14:37:55.702006 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.701708    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/85529c21-3161-455b-a3cc-7f5a981a9ebc-config-out\") pod \"85529c21-3161-455b-a3cc-7f5a981a9ebc\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") "
Jul 29 14:37:55.702006 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.701736    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/85529c21-3161-455b-a3cc-7f5a981a9ebc-prometheus-k8s-rulefiles-2\") pod \"85529c21-3161-455b-a3cc-7f5a981a9ebc\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") "
Jul 29 14:37:55.702006 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.701767    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/85529c21-3161-455b-a3cc-7f5a981a9ebc-prometheus-k8s-rulefiles-0\") pod \"85529c21-3161-455b-a3cc-7f5a981a9ebc\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") "
Jul 29 14:37:55.702006 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.701810    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-config\") pod \"85529c21-3161-455b-a3cc-7f5a981a9ebc\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") "
Jul 29 14:37:55.702006 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.701870    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"85529c21-3161-455b-a3cc-7f5a981a9ebc\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") "
Jul 29 14:37:55.702006 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.701894    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-secret-grpc-tls\") pod \"85529c21-3161-455b-a3cc-7f5a981a9ebc\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") "
Jul 29 14:37:55.702006 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.701923    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85529c21-3161-455b-a3cc-7f5a981a9ebc-configmap-kubelet-serving-ca-bundle\") pod \"85529c21-3161-455b-a3cc-7f5a981a9ebc\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") "
Jul 29 14:37:55.702006 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.701953    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85529c21-3161-455b-a3cc-7f5a981a9ebc-prometheus-trusted-ca-bundle\") pod \"85529c21-3161-455b-a3cc-7f5a981a9ebc\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") "
Jul 29 14:37:55.702006 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.701981    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85529c21-3161-455b-a3cc-7f5a981a9ebc-configmap-metrics-client-ca\") pod \"85529c21-3161-455b-a3cc-7f5a981a9ebc\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") "
Jul 29 14:37:55.702006 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.702007    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-web-config\") pod \"85529c21-3161-455b-a3cc-7f5a981a9ebc\" (UID: \"85529c21-3161-455b-a3cc-7f5a981a9ebc\") "
Jul 29 14:37:55.702555 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.702270    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/85529c21-3161-455b-a3cc-7f5a981a9ebc-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:37:55.705373 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.703004    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85529c21-3161-455b-a3cc-7f5a981a9ebc-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "85529c21-3161-455b-a3cc-7f5a981a9ebc" (UID: "85529c21-3161-455b-a3cc-7f5a981a9ebc"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 14:37:55.705373 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.704330    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85529c21-3161-455b-a3cc-7f5a981a9ebc-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "85529c21-3161-455b-a3cc-7f5a981a9ebc" (UID: "85529c21-3161-455b-a3cc-7f5a981a9ebc"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 14:37:55.705373 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.704343    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85529c21-3161-455b-a3cc-7f5a981a9ebc-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "85529c21-3161-455b-a3cc-7f5a981a9ebc" (UID: "85529c21-3161-455b-a3cc-7f5a981a9ebc"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 14:37:55.705373 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.704680    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85529c21-3161-455b-a3cc-7f5a981a9ebc-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "85529c21-3161-455b-a3cc-7f5a981a9ebc" (UID: "85529c21-3161-455b-a3cc-7f5a981a9ebc"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 14:37:55.705373 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.704783    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85529c21-3161-455b-a3cc-7f5a981a9ebc-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "85529c21-3161-455b-a3cc-7f5a981a9ebc" (UID: "85529c21-3161-455b-a3cc-7f5a981a9ebc"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 14:37:55.705373 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.704904    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85529c21-3161-455b-a3cc-7f5a981a9ebc-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "85529c21-3161-455b-a3cc-7f5a981a9ebc" (UID: "85529c21-3161-455b-a3cc-7f5a981a9ebc"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 14:37:55.705373 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.705042    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85529c21-3161-455b-a3cc-7f5a981a9ebc-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "85529c21-3161-455b-a3cc-7f5a981a9ebc" (UID: "85529c21-3161-455b-a3cc-7f5a981a9ebc"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 14:37:55.705373 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.705282    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "85529c21-3161-455b-a3cc-7f5a981a9ebc" (UID: "85529c21-3161-455b-a3cc-7f5a981a9ebc"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 14:37:55.706190 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.706152    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "85529c21-3161-455b-a3cc-7f5a981a9ebc" (UID: "85529c21-3161-455b-a3cc-7f5a981a9ebc"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 14:37:55.706551 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.706513    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "85529c21-3161-455b-a3cc-7f5a981a9ebc" (UID: "85529c21-3161-455b-a3cc-7f5a981a9ebc"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 14:37:55.706821 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.706707    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "85529c21-3161-455b-a3cc-7f5a981a9ebc" (UID: "85529c21-3161-455b-a3cc-7f5a981a9ebc"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 14:37:55.706821 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.706802    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85529c21-3161-455b-a3cc-7f5a981a9ebc-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "85529c21-3161-455b-a3cc-7f5a981a9ebc" (UID: "85529c21-3161-455b-a3cc-7f5a981a9ebc"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 14:37:55.706957 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.706897    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "85529c21-3161-455b-a3cc-7f5a981a9ebc" (UID: "85529c21-3161-455b-a3cc-7f5a981a9ebc"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 14:37:55.707046 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.707013    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "85529c21-3161-455b-a3cc-7f5a981a9ebc" (UID: "85529c21-3161-455b-a3cc-7f5a981a9ebc"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 14:37:55.707174 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.707105    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "85529c21-3161-455b-a3cc-7f5a981a9ebc" (UID: "85529c21-3161-455b-a3cc-7f5a981a9ebc"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 14:37:55.707264 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.707199    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-config" (OuterVolumeSpecName: "config") pod "85529c21-3161-455b-a3cc-7f5a981a9ebc" (UID: "85529c21-3161-455b-a3cc-7f5a981a9ebc"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 14:37:55.707523 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.707498    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85529c21-3161-455b-a3cc-7f5a981a9ebc-kube-api-access-tx9cf" (OuterVolumeSpecName: "kube-api-access-tx9cf") pod "85529c21-3161-455b-a3cc-7f5a981a9ebc" (UID: "85529c21-3161-455b-a3cc-7f5a981a9ebc"). InnerVolumeSpecName "kube-api-access-tx9cf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 14:37:55.707874 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.707854    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85529c21-3161-455b-a3cc-7f5a981a9ebc-config-out" (OuterVolumeSpecName: "config-out") pod "85529c21-3161-455b-a3cc-7f5a981a9ebc" (UID: "85529c21-3161-455b-a3cc-7f5a981a9ebc"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 14:37:55.715459 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.715439    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-web-config" (OuterVolumeSpecName: "web-config") pod "85529c21-3161-455b-a3cc-7f5a981a9ebc" (UID: "85529c21-3161-455b-a3cc-7f5a981a9ebc"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 14:37:55.802868 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.802844    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/85529c21-3161-455b-a3cc-7f5a981a9ebc-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:37:55.802868 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.802866    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/85529c21-3161-455b-a3cc-7f5a981a9ebc-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:37:55.802980 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.802876    2578 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-config\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:37:55.802980 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.802886    2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:37:55.802980 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.802895    2578 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-secret-grpc-tls\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:37:55.802980 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.802904    2578 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85529c21-3161-455b-a3cc-7f5a981a9ebc-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:37:55.802980 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.802913    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85529c21-3161-455b-a3cc-7f5a981a9ebc-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:37:55.802980 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.802921    2578 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85529c21-3161-455b-a3cc-7f5a981a9ebc-configmap-metrics-client-ca\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:37:55.802980 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.802929    2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-web-config\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:37:55.802980 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.802936    2578 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-secret-metrics-client-certs\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:37:55.802980 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.802944    2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:37:55.802980 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.802952    2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:37:55.802980 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.802960    2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/85529c21-3161-455b-a3cc-7f5a981a9ebc-tls-assets\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:37:55.802980 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.802967    2578 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-secret-kube-rbac-proxy\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:37:55.802980 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.802975    2578 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/85529c21-3161-455b-a3cc-7f5a981a9ebc-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:37:55.802980 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.802982    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tx9cf\" (UniqueName: \"kubernetes.io/projected/85529c21-3161-455b-a3cc-7f5a981a9ebc-kube-api-access-tx9cf\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:37:55.803379 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.802990    2578 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85529c21-3161-455b-a3cc-7f5a981a9ebc-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:37:55.803379 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.802998    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/85529c21-3161-455b-a3cc-7f5a981a9ebc-prometheus-k8s-db\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:37:55.803379 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.803005    2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/85529c21-3161-455b-a3cc-7f5a981a9ebc-config-out\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:37:55.926435 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.926387    2578 generic.go:356] "Generic (PLEG): container finished" podID="85529c21-3161-455b-a3cc-7f5a981a9ebc" containerID="d8093418714428053402a5b7b6e67e6dac6f2ba65480b4de192a375ca93bea6e" exitCode=0
Jul 29 14:37:55.926435 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.926408    2578 generic.go:356] "Generic (PLEG): container finished" podID="85529c21-3161-455b-a3cc-7f5a981a9ebc" containerID="2e8b53e1b93249122c2c135712e5262304393c887859ae5f490382f06a40efae" exitCode=0
Jul 29 14:37:55.926435 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.926414    2578 generic.go:356] "Generic (PLEG): container finished" podID="85529c21-3161-455b-a3cc-7f5a981a9ebc" containerID="4511957dc39c3b6a76fdcd16353334902f49e022c1f7a490f13ee821dbff75af" exitCode=0
Jul 29 14:37:55.926435 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.926419    2578 generic.go:356] "Generic (PLEG): container finished" podID="85529c21-3161-455b-a3cc-7f5a981a9ebc" containerID="d7414b1fc521260eaffdf4b961b0fe2caf397049b400f732c9b40be7810ce747" exitCode=0
Jul 29 14:37:55.926435 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.926425    2578 generic.go:356] "Generic (PLEG): container finished" podID="85529c21-3161-455b-a3cc-7f5a981a9ebc" containerID="81bc45227f15db84b4a3195c3688705e2214386dc771554beb598b8f6f944b2f" exitCode=0
Jul 29 14:37:55.926435 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.926430    2578 generic.go:356] "Generic (PLEG): container finished" podID="85529c21-3161-455b-a3cc-7f5a981a9ebc" containerID="f7b391d5777be8e1802e467c4a359ed0a5228d4f058b334761cffc9cbdb6cfe1" exitCode=0
Jul 29 14:37:55.926647 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.926460    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:55.926647 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.926474    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85529c21-3161-455b-a3cc-7f5a981a9ebc","Type":"ContainerDied","Data":"d8093418714428053402a5b7b6e67e6dac6f2ba65480b4de192a375ca93bea6e"}
Jul 29 14:37:55.926647 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.926564    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85529c21-3161-455b-a3cc-7f5a981a9ebc","Type":"ContainerDied","Data":"2e8b53e1b93249122c2c135712e5262304393c887859ae5f490382f06a40efae"}
Jul 29 14:37:55.926647 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.926592    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85529c21-3161-455b-a3cc-7f5a981a9ebc","Type":"ContainerDied","Data":"4511957dc39c3b6a76fdcd16353334902f49e022c1f7a490f13ee821dbff75af"}
Jul 29 14:37:55.926647 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.926617    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85529c21-3161-455b-a3cc-7f5a981a9ebc","Type":"ContainerDied","Data":"d7414b1fc521260eaffdf4b961b0fe2caf397049b400f732c9b40be7810ce747"}
Jul 29 14:37:55.926647 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.926641    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85529c21-3161-455b-a3cc-7f5a981a9ebc","Type":"ContainerDied","Data":"81bc45227f15db84b4a3195c3688705e2214386dc771554beb598b8f6f944b2f"}
Jul 29 14:37:55.926893 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.926663    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85529c21-3161-455b-a3cc-7f5a981a9ebc","Type":"ContainerDied","Data":"f7b391d5777be8e1802e467c4a359ed0a5228d4f058b334761cffc9cbdb6cfe1"}
Jul 29 14:37:55.926893 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.926642    2578 scope.go:117] "RemoveContainer" containerID="d8093418714428053402a5b7b6e67e6dac6f2ba65480b4de192a375ca93bea6e"
Jul 29 14:37:55.926893 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.926688    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85529c21-3161-455b-a3cc-7f5a981a9ebc","Type":"ContainerDied","Data":"e93d8ba1bd18c58dc81b9dfe1696ebe00d92a1473a8391f1d4ae5fc4d13e3f79"}
Jul 29 14:37:55.935706 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.935688    2578 scope.go:117] "RemoveContainer" containerID="2e8b53e1b93249122c2c135712e5262304393c887859ae5f490382f06a40efae"
Jul 29 14:37:55.942464 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.942450    2578 scope.go:117] "RemoveContainer" containerID="4511957dc39c3b6a76fdcd16353334902f49e022c1f7a490f13ee821dbff75af"
Jul 29 14:37:55.948449 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.948432    2578 scope.go:117] "RemoveContainer" containerID="d7414b1fc521260eaffdf4b961b0fe2caf397049b400f732c9b40be7810ce747"
Jul 29 14:37:55.951711 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.951691    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 14:37:55.955981 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.955966    2578 scope.go:117] "RemoveContainer" containerID="81bc45227f15db84b4a3195c3688705e2214386dc771554beb598b8f6f944b2f"
Jul 29 14:37:55.956802 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.956714    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 14:37:55.961986 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.961969    2578 scope.go:117] "RemoveContainer" containerID="f7b391d5777be8e1802e467c4a359ed0a5228d4f058b334761cffc9cbdb6cfe1"
Jul 29 14:37:55.968180 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.968164    2578 scope.go:117] "RemoveContainer" containerID="5ea3e784cfe2df8d91ba10930b837a6bdd25efa543f7265daf8cd77bffa75f04"
Jul 29 14:37:55.974023 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.974008    2578 scope.go:117] "RemoveContainer" containerID="d8093418714428053402a5b7b6e67e6dac6f2ba65480b4de192a375ca93bea6e"
Jul 29 14:37:55.974277 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:37:55.974259    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8093418714428053402a5b7b6e67e6dac6f2ba65480b4de192a375ca93bea6e\": container with ID starting with d8093418714428053402a5b7b6e67e6dac6f2ba65480b4de192a375ca93bea6e not found: ID does not exist" containerID="d8093418714428053402a5b7b6e67e6dac6f2ba65480b4de192a375ca93bea6e"
Jul 29 14:37:55.974322 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.974285    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8093418714428053402a5b7b6e67e6dac6f2ba65480b4de192a375ca93bea6e"} err="failed to get container status \"d8093418714428053402a5b7b6e67e6dac6f2ba65480b4de192a375ca93bea6e\": rpc error: code = NotFound desc = could not find container \"d8093418714428053402a5b7b6e67e6dac6f2ba65480b4de192a375ca93bea6e\": container with ID starting with d8093418714428053402a5b7b6e67e6dac6f2ba65480b4de192a375ca93bea6e not found: ID does not exist"
Jul 29 14:37:55.974322 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.974302    2578 scope.go:117] "RemoveContainer" containerID="2e8b53e1b93249122c2c135712e5262304393c887859ae5f490382f06a40efae"
Jul 29 14:37:55.974513 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:37:55.974496    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e8b53e1b93249122c2c135712e5262304393c887859ae5f490382f06a40efae\": container with ID starting with 2e8b53e1b93249122c2c135712e5262304393c887859ae5f490382f06a40efae not found: ID does not exist" containerID="2e8b53e1b93249122c2c135712e5262304393c887859ae5f490382f06a40efae"
Jul 29 14:37:55.974553 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.974518    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e8b53e1b93249122c2c135712e5262304393c887859ae5f490382f06a40efae"} err="failed to get container status \"2e8b53e1b93249122c2c135712e5262304393c887859ae5f490382f06a40efae\": rpc error: code = NotFound desc = could not find container \"2e8b53e1b93249122c2c135712e5262304393c887859ae5f490382f06a40efae\": container with ID starting with 2e8b53e1b93249122c2c135712e5262304393c887859ae5f490382f06a40efae not found: ID does not exist"
Jul 29 14:37:55.974553 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.974535    2578 scope.go:117] "RemoveContainer" containerID="4511957dc39c3b6a76fdcd16353334902f49e022c1f7a490f13ee821dbff75af"
Jul 29 14:37:55.974724 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:37:55.974706    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4511957dc39c3b6a76fdcd16353334902f49e022c1f7a490f13ee821dbff75af\": container with ID starting with 4511957dc39c3b6a76fdcd16353334902f49e022c1f7a490f13ee821dbff75af not found: ID does not exist" containerID="4511957dc39c3b6a76fdcd16353334902f49e022c1f7a490f13ee821dbff75af"
Jul 29 14:37:55.974760 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.974727    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4511957dc39c3b6a76fdcd16353334902f49e022c1f7a490f13ee821dbff75af"} err="failed to get container status \"4511957dc39c3b6a76fdcd16353334902f49e022c1f7a490f13ee821dbff75af\": rpc error: code = NotFound desc = could not find container \"4511957dc39c3b6a76fdcd16353334902f49e022c1f7a490f13ee821dbff75af\": container with ID starting with 4511957dc39c3b6a76fdcd16353334902f49e022c1f7a490f13ee821dbff75af not found: ID does not exist"
Jul 29 14:37:55.974760 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.974740    2578 scope.go:117] "RemoveContainer" containerID="d7414b1fc521260eaffdf4b961b0fe2caf397049b400f732c9b40be7810ce747"
Jul 29 14:37:55.974911 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:37:55.974898    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7414b1fc521260eaffdf4b961b0fe2caf397049b400f732c9b40be7810ce747\": container with ID starting with d7414b1fc521260eaffdf4b961b0fe2caf397049b400f732c9b40be7810ce747 not found: ID does not exist" containerID="d7414b1fc521260eaffdf4b961b0fe2caf397049b400f732c9b40be7810ce747"
Jul 29 14:37:55.974946 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.974913    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7414b1fc521260eaffdf4b961b0fe2caf397049b400f732c9b40be7810ce747"} err="failed to get container status \"d7414b1fc521260eaffdf4b961b0fe2caf397049b400f732c9b40be7810ce747\": rpc error: code = NotFound desc = could not find container \"d7414b1fc521260eaffdf4b961b0fe2caf397049b400f732c9b40be7810ce747\": container with ID starting with d7414b1fc521260eaffdf4b961b0fe2caf397049b400f732c9b40be7810ce747 not found: ID does not exist"
Jul 29 14:37:55.974946 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.974924    2578 scope.go:117] "RemoveContainer" containerID="81bc45227f15db84b4a3195c3688705e2214386dc771554beb598b8f6f944b2f"
Jul 29 14:37:55.975180 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:37:55.975159    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81bc45227f15db84b4a3195c3688705e2214386dc771554beb598b8f6f944b2f\": container with ID starting with 81bc45227f15db84b4a3195c3688705e2214386dc771554beb598b8f6f944b2f not found: ID does not exist" containerID="81bc45227f15db84b4a3195c3688705e2214386dc771554beb598b8f6f944b2f"
Jul 29 14:37:55.975286 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.975184    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81bc45227f15db84b4a3195c3688705e2214386dc771554beb598b8f6f944b2f"} err="failed to get container status \"81bc45227f15db84b4a3195c3688705e2214386dc771554beb598b8f6f944b2f\": rpc error: code = NotFound desc = could not find container \"81bc45227f15db84b4a3195c3688705e2214386dc771554beb598b8f6f944b2f\": container with ID starting with 81bc45227f15db84b4a3195c3688705e2214386dc771554beb598b8f6f944b2f not found: ID does not exist"
Jul 29 14:37:55.975286 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.975199    2578 scope.go:117] "RemoveContainer" containerID="f7b391d5777be8e1802e467c4a359ed0a5228d4f058b334761cffc9cbdb6cfe1"
Jul 29 14:37:55.975601 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:37:55.975582    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7b391d5777be8e1802e467c4a359ed0a5228d4f058b334761cffc9cbdb6cfe1\": container with ID starting with f7b391d5777be8e1802e467c4a359ed0a5228d4f058b334761cffc9cbdb6cfe1 not found: ID does not exist" containerID="f7b391d5777be8e1802e467c4a359ed0a5228d4f058b334761cffc9cbdb6cfe1"
Jul 29 14:37:55.975661 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.975600    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7b391d5777be8e1802e467c4a359ed0a5228d4f058b334761cffc9cbdb6cfe1"} err="failed to get container status \"f7b391d5777be8e1802e467c4a359ed0a5228d4f058b334761cffc9cbdb6cfe1\": rpc error: code = NotFound desc = could not find container \"f7b391d5777be8e1802e467c4a359ed0a5228d4f058b334761cffc9cbdb6cfe1\": container with ID starting with f7b391d5777be8e1802e467c4a359ed0a5228d4f058b334761cffc9cbdb6cfe1 not found: ID does not exist"
Jul 29 14:37:55.975661 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.975611    2578 scope.go:117] "RemoveContainer" containerID="5ea3e784cfe2df8d91ba10930b837a6bdd25efa543f7265daf8cd77bffa75f04"
Jul 29 14:37:55.975799 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:37:55.975785    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ea3e784cfe2df8d91ba10930b837a6bdd25efa543f7265daf8cd77bffa75f04\": container with ID starting with 5ea3e784cfe2df8d91ba10930b837a6bdd25efa543f7265daf8cd77bffa75f04 not found: ID does not exist" containerID="5ea3e784cfe2df8d91ba10930b837a6bdd25efa543f7265daf8cd77bffa75f04"
Jul 29 14:37:55.975849 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.975802    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ea3e784cfe2df8d91ba10930b837a6bdd25efa543f7265daf8cd77bffa75f04"} err="failed to get container status \"5ea3e784cfe2df8d91ba10930b837a6bdd25efa543f7265daf8cd77bffa75f04\": rpc error: code = NotFound desc = could not find container \"5ea3e784cfe2df8d91ba10930b837a6bdd25efa543f7265daf8cd77bffa75f04\": container with ID starting with 5ea3e784cfe2df8d91ba10930b837a6bdd25efa543f7265daf8cd77bffa75f04 not found: ID does not exist"
Jul 29 14:37:55.975849 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.975814    2578 scope.go:117] "RemoveContainer" containerID="d8093418714428053402a5b7b6e67e6dac6f2ba65480b4de192a375ca93bea6e"
Jul 29 14:37:55.976018 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.976001    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8093418714428053402a5b7b6e67e6dac6f2ba65480b4de192a375ca93bea6e"} err="failed to get container status \"d8093418714428053402a5b7b6e67e6dac6f2ba65480b4de192a375ca93bea6e\": rpc error: code = NotFound desc = could not find container \"d8093418714428053402a5b7b6e67e6dac6f2ba65480b4de192a375ca93bea6e\": container with ID starting with d8093418714428053402a5b7b6e67e6dac6f2ba65480b4de192a375ca93bea6e not found: ID does not exist"
Jul 29 14:37:55.976053 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.976019    2578 scope.go:117] "RemoveContainer" containerID="2e8b53e1b93249122c2c135712e5262304393c887859ae5f490382f06a40efae"
Jul 29 14:37:55.976221 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.976201    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e8b53e1b93249122c2c135712e5262304393c887859ae5f490382f06a40efae"} err="failed to get container status \"2e8b53e1b93249122c2c135712e5262304393c887859ae5f490382f06a40efae\": rpc error: code = NotFound desc = could not find container \"2e8b53e1b93249122c2c135712e5262304393c887859ae5f490382f06a40efae\": container with ID starting with 2e8b53e1b93249122c2c135712e5262304393c887859ae5f490382f06a40efae not found: ID does not exist"
Jul 29 14:37:55.976221 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.976220    2578 scope.go:117] "RemoveContainer" containerID="4511957dc39c3b6a76fdcd16353334902f49e022c1f7a490f13ee821dbff75af"
Jul 29 14:37:55.976474 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.976458    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4511957dc39c3b6a76fdcd16353334902f49e022c1f7a490f13ee821dbff75af"} err="failed to get container status \"4511957dc39c3b6a76fdcd16353334902f49e022c1f7a490f13ee821dbff75af\": rpc error: code = NotFound desc = could not find container \"4511957dc39c3b6a76fdcd16353334902f49e022c1f7a490f13ee821dbff75af\": container with ID starting with 4511957dc39c3b6a76fdcd16353334902f49e022c1f7a490f13ee821dbff75af not found: ID does not exist"
Jul 29 14:37:55.976518 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.976474    2578 scope.go:117] "RemoveContainer" containerID="d7414b1fc521260eaffdf4b961b0fe2caf397049b400f732c9b40be7810ce747"
Jul 29 14:37:55.976689 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.976668    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7414b1fc521260eaffdf4b961b0fe2caf397049b400f732c9b40be7810ce747"} err="failed to get container status \"d7414b1fc521260eaffdf4b961b0fe2caf397049b400f732c9b40be7810ce747\": rpc error: code = NotFound desc = could not find container \"d7414b1fc521260eaffdf4b961b0fe2caf397049b400f732c9b40be7810ce747\": container with ID starting with d7414b1fc521260eaffdf4b961b0fe2caf397049b400f732c9b40be7810ce747 not found: ID does not exist"
Jul 29 14:37:55.976689 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.976689    2578 scope.go:117] "RemoveContainer" containerID="81bc45227f15db84b4a3195c3688705e2214386dc771554beb598b8f6f944b2f"
Jul 29 14:37:55.976901 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.976885    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81bc45227f15db84b4a3195c3688705e2214386dc771554beb598b8f6f944b2f"} err="failed to get container status \"81bc45227f15db84b4a3195c3688705e2214386dc771554beb598b8f6f944b2f\": rpc error: code = NotFound desc = could not find container \"81bc45227f15db84b4a3195c3688705e2214386dc771554beb598b8f6f944b2f\": container with ID starting with 81bc45227f15db84b4a3195c3688705e2214386dc771554beb598b8f6f944b2f not found: ID does not exist"
Jul 29 14:37:55.976943 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.976904    2578 scope.go:117] "RemoveContainer" containerID="f7b391d5777be8e1802e467c4a359ed0a5228d4f058b334761cffc9cbdb6cfe1"
Jul 29 14:37:55.977103 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.977083    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7b391d5777be8e1802e467c4a359ed0a5228d4f058b334761cffc9cbdb6cfe1"} err="failed to get container status \"f7b391d5777be8e1802e467c4a359ed0a5228d4f058b334761cffc9cbdb6cfe1\": rpc error: code = NotFound desc = could not find container \"f7b391d5777be8e1802e467c4a359ed0a5228d4f058b334761cffc9cbdb6cfe1\": container with ID starting with f7b391d5777be8e1802e467c4a359ed0a5228d4f058b334761cffc9cbdb6cfe1 not found: ID does not exist"
Jul 29 14:37:55.977103 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.977101    2578 scope.go:117] "RemoveContainer" containerID="5ea3e784cfe2df8d91ba10930b837a6bdd25efa543f7265daf8cd77bffa75f04"
Jul 29 14:37:55.977293 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.977275    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ea3e784cfe2df8d91ba10930b837a6bdd25efa543f7265daf8cd77bffa75f04"} err="failed to get container status \"5ea3e784cfe2df8d91ba10930b837a6bdd25efa543f7265daf8cd77bffa75f04\": rpc error: code = NotFound desc = could not find container \"5ea3e784cfe2df8d91ba10930b837a6bdd25efa543f7265daf8cd77bffa75f04\": container with ID starting with 5ea3e784cfe2df8d91ba10930b837a6bdd25efa543f7265daf8cd77bffa75f04 not found: ID does not exist"
Jul 29 14:37:55.977341 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.977295    2578 scope.go:117] "RemoveContainer" containerID="d8093418714428053402a5b7b6e67e6dac6f2ba65480b4de192a375ca93bea6e"
Jul 29 14:37:55.977481 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.977462    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8093418714428053402a5b7b6e67e6dac6f2ba65480b4de192a375ca93bea6e"} err="failed to get container status \"d8093418714428053402a5b7b6e67e6dac6f2ba65480b4de192a375ca93bea6e\": rpc error: code = NotFound desc = could not find container \"d8093418714428053402a5b7b6e67e6dac6f2ba65480b4de192a375ca93bea6e\": container with ID starting with d8093418714428053402a5b7b6e67e6dac6f2ba65480b4de192a375ca93bea6e not found: ID does not exist"
Jul 29 14:37:55.977524 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.977481    2578 scope.go:117] "RemoveContainer" containerID="2e8b53e1b93249122c2c135712e5262304393c887859ae5f490382f06a40efae"
Jul 29 14:37:55.977700 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.977680    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e8b53e1b93249122c2c135712e5262304393c887859ae5f490382f06a40efae"} err="failed to get container status \"2e8b53e1b93249122c2c135712e5262304393c887859ae5f490382f06a40efae\": rpc error: code = NotFound desc = could not find container \"2e8b53e1b93249122c2c135712e5262304393c887859ae5f490382f06a40efae\": container with ID starting with 2e8b53e1b93249122c2c135712e5262304393c887859ae5f490382f06a40efae not found: ID does not exist"
Jul 29 14:37:55.977700 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.977699    2578 scope.go:117] "RemoveContainer" containerID="4511957dc39c3b6a76fdcd16353334902f49e022c1f7a490f13ee821dbff75af"
Jul 29 14:37:55.977948 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.977932    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4511957dc39c3b6a76fdcd16353334902f49e022c1f7a490f13ee821dbff75af"} err="failed to get container status \"4511957dc39c3b6a76fdcd16353334902f49e022c1f7a490f13ee821dbff75af\": rpc error: code = NotFound desc = could not find container \"4511957dc39c3b6a76fdcd16353334902f49e022c1f7a490f13ee821dbff75af\": container with ID starting with 4511957dc39c3b6a76fdcd16353334902f49e022c1f7a490f13ee821dbff75af not found: ID does not exist"
Jul 29 14:37:55.977999 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.977949    2578 scope.go:117] "RemoveContainer" containerID="d7414b1fc521260eaffdf4b961b0fe2caf397049b400f732c9b40be7810ce747"
Jul 29 14:37:55.978154 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.978138    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7414b1fc521260eaffdf4b961b0fe2caf397049b400f732c9b40be7810ce747"} err="failed to get container status \"d7414b1fc521260eaffdf4b961b0fe2caf397049b400f732c9b40be7810ce747\": rpc error: code = NotFound desc = could not find container \"d7414b1fc521260eaffdf4b961b0fe2caf397049b400f732c9b40be7810ce747\": container with ID starting with d7414b1fc521260eaffdf4b961b0fe2caf397049b400f732c9b40be7810ce747 not found: ID does not exist"
Jul 29 14:37:55.978194 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.978155    2578 scope.go:117] "RemoveContainer" containerID="81bc45227f15db84b4a3195c3688705e2214386dc771554beb598b8f6f944b2f"
Jul 29 14:37:55.978370 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.978355    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81bc45227f15db84b4a3195c3688705e2214386dc771554beb598b8f6f944b2f"} err="failed to get container status \"81bc45227f15db84b4a3195c3688705e2214386dc771554beb598b8f6f944b2f\": rpc error: code = NotFound desc = could not find container \"81bc45227f15db84b4a3195c3688705e2214386dc771554beb598b8f6f944b2f\": container with ID starting with 81bc45227f15db84b4a3195c3688705e2214386dc771554beb598b8f6f944b2f not found: ID does not exist"
Jul 29 14:37:55.978416 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.978370    2578 scope.go:117] "RemoveContainer" containerID="f7b391d5777be8e1802e467c4a359ed0a5228d4f058b334761cffc9cbdb6cfe1"
Jul 29 14:37:55.978566 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.978548    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7b391d5777be8e1802e467c4a359ed0a5228d4f058b334761cffc9cbdb6cfe1"} err="failed to get container status \"f7b391d5777be8e1802e467c4a359ed0a5228d4f058b334761cffc9cbdb6cfe1\": rpc error: code = NotFound desc = could not find container \"f7b391d5777be8e1802e467c4a359ed0a5228d4f058b334761cffc9cbdb6cfe1\": container with ID starting with f7b391d5777be8e1802e467c4a359ed0a5228d4f058b334761cffc9cbdb6cfe1 not found: ID does not exist"
Jul 29 14:37:55.978622 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.978567    2578 scope.go:117] "RemoveContainer" containerID="5ea3e784cfe2df8d91ba10930b837a6bdd25efa543f7265daf8cd77bffa75f04"
Jul 29 14:37:55.978798 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.978775    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ea3e784cfe2df8d91ba10930b837a6bdd25efa543f7265daf8cd77bffa75f04"} err="failed to get container status \"5ea3e784cfe2df8d91ba10930b837a6bdd25efa543f7265daf8cd77bffa75f04\": rpc error: code = NotFound desc = could not find container \"5ea3e784cfe2df8d91ba10930b837a6bdd25efa543f7265daf8cd77bffa75f04\": container with ID starting with 5ea3e784cfe2df8d91ba10930b837a6bdd25efa543f7265daf8cd77bffa75f04 not found: ID does not exist"
Jul 29 14:37:55.978798 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.978796    2578 scope.go:117] "RemoveContainer" containerID="d8093418714428053402a5b7b6e67e6dac6f2ba65480b4de192a375ca93bea6e"
Jul 29 14:37:55.979019 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.978997    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8093418714428053402a5b7b6e67e6dac6f2ba65480b4de192a375ca93bea6e"} err="failed to get container status \"d8093418714428053402a5b7b6e67e6dac6f2ba65480b4de192a375ca93bea6e\": rpc error: code = NotFound desc = could not find container \"d8093418714428053402a5b7b6e67e6dac6f2ba65480b4de192a375ca93bea6e\": container with ID starting with d8093418714428053402a5b7b6e67e6dac6f2ba65480b4de192a375ca93bea6e not found: ID does not exist"
Jul 29 14:37:55.979081 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.979019    2578 scope.go:117] "RemoveContainer" containerID="2e8b53e1b93249122c2c135712e5262304393c887859ae5f490382f06a40efae"
Jul 29 14:37:55.979221 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.979206    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e8b53e1b93249122c2c135712e5262304393c887859ae5f490382f06a40efae"} err="failed to get container status \"2e8b53e1b93249122c2c135712e5262304393c887859ae5f490382f06a40efae\": rpc error: code = NotFound desc = could not find container \"2e8b53e1b93249122c2c135712e5262304393c887859ae5f490382f06a40efae\": container with ID starting with 2e8b53e1b93249122c2c135712e5262304393c887859ae5f490382f06a40efae not found: ID does not exist"
Jul 29 14:37:55.979288 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.979222    2578 scope.go:117] "RemoveContainer" containerID="4511957dc39c3b6a76fdcd16353334902f49e022c1f7a490f13ee821dbff75af"
Jul 29 14:37:55.979448 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.979431    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4511957dc39c3b6a76fdcd16353334902f49e022c1f7a490f13ee821dbff75af"} err="failed to get container status \"4511957dc39c3b6a76fdcd16353334902f49e022c1f7a490f13ee821dbff75af\": rpc error: code = NotFound desc = could not find container \"4511957dc39c3b6a76fdcd16353334902f49e022c1f7a490f13ee821dbff75af\": container with ID starting with 4511957dc39c3b6a76fdcd16353334902f49e022c1f7a490f13ee821dbff75af not found: ID does not exist"
Jul 29 14:37:55.979448 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.979447    2578 scope.go:117] "RemoveContainer" containerID="d7414b1fc521260eaffdf4b961b0fe2caf397049b400f732c9b40be7810ce747"
Jul 29 14:37:55.979588 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.979574    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7414b1fc521260eaffdf4b961b0fe2caf397049b400f732c9b40be7810ce747"} err="failed to get container status \"d7414b1fc521260eaffdf4b961b0fe2caf397049b400f732c9b40be7810ce747\": rpc error: code = NotFound desc = could not find container \"d7414b1fc521260eaffdf4b961b0fe2caf397049b400f732c9b40be7810ce747\": container with ID starting with d7414b1fc521260eaffdf4b961b0fe2caf397049b400f732c9b40be7810ce747 not found: ID does not exist"
Jul 29 14:37:55.979634 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.979588    2578 scope.go:117] "RemoveContainer" containerID="81bc45227f15db84b4a3195c3688705e2214386dc771554beb598b8f6f944b2f"
Jul 29 14:37:55.979802 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.979781    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81bc45227f15db84b4a3195c3688705e2214386dc771554beb598b8f6f944b2f"} err="failed to get container status \"81bc45227f15db84b4a3195c3688705e2214386dc771554beb598b8f6f944b2f\": rpc error: code = NotFound desc = could not find container \"81bc45227f15db84b4a3195c3688705e2214386dc771554beb598b8f6f944b2f\": container with ID starting with 81bc45227f15db84b4a3195c3688705e2214386dc771554beb598b8f6f944b2f not found: ID does not exist"
Jul 29 14:37:55.979802 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.979795    2578 scope.go:117] "RemoveContainer" containerID="f7b391d5777be8e1802e467c4a359ed0a5228d4f058b334761cffc9cbdb6cfe1"
Jul 29 14:37:55.979995 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.979978    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7b391d5777be8e1802e467c4a359ed0a5228d4f058b334761cffc9cbdb6cfe1"} err="failed to get container status \"f7b391d5777be8e1802e467c4a359ed0a5228d4f058b334761cffc9cbdb6cfe1\": rpc error: code = NotFound desc = could not find container \"f7b391d5777be8e1802e467c4a359ed0a5228d4f058b334761cffc9cbdb6cfe1\": container with ID starting with f7b391d5777be8e1802e467c4a359ed0a5228d4f058b334761cffc9cbdb6cfe1 not found: ID does not exist"
Jul 29 14:37:55.979995 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.979994    2578 scope.go:117] "RemoveContainer" containerID="5ea3e784cfe2df8d91ba10930b837a6bdd25efa543f7265daf8cd77bffa75f04"
Jul 29 14:37:55.980231 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.980210    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ea3e784cfe2df8d91ba10930b837a6bdd25efa543f7265daf8cd77bffa75f04"} err="failed to get container status \"5ea3e784cfe2df8d91ba10930b837a6bdd25efa543f7265daf8cd77bffa75f04\": rpc error: code = NotFound desc = could not find container \"5ea3e784cfe2df8d91ba10930b837a6bdd25efa543f7265daf8cd77bffa75f04\": container with ID starting with 5ea3e784cfe2df8d91ba10930b837a6bdd25efa543f7265daf8cd77bffa75f04 not found: ID does not exist"
Jul 29 14:37:55.980231 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.980230    2578 scope.go:117] "RemoveContainer" containerID="d8093418714428053402a5b7b6e67e6dac6f2ba65480b4de192a375ca93bea6e"
Jul 29 14:37:55.980452 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.980434    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8093418714428053402a5b7b6e67e6dac6f2ba65480b4de192a375ca93bea6e"} err="failed to get container status \"d8093418714428053402a5b7b6e67e6dac6f2ba65480b4de192a375ca93bea6e\": rpc error: code = NotFound desc = could not find container \"d8093418714428053402a5b7b6e67e6dac6f2ba65480b4de192a375ca93bea6e\": container with ID starting with d8093418714428053402a5b7b6e67e6dac6f2ba65480b4de192a375ca93bea6e not found: ID does not exist"
Jul 29 14:37:55.980501 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.980453    2578 scope.go:117] "RemoveContainer" containerID="2e8b53e1b93249122c2c135712e5262304393c887859ae5f490382f06a40efae"
Jul 29 14:37:55.980646 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.980631    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e8b53e1b93249122c2c135712e5262304393c887859ae5f490382f06a40efae"} err="failed to get container status \"2e8b53e1b93249122c2c135712e5262304393c887859ae5f490382f06a40efae\": rpc error: code = NotFound desc = could not find container \"2e8b53e1b93249122c2c135712e5262304393c887859ae5f490382f06a40efae\": container with ID starting with 2e8b53e1b93249122c2c135712e5262304393c887859ae5f490382f06a40efae not found: ID does not exist"
Jul 29 14:37:55.980687 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.980646    2578 scope.go:117] "RemoveContainer" containerID="4511957dc39c3b6a76fdcd16353334902f49e022c1f7a490f13ee821dbff75af"
Jul 29 14:37:55.980827 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.980808    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4511957dc39c3b6a76fdcd16353334902f49e022c1f7a490f13ee821dbff75af"} err="failed to get container status \"4511957dc39c3b6a76fdcd16353334902f49e022c1f7a490f13ee821dbff75af\": rpc error: code = NotFound desc = could not find container \"4511957dc39c3b6a76fdcd16353334902f49e022c1f7a490f13ee821dbff75af\": container with ID starting with 4511957dc39c3b6a76fdcd16353334902f49e022c1f7a490f13ee821dbff75af not found: ID does not exist"
Jul 29 14:37:55.980864 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.980830    2578 scope.go:117] "RemoveContainer" containerID="d7414b1fc521260eaffdf4b961b0fe2caf397049b400f732c9b40be7810ce747"
Jul 29 14:37:55.981001 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.980987    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7414b1fc521260eaffdf4b961b0fe2caf397049b400f732c9b40be7810ce747"} err="failed to get container status \"d7414b1fc521260eaffdf4b961b0fe2caf397049b400f732c9b40be7810ce747\": rpc error: code = NotFound desc = could not find container \"d7414b1fc521260eaffdf4b961b0fe2caf397049b400f732c9b40be7810ce747\": container with ID starting with d7414b1fc521260eaffdf4b961b0fe2caf397049b400f732c9b40be7810ce747 not found: ID does not exist"
Jul 29 14:37:55.981001 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.981001    2578 scope.go:117] "RemoveContainer" containerID="81bc45227f15db84b4a3195c3688705e2214386dc771554beb598b8f6f944b2f"
Jul 29 14:37:55.981201 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.981180    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81bc45227f15db84b4a3195c3688705e2214386dc771554beb598b8f6f944b2f"} err="failed to get container status \"81bc45227f15db84b4a3195c3688705e2214386dc771554beb598b8f6f944b2f\": rpc error: code = NotFound desc = could not find container \"81bc45227f15db84b4a3195c3688705e2214386dc771554beb598b8f6f944b2f\": container with ID starting with 81bc45227f15db84b4a3195c3688705e2214386dc771554beb598b8f6f944b2f not found: ID does not exist"
Jul 29 14:37:55.981288 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.981203    2578 scope.go:117] "RemoveContainer" containerID="f7b391d5777be8e1802e467c4a359ed0a5228d4f058b334761cffc9cbdb6cfe1"
Jul 29 14:37:55.981457 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.981439    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7b391d5777be8e1802e467c4a359ed0a5228d4f058b334761cffc9cbdb6cfe1"} err="failed to get container status \"f7b391d5777be8e1802e467c4a359ed0a5228d4f058b334761cffc9cbdb6cfe1\": rpc error: code = NotFound desc = could not find container \"f7b391d5777be8e1802e467c4a359ed0a5228d4f058b334761cffc9cbdb6cfe1\": container with ID starting with f7b391d5777be8e1802e467c4a359ed0a5228d4f058b334761cffc9cbdb6cfe1 not found: ID does not exist"
Jul 29 14:37:55.981499 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.981458    2578 scope.go:117] "RemoveContainer" containerID="5ea3e784cfe2df8d91ba10930b837a6bdd25efa543f7265daf8cd77bffa75f04"
Jul 29 14:37:55.981640 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.981620    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ea3e784cfe2df8d91ba10930b837a6bdd25efa543f7265daf8cd77bffa75f04"} err="failed to get container status \"5ea3e784cfe2df8d91ba10930b837a6bdd25efa543f7265daf8cd77bffa75f04\": rpc error: code = NotFound desc = could not find container \"5ea3e784cfe2df8d91ba10930b837a6bdd25efa543f7265daf8cd77bffa75f04\": container with ID starting with 5ea3e784cfe2df8d91ba10930b837a6bdd25efa543f7265daf8cd77bffa75f04 not found: ID does not exist"
Jul 29 14:37:55.981680 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.981642    2578 scope.go:117] "RemoveContainer" containerID="d8093418714428053402a5b7b6e67e6dac6f2ba65480b4de192a375ca93bea6e"
Jul 29 14:37:55.981853 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.981836    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8093418714428053402a5b7b6e67e6dac6f2ba65480b4de192a375ca93bea6e"} err="failed to get container status \"d8093418714428053402a5b7b6e67e6dac6f2ba65480b4de192a375ca93bea6e\": rpc error: code = NotFound desc = could not find container \"d8093418714428053402a5b7b6e67e6dac6f2ba65480b4de192a375ca93bea6e\": container with ID starting with d8093418714428053402a5b7b6e67e6dac6f2ba65480b4de192a375ca93bea6e not found: ID does not exist"
Jul 29 14:37:55.981892 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.981853    2578 scope.go:117] "RemoveContainer" containerID="2e8b53e1b93249122c2c135712e5262304393c887859ae5f490382f06a40efae"
Jul 29 14:37:55.982060 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.982046    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e8b53e1b93249122c2c135712e5262304393c887859ae5f490382f06a40efae"} err="failed to get container status \"2e8b53e1b93249122c2c135712e5262304393c887859ae5f490382f06a40efae\": rpc error: code = NotFound desc = could not find container \"2e8b53e1b93249122c2c135712e5262304393c887859ae5f490382f06a40efae\": container with ID starting with 2e8b53e1b93249122c2c135712e5262304393c887859ae5f490382f06a40efae not found: ID does not exist"
Jul 29 14:37:55.982100 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.982061    2578 scope.go:117] "RemoveContainer" containerID="4511957dc39c3b6a76fdcd16353334902f49e022c1f7a490f13ee821dbff75af"
Jul 29 14:37:55.982273 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.982255    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4511957dc39c3b6a76fdcd16353334902f49e022c1f7a490f13ee821dbff75af"} err="failed to get container status \"4511957dc39c3b6a76fdcd16353334902f49e022c1f7a490f13ee821dbff75af\": rpc error: code = NotFound desc = could not find container \"4511957dc39c3b6a76fdcd16353334902f49e022c1f7a490f13ee821dbff75af\": container with ID starting with 4511957dc39c3b6a76fdcd16353334902f49e022c1f7a490f13ee821dbff75af not found: ID does not exist"
Jul 29 14:37:55.982315 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.982274    2578 scope.go:117] "RemoveContainer" containerID="d7414b1fc521260eaffdf4b961b0fe2caf397049b400f732c9b40be7810ce747"
Jul 29 14:37:55.982475 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.982458    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7414b1fc521260eaffdf4b961b0fe2caf397049b400f732c9b40be7810ce747"} err="failed to get container status \"d7414b1fc521260eaffdf4b961b0fe2caf397049b400f732c9b40be7810ce747\": rpc error: code = NotFound desc = could not find container \"d7414b1fc521260eaffdf4b961b0fe2caf397049b400f732c9b40be7810ce747\": container with ID starting with d7414b1fc521260eaffdf4b961b0fe2caf397049b400f732c9b40be7810ce747 not found: ID does not exist"
Jul 29 14:37:55.982510 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.982477    2578 scope.go:117] "RemoveContainer" containerID="81bc45227f15db84b4a3195c3688705e2214386dc771554beb598b8f6f944b2f"
Jul 29 14:37:55.982682 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.982666    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81bc45227f15db84b4a3195c3688705e2214386dc771554beb598b8f6f944b2f"} err="failed to get container status \"81bc45227f15db84b4a3195c3688705e2214386dc771554beb598b8f6f944b2f\": rpc error: code = NotFound desc = could not find container \"81bc45227f15db84b4a3195c3688705e2214386dc771554beb598b8f6f944b2f\": container with ID starting with 81bc45227f15db84b4a3195c3688705e2214386dc771554beb598b8f6f944b2f not found: ID does not exist"
Jul 29 14:37:55.982726 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.982682    2578 scope.go:117] "RemoveContainer" containerID="f7b391d5777be8e1802e467c4a359ed0a5228d4f058b334761cffc9cbdb6cfe1"
Jul 29 14:37:55.982858 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.982844    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7b391d5777be8e1802e467c4a359ed0a5228d4f058b334761cffc9cbdb6cfe1"} err="failed to get container status \"f7b391d5777be8e1802e467c4a359ed0a5228d4f058b334761cffc9cbdb6cfe1\": rpc error: code = NotFound desc = could not find container \"f7b391d5777be8e1802e467c4a359ed0a5228d4f058b334761cffc9cbdb6cfe1\": container with ID starting with f7b391d5777be8e1802e467c4a359ed0a5228d4f058b334761cffc9cbdb6cfe1 not found: ID does not exist"
Jul 29 14:37:55.982899 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.982857    2578 scope.go:117] "RemoveContainer" containerID="5ea3e784cfe2df8d91ba10930b837a6bdd25efa543f7265daf8cd77bffa75f04"
Jul 29 14:37:55.983045 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.983027    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ea3e784cfe2df8d91ba10930b837a6bdd25efa543f7265daf8cd77bffa75f04"} err="failed to get container status \"5ea3e784cfe2df8d91ba10930b837a6bdd25efa543f7265daf8cd77bffa75f04\": rpc error: code = NotFound desc = could not find container \"5ea3e784cfe2df8d91ba10930b837a6bdd25efa543f7265daf8cd77bffa75f04\": container with ID starting with 5ea3e784cfe2df8d91ba10930b837a6bdd25efa543f7265daf8cd77bffa75f04 not found: ID does not exist"
Jul 29 14:37:55.989214 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.989194    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 14:37:55.989496 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.989481    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85529c21-3161-455b-a3cc-7f5a981a9ebc" containerName="init-config-reloader"
Jul 29 14:37:55.989574 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.989499    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="85529c21-3161-455b-a3cc-7f5a981a9ebc" containerName="init-config-reloader"
Jul 29 14:37:55.989574 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.989514    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85529c21-3161-455b-a3cc-7f5a981a9ebc" containerName="kube-rbac-proxy-web"
Jul 29 14:37:55.989574 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.989522    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="85529c21-3161-455b-a3cc-7f5a981a9ebc" containerName="kube-rbac-proxy-web"
Jul 29 14:37:55.989574 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.989535    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85529c21-3161-455b-a3cc-7f5a981a9ebc" containerName="kube-rbac-proxy"
Jul 29 14:37:55.989574 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.989543    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="85529c21-3161-455b-a3cc-7f5a981a9ebc" containerName="kube-rbac-proxy"
Jul 29 14:37:55.989574 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.989553    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85529c21-3161-455b-a3cc-7f5a981a9ebc" containerName="kube-rbac-proxy-thanos"
Jul 29 14:37:55.989574 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.989561    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="85529c21-3161-455b-a3cc-7f5a981a9ebc" containerName="kube-rbac-proxy-thanos"
Jul 29 14:37:55.989574 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.989574    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85529c21-3161-455b-a3cc-7f5a981a9ebc" containerName="prometheus"
Jul 29 14:37:55.989944 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.989582    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="85529c21-3161-455b-a3cc-7f5a981a9ebc" containerName="prometheus"
Jul 29 14:37:55.989944 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.989592    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85529c21-3161-455b-a3cc-7f5a981a9ebc" containerName="config-reloader"
Jul 29 14:37:55.989944 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.989601    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="85529c21-3161-455b-a3cc-7f5a981a9ebc" containerName="config-reloader"
Jul 29 14:37:55.989944 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.989612    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25d3846d-f20e-402d-b546-6713b6ac235d" containerName="console"
Jul 29 14:37:55.989944 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.989620    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="25d3846d-f20e-402d-b546-6713b6ac235d" containerName="console"
Jul 29 14:37:55.989944 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.989637    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a30d2007-9f6a-414f-82af-e7edc96c3400" containerName="console"
Jul 29 14:37:55.989944 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.989645    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a30d2007-9f6a-414f-82af-e7edc96c3400" containerName="console"
Jul 29 14:37:55.989944 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.989657    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85529c21-3161-455b-a3cc-7f5a981a9ebc" containerName="thanos-sidecar"
Jul 29 14:37:55.989944 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.989665    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="85529c21-3161-455b-a3cc-7f5a981a9ebc" containerName="thanos-sidecar"
Jul 29 14:37:55.989944 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.989724    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="85529c21-3161-455b-a3cc-7f5a981a9ebc" containerName="thanos-sidecar"
Jul 29 14:37:55.989944 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.989735    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="85529c21-3161-455b-a3cc-7f5a981a9ebc" containerName="kube-rbac-proxy-web"
Jul 29 14:37:55.989944 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.989744    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="85529c21-3161-455b-a3cc-7f5a981a9ebc" containerName="prometheus"
Jul 29 14:37:55.989944 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.989753    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="85529c21-3161-455b-a3cc-7f5a981a9ebc" containerName="kube-rbac-proxy-thanos"
Jul 29 14:37:55.989944 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.989762    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="25d3846d-f20e-402d-b546-6713b6ac235d" containerName="console"
Jul 29 14:37:55.989944 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.989771    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a30d2007-9f6a-414f-82af-e7edc96c3400" containerName="console"
Jul 29 14:37:55.989944 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.989780    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="85529c21-3161-455b-a3cc-7f5a981a9ebc" containerName="config-reloader"
Jul 29 14:37:55.989944 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.989787    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="85529c21-3161-455b-a3cc-7f5a981a9ebc" containerName="kube-rbac-proxy"
Jul 29 14:37:55.995042 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.995025    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:55.997888 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.997872    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 29 14:37:55.997971 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.997875    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 29 14:37:55.998428 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.998404    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 29 14:37:55.998516 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.998483    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 29 14:37:55.998516 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.998495    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 29 14:37:55.998715 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.998699    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 29 14:37:55.998772 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.998701    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 29 14:37:55.998772 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.998731    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-x7wvq\""
Jul 29 14:37:55.998856 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.998702    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 29 14:37:55.999440 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.999421    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 29 14:37:55.999522 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.999465    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 29 14:37:55.999719 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.999701    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 29 14:37:55.999797 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:55.999718    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 29 14:37:56.000334 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.000318    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6rrbenv8nglhb\""
Jul 29 14:37:56.003507 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.003488    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 29 14:37:56.004581 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.004566    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 29 14:37:56.011157 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.011135    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 14:37:56.104200 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.104172    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/351545a7-31c7-448e-ad93-1886c625e846-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.104200 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.104204    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/351545a7-31c7-448e-ad93-1886c625e846-config-out\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.104421 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.104221    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/351545a7-31c7-448e-ad93-1886c625e846-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.104421 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.104265    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/351545a7-31c7-448e-ad93-1886c625e846-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.104421 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.104313    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/351545a7-31c7-448e-ad93-1886c625e846-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.104421 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.104371    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/351545a7-31c7-448e-ad93-1886c625e846-config\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.104558 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.104449    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/351545a7-31c7-448e-ad93-1886c625e846-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.104558 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.104471    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/351545a7-31c7-448e-ad93-1886c625e846-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.104558 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.104489    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/351545a7-31c7-448e-ad93-1886c625e846-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.104558 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.104504    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/351545a7-31c7-448e-ad93-1886c625e846-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.104558 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.104523    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/351545a7-31c7-448e-ad93-1886c625e846-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.104558 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.104537    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/351545a7-31c7-448e-ad93-1886c625e846-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.104558 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.104552    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/351545a7-31c7-448e-ad93-1886c625e846-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.104846 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.104568    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/351545a7-31c7-448e-ad93-1886c625e846-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.104846 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.104583    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/351545a7-31c7-448e-ad93-1886c625e846-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.104846 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.104598    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/351545a7-31c7-448e-ad93-1886c625e846-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.104846 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.104613    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/351545a7-31c7-448e-ad93-1886c625e846-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.104846 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.104627    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/351545a7-31c7-448e-ad93-1886c625e846-web-config\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.104846 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.104641    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/351545a7-31c7-448e-ad93-1886c625e846-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.104846 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.104669    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nqj4\" (UniqueName: \"kubernetes.io/projected/351545a7-31c7-448e-ad93-1886c625e846-kube-api-access-9nqj4\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.205896 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.205825    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/351545a7-31c7-448e-ad93-1886c625e846-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.205896 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.205859    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/351545a7-31c7-448e-ad93-1886c625e846-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.205896 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.205878    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/351545a7-31c7-448e-ad93-1886c625e846-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.205896 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.205893    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/351545a7-31c7-448e-ad93-1886c625e846-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.206188 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.205923    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/351545a7-31c7-448e-ad93-1886c625e846-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.206188 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.205946    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/351545a7-31c7-448e-ad93-1886c625e846-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.206188 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.205969    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/351545a7-31c7-448e-ad93-1886c625e846-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.206188 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.206067    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/351545a7-31c7-448e-ad93-1886c625e846-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.206188 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.206096    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/351545a7-31c7-448e-ad93-1886c625e846-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.206188 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.206140    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/351545a7-31c7-448e-ad93-1886c625e846-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.206188 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.206165    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/351545a7-31c7-448e-ad93-1886c625e846-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.206518 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.206194    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/351545a7-31c7-448e-ad93-1886c625e846-web-config\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.206518 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.206219    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/351545a7-31c7-448e-ad93-1886c625e846-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.206518 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.206262    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nqj4\" (UniqueName: \"kubernetes.io/projected/351545a7-31c7-448e-ad93-1886c625e846-kube-api-access-9nqj4\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.206518 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.206306    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/351545a7-31c7-448e-ad93-1886c625e846-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.206518 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.206343    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/351545a7-31c7-448e-ad93-1886c625e846-config-out\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.206518 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.206367    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/351545a7-31c7-448e-ad93-1886c625e846-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.206518 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.206391    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/351545a7-31c7-448e-ad93-1886c625e846-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.206518 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.206418    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/351545a7-31c7-448e-ad93-1886c625e846-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.206518 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.206450    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/351545a7-31c7-448e-ad93-1886c625e846-config\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.206939 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.206860    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/351545a7-31c7-448e-ad93-1886c625e846-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.206998 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.206935    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/351545a7-31c7-448e-ad93-1886c625e846-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.207884 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.207643    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/351545a7-31c7-448e-ad93-1886c625e846-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.209270 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.209077    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/351545a7-31c7-448e-ad93-1886c625e846-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.209270 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.209186    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/351545a7-31c7-448e-ad93-1886c625e846-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.209270 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.209201    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/351545a7-31c7-448e-ad93-1886c625e846-config\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.210103 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.209326    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/351545a7-31c7-448e-ad93-1886c625e846-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.210103 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.209344    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/351545a7-31c7-448e-ad93-1886c625e846-config-out\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.210103 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.209622    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/351545a7-31c7-448e-ad93-1886c625e846-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.210103 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.209636    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/351545a7-31c7-448e-ad93-1886c625e846-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.210103 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.209869    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/351545a7-31c7-448e-ad93-1886c625e846-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.210103 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.209959    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/351545a7-31c7-448e-ad93-1886c625e846-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.210103 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.209984    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/351545a7-31c7-448e-ad93-1886c625e846-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.210103 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.210100    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/351545a7-31c7-448e-ad93-1886c625e846-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.210521 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.210431    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/351545a7-31c7-448e-ad93-1886c625e846-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.211516 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.211495    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/351545a7-31c7-448e-ad93-1886c625e846-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.211669 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.211644    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/351545a7-31c7-448e-ad93-1886c625e846-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.211953 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.211935    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/351545a7-31c7-448e-ad93-1886c625e846-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.212012 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.211949    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/351545a7-31c7-448e-ad93-1886c625e846-web-config\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.222009 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.221990    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nqj4\" (UniqueName: \"kubernetes.io/projected/351545a7-31c7-448e-ad93-1886c625e846-kube-api-access-9nqj4\") pod \"prometheus-k8s-0\" (UID: \"351545a7-31c7-448e-ad93-1886c625e846\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.276700 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.276675    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85529c21-3161-455b-a3cc-7f5a981a9ebc" path="/var/lib/kubelet/pods/85529c21-3161-455b-a3cc-7f5a981a9ebc/volumes"
Jul 29 14:37:56.304916 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.304900    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:37:56.441886 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.441735    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 14:37:56.444399 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:37:56.444371    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod351545a7_31c7_448e_ad93_1886c625e846.slice/crio-e2da79880b81f166a489fdfd2c5f7966ace4e2328f443271089fb79b0d780182 WatchSource:0}: Error finding container e2da79880b81f166a489fdfd2c5f7966ace4e2328f443271089fb79b0d780182: Status 404 returned error can't find the container with id e2da79880b81f166a489fdfd2c5f7966ace4e2328f443271089fb79b0d780182
Jul 29 14:37:56.931529 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.931493    2578 generic.go:356] "Generic (PLEG): container finished" podID="351545a7-31c7-448e-ad93-1886c625e846" containerID="c28f8fe940ae998bf6f031951267d5c7a51b63211e4e91896d1771ad878b33b5" exitCode=0
Jul 29 14:37:56.931681 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.931580    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"351545a7-31c7-448e-ad93-1886c625e846","Type":"ContainerDied","Data":"c28f8fe940ae998bf6f031951267d5c7a51b63211e4e91896d1771ad878b33b5"}
Jul 29 14:37:56.931681 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:56.931654    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"351545a7-31c7-448e-ad93-1886c625e846","Type":"ContainerStarted","Data":"e2da79880b81f166a489fdfd2c5f7966ace4e2328f443271089fb79b0d780182"}
Jul 29 14:37:57.940804 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:57.940774    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"351545a7-31c7-448e-ad93-1886c625e846","Type":"ContainerStarted","Data":"080e9cca8e0571d22d98ca7472e0c621c10a68ee025a44c6eb80014861961202"}
Jul 29 14:37:57.941132 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:57.940834    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"351545a7-31c7-448e-ad93-1886c625e846","Type":"ContainerStarted","Data":"5766636e14f5f14df0a8971756d6f07256694da4c92d6eb7ca26627c71643b16"}
Jul 29 14:37:57.941132 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:57.940860    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"351545a7-31c7-448e-ad93-1886c625e846","Type":"ContainerStarted","Data":"5f3b1eff4d5db6ecbc8e83505102ec1d3b1180c1e8558398f069d6bb88ce20d7"}
Jul 29 14:37:57.941132 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:57.940884    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"351545a7-31c7-448e-ad93-1886c625e846","Type":"ContainerStarted","Data":"91410fb8cf2631c36bd47353e1615c79509fc6e4e7206da68599418a82d052fb"}
Jul 29 14:37:57.941132 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:57.940913    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"351545a7-31c7-448e-ad93-1886c625e846","Type":"ContainerStarted","Data":"de7dcd4b543bd3ab8e7d1d5c3e0242388b760cb0216b6f317c578958ab15db1e"}
Jul 29 14:37:57.941132 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:57.940935    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"351545a7-31c7-448e-ad93-1886c625e846","Type":"ContainerStarted","Data":"d25e9360a89afb3b67359725b6f877797e1f8e123ba68acf4e7a0e98f175f490"}
Jul 29 14:37:57.970430 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:37:57.970383    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.9517399060000002 podStartE2EDuration="2.970362406s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.6225ms" isStatefulPod=false podCreationTimestamp="2026-07-29 14:37:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 14:37:57.967969299 +0000 UTC m=+150.270435905" watchObservedRunningTime="2026-07-29 14:37:57.970362406 +0000 UTC m=+150.272829016"
Jul 29 14:38:01.305963 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:38:01.305929    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:38:56.305135 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:38:56.305103    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:38:56.320145 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:38:56.320118    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:38:57.168539 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:38:57.168513    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 14:40:28.057973 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:40:28.057940    2578 kubelet.go:1648] "Image garbage collection succeeded"
Jul 29 14:40:48.789369 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:40:48.789337    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-rxzq4"]
Jul 29 14:40:48.792667 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:40:48.792652    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rxzq4"
Jul 29 14:40:48.795465 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:40:48.795442    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-k489p\""
Jul 29 14:40:48.795465 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:40:48.795461    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 29 14:40:48.796546 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:40:48.796533    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 29 14:40:48.803247 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:40:48.803216    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-rxzq4"]
Jul 29 14:40:48.916647 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:40:48.916613    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2ac9fcc9-0e92-4207-86c8-8e2f9ac7146a-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-rxzq4\" (UID: \"2ac9fcc9-0e92-4207-86c8-8e2f9ac7146a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rxzq4"
Jul 29 14:40:48.916647 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:40:48.916648    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7prk\" (UniqueName: \"kubernetes.io/projected/2ac9fcc9-0e92-4207-86c8-8e2f9ac7146a-kube-api-access-f7prk\") pod \"cert-manager-cainjector-559cdd8c87-rxzq4\" (UID: \"2ac9fcc9-0e92-4207-86c8-8e2f9ac7146a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rxzq4"
Jul 29 14:40:49.018212 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:40:49.018172    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2ac9fcc9-0e92-4207-86c8-8e2f9ac7146a-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-rxzq4\" (UID: \"2ac9fcc9-0e92-4207-86c8-8e2f9ac7146a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rxzq4"
Jul 29 14:40:49.018212 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:40:49.018207    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7prk\" (UniqueName: \"kubernetes.io/projected/2ac9fcc9-0e92-4207-86c8-8e2f9ac7146a-kube-api-access-f7prk\") pod \"cert-manager-cainjector-559cdd8c87-rxzq4\" (UID: \"2ac9fcc9-0e92-4207-86c8-8e2f9ac7146a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rxzq4"
Jul 29 14:40:49.028710 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:40:49.028687    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2ac9fcc9-0e92-4207-86c8-8e2f9ac7146a-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-rxzq4\" (UID: \"2ac9fcc9-0e92-4207-86c8-8e2f9ac7146a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rxzq4"
Jul 29 14:40:49.028831 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:40:49.028816    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7prk\" (UniqueName: \"kubernetes.io/projected/2ac9fcc9-0e92-4207-86c8-8e2f9ac7146a-kube-api-access-f7prk\") pod \"cert-manager-cainjector-559cdd8c87-rxzq4\" (UID: \"2ac9fcc9-0e92-4207-86c8-8e2f9ac7146a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rxzq4"
Jul 29 14:40:49.113909 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:40:49.113829    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rxzq4"
Jul 29 14:40:49.232758 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:40:49.232737    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-rxzq4"]
Jul 29 14:40:49.234741 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:40:49.234713    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ac9fcc9_0e92_4207_86c8_8e2f9ac7146a.slice/crio-0d779d51217e08ca5d523fff8a1fb7813d7fcfc7b5e591c48986058a71f626ed WatchSource:0}: Error finding container 0d779d51217e08ca5d523fff8a1fb7813d7fcfc7b5e591c48986058a71f626ed: Status 404 returned error can't find the container with id 0d779d51217e08ca5d523fff8a1fb7813d7fcfc7b5e591c48986058a71f626ed
Jul 29 14:40:49.236761 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:40:49.236745    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 14:40:49.548783 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:40:49.548752    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rxzq4" event={"ID":"2ac9fcc9-0e92-4207-86c8-8e2f9ac7146a","Type":"ContainerStarted","Data":"0d779d51217e08ca5d523fff8a1fb7813d7fcfc7b5e591c48986058a71f626ed"}
Jul 29 14:40:52.563884 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:40:52.563849    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rxzq4" event={"ID":"2ac9fcc9-0e92-4207-86c8-8e2f9ac7146a","Type":"ContainerStarted","Data":"8d6cf717f5aab0168925166225c029367908fb42132496c3b579fb3ef2fe07d3"}
Jul 29 14:40:52.580557 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:40:52.580505    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rxzq4" podStartSLOduration=1.408436083 podStartE2EDuration="4.580489886s" totalImagesPullingTime="3.172053803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 14:40:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 14:40:52.579725347 +0000 UTC m=+324.882191949" watchObservedRunningTime="2026-07-29 14:40:52.580489886 +0000 UTC m=+324.882956492"
Jul 29 14:41:22.058797 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:22.058705    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g"]
Jul 29 14:41:22.062098 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:22.062076    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g"
Jul 29 14:41:22.064431 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:22.064407    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 29 14:41:22.064636 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:22.064622    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 29 14:41:22.064785 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:22.064766    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 29 14:41:22.064919 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:22.064901    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zq7td\""
Jul 29 14:41:22.064957 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:22.064931    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 29 14:41:22.078350 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:22.078327    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g"]
Jul 29 14:41:22.081304 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:22.081284    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/819750fd-a9e2-4690-8826-6bf85ad53ad7-tmp\") pod \"opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g\" (UID: \"819750fd-a9e2-4690-8826-6bf85ad53ad7\") " pod="opendatahub/opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g"
Jul 29 14:41:22.081399 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:22.081324    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/819750fd-a9e2-4690-8826-6bf85ad53ad7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g\" (UID: \"819750fd-a9e2-4690-8826-6bf85ad53ad7\") " pod="opendatahub/opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g"
Jul 29 14:41:22.081461 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:22.081399    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/819750fd-a9e2-4690-8826-6bf85ad53ad7-webhook-cert\") pod \"opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g\" (UID: \"819750fd-a9e2-4690-8826-6bf85ad53ad7\") " pod="opendatahub/opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g"
Jul 29 14:41:22.081508 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:22.081459    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97d9v\" (UniqueName: \"kubernetes.io/projected/819750fd-a9e2-4690-8826-6bf85ad53ad7-kube-api-access-97d9v\") pod \"opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g\" (UID: \"819750fd-a9e2-4690-8826-6bf85ad53ad7\") " pod="opendatahub/opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g"
Jul 29 14:41:22.081550 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:22.081526    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/819750fd-a9e2-4690-8826-6bf85ad53ad7-manifests\") pod \"opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g\" (UID: \"819750fd-a9e2-4690-8826-6bf85ad53ad7\") " pod="opendatahub/opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g"
Jul 29 14:41:22.182642 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:22.182616    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/819750fd-a9e2-4690-8826-6bf85ad53ad7-tmp\") pod \"opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g\" (UID: \"819750fd-a9e2-4690-8826-6bf85ad53ad7\") " pod="opendatahub/opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g"
Jul 29 14:41:22.182817 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:22.182653    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/819750fd-a9e2-4690-8826-6bf85ad53ad7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g\" (UID: \"819750fd-a9e2-4690-8826-6bf85ad53ad7\") " pod="opendatahub/opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g"
Jul 29 14:41:22.182817 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:22.182681    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/819750fd-a9e2-4690-8826-6bf85ad53ad7-webhook-cert\") pod \"opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g\" (UID: \"819750fd-a9e2-4690-8826-6bf85ad53ad7\") " pod="opendatahub/opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g"
Jul 29 14:41:22.182817 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:22.182727    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97d9v\" (UniqueName: \"kubernetes.io/projected/819750fd-a9e2-4690-8826-6bf85ad53ad7-kube-api-access-97d9v\") pod \"opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g\" (UID: \"819750fd-a9e2-4690-8826-6bf85ad53ad7\") " pod="opendatahub/opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g"
Jul 29 14:41:22.182817 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:22.182786    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/819750fd-a9e2-4690-8826-6bf85ad53ad7-manifests\") pod \"opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g\" (UID: \"819750fd-a9e2-4690-8826-6bf85ad53ad7\") " pod="opendatahub/opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g"
Jul 29 14:41:22.183121 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:22.183102    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/819750fd-a9e2-4690-8826-6bf85ad53ad7-manifests\") pod \"opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g\" (UID: \"819750fd-a9e2-4690-8826-6bf85ad53ad7\") " pod="opendatahub/opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g"
Jul 29 14:41:22.184716 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:22.184685    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/819750fd-a9e2-4690-8826-6bf85ad53ad7-tmp\") pod \"opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g\" (UID: \"819750fd-a9e2-4690-8826-6bf85ad53ad7\") " pod="opendatahub/opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g"
Jul 29 14:41:22.184884 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:22.184866    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/819750fd-a9e2-4690-8826-6bf85ad53ad7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g\" (UID: \"819750fd-a9e2-4690-8826-6bf85ad53ad7\") " pod="opendatahub/opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g"
Jul 29 14:41:22.184884 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:22.184879    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/819750fd-a9e2-4690-8826-6bf85ad53ad7-webhook-cert\") pod \"opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g\" (UID: \"819750fd-a9e2-4690-8826-6bf85ad53ad7\") " pod="opendatahub/opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g"
Jul 29 14:41:22.193615 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:22.193597    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97d9v\" (UniqueName: \"kubernetes.io/projected/819750fd-a9e2-4690-8826-6bf85ad53ad7-kube-api-access-97d9v\") pod \"opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g\" (UID: \"819750fd-a9e2-4690-8826-6bf85ad53ad7\") " pod="opendatahub/opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g"
Jul 29 14:41:22.372648 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:22.372560    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g"
Jul 29 14:41:22.499888 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:22.499865    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g"]
Jul 29 14:41:22.502737 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:41:22.502714    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod819750fd_a9e2_4690_8826_6bf85ad53ad7.slice/crio-4872a549ee0d2216f65de641470482cf2bd25fe7f5491de23c9a9f1a0e38d499 WatchSource:0}: Error finding container 4872a549ee0d2216f65de641470482cf2bd25fe7f5491de23c9a9f1a0e38d499: Status 404 returned error can't find the container with id 4872a549ee0d2216f65de641470482cf2bd25fe7f5491de23c9a9f1a0e38d499
Jul 29 14:41:22.667029 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:22.666945    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g" event={"ID":"819750fd-a9e2-4690-8826-6bf85ad53ad7","Type":"ContainerStarted","Data":"4872a549ee0d2216f65de641470482cf2bd25fe7f5491de23c9a9f1a0e38d499"}
Jul 29 14:41:25.682380 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:25.682302    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g" event={"ID":"819750fd-a9e2-4690-8826-6bf85ad53ad7","Type":"ContainerStarted","Data":"6c2e1e83f4324bb4deb33b2670b5cb9d23eaf64776fa98fe5387d90c4fd9afdc"}
Jul 29 14:41:26.687655 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:26.687567    2578 generic.go:356] "Generic (PLEG): container finished" podID="819750fd-a9e2-4690-8826-6bf85ad53ad7" containerID="6c2e1e83f4324bb4deb33b2670b5cb9d23eaf64776fa98fe5387d90c4fd9afdc" exitCode=0
Jul 29 14:41:26.688000 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:26.687650    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g" event={"ID":"819750fd-a9e2-4690-8826-6bf85ad53ad7","Type":"ContainerDied","Data":"6c2e1e83f4324bb4deb33b2670b5cb9d23eaf64776fa98fe5387d90c4fd9afdc"}
Jul 29 14:41:27.694165 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:27.694129    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g" event={"ID":"819750fd-a9e2-4690-8826-6bf85ad53ad7","Type":"ContainerStarted","Data":"d5d9a1bc2a890cae3d3ebc108258b7a2d835c47398f2cd1d499b0229ca1ce8b6"}
Jul 29 14:41:27.694653 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:27.694291    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g"
Jul 29 14:41:27.728714 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:27.728667    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g" podStartSLOduration=1.487863585 podStartE2EDuration="5.728651485s" totalImagesPullingTime="3.205707688s" totalInitContainerRuntime="1.035080212s" isStatefulPod=false podCreationTimestamp="2026-07-29 14:41:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 14:41:27.726587146 +0000 UTC m=+360.029053751" watchObservedRunningTime="2026-07-29 14:41:27.728651485 +0000 UTC m=+360.031118092"
Jul 29 14:41:38.701329 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:38.701297    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g"
Jul 29 14:41:41.806850 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:41.806809    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-68ffcd8f6-z8x7c"]
Jul 29 14:41:41.818440 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:41.818393    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-68ffcd8f6-z8x7c"
Jul 29 14:41:41.822379 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:41.822350    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 29 14:41:41.822588 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:41.822570    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 29 14:41:41.822743 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:41.822449    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 29 14:41:41.822844 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:41.822350    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 29 14:41:41.822935 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:41.822494    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-gzx2x\""
Jul 29 14:41:41.823115 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:41.823092    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-68ffcd8f6-z8x7c"]
Jul 29 14:41:41.944640 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:41.944606    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ef89b7f-3230-49d7-9c32-202bd88c7771-tmp\") pod \"kube-auth-proxy-68ffcd8f6-z8x7c\" (UID: \"6ef89b7f-3230-49d7-9c32-202bd88c7771\") " pod="openshift-ingress/kube-auth-proxy-68ffcd8f6-z8x7c"
Jul 29 14:41:41.944640 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:41.944643    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ef89b7f-3230-49d7-9c32-202bd88c7771-tls-certs\") pod \"kube-auth-proxy-68ffcd8f6-z8x7c\" (UID: \"6ef89b7f-3230-49d7-9c32-202bd88c7771\") " pod="openshift-ingress/kube-auth-proxy-68ffcd8f6-z8x7c"
Jul 29 14:41:41.944859 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:41.944663    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxkvp\" (UniqueName: \"kubernetes.io/projected/6ef89b7f-3230-49d7-9c32-202bd88c7771-kube-api-access-bxkvp\") pod \"kube-auth-proxy-68ffcd8f6-z8x7c\" (UID: \"6ef89b7f-3230-49d7-9c32-202bd88c7771\") " pod="openshift-ingress/kube-auth-proxy-68ffcd8f6-z8x7c"
Jul 29 14:41:42.046121 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:42.046083    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ef89b7f-3230-49d7-9c32-202bd88c7771-tmp\") pod \"kube-auth-proxy-68ffcd8f6-z8x7c\" (UID: \"6ef89b7f-3230-49d7-9c32-202bd88c7771\") " pod="openshift-ingress/kube-auth-proxy-68ffcd8f6-z8x7c"
Jul 29 14:41:42.046306 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:42.046134    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ef89b7f-3230-49d7-9c32-202bd88c7771-tls-certs\") pod \"kube-auth-proxy-68ffcd8f6-z8x7c\" (UID: \"6ef89b7f-3230-49d7-9c32-202bd88c7771\") " pod="openshift-ingress/kube-auth-proxy-68ffcd8f6-z8x7c"
Jul 29 14:41:42.046306 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:42.046288    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxkvp\" (UniqueName: \"kubernetes.io/projected/6ef89b7f-3230-49d7-9c32-202bd88c7771-kube-api-access-bxkvp\") pod \"kube-auth-proxy-68ffcd8f6-z8x7c\" (UID: \"6ef89b7f-3230-49d7-9c32-202bd88c7771\") " pod="openshift-ingress/kube-auth-proxy-68ffcd8f6-z8x7c"
Jul 29 14:41:42.048612 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:42.048573    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ef89b7f-3230-49d7-9c32-202bd88c7771-tmp\") pod \"kube-auth-proxy-68ffcd8f6-z8x7c\" (UID: \"6ef89b7f-3230-49d7-9c32-202bd88c7771\") " pod="openshift-ingress/kube-auth-proxy-68ffcd8f6-z8x7c"
Jul 29 14:41:42.049072 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:42.049051    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ef89b7f-3230-49d7-9c32-202bd88c7771-tls-certs\") pod \"kube-auth-proxy-68ffcd8f6-z8x7c\" (UID: \"6ef89b7f-3230-49d7-9c32-202bd88c7771\") " pod="openshift-ingress/kube-auth-proxy-68ffcd8f6-z8x7c"
Jul 29 14:41:42.057914 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:42.057853    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxkvp\" (UniqueName: \"kubernetes.io/projected/6ef89b7f-3230-49d7-9c32-202bd88c7771-kube-api-access-bxkvp\") pod \"kube-auth-proxy-68ffcd8f6-z8x7c\" (UID: \"6ef89b7f-3230-49d7-9c32-202bd88c7771\") " pod="openshift-ingress/kube-auth-proxy-68ffcd8f6-z8x7c"
Jul 29 14:41:42.131750 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:42.131716    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-68ffcd8f6-z8x7c"
Jul 29 14:41:42.272149 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:42.272018    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-68ffcd8f6-z8x7c"]
Jul 29 14:41:42.275497 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:41:42.275467    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ef89b7f_3230_49d7_9c32_202bd88c7771.slice/crio-42574f308e196f4c752940930951a4b876b60ad3fbb607622abf51b92cbcbfaa WatchSource:0}: Error finding container 42574f308e196f4c752940930951a4b876b60ad3fbb607622abf51b92cbcbfaa: Status 404 returned error can't find the container with id 42574f308e196f4c752940930951a4b876b60ad3fbb607622abf51b92cbcbfaa
Jul 29 14:41:42.754602 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:42.753064    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qglhw"]
Jul 29 14:41:42.759121 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:42.758373    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-68ffcd8f6-z8x7c" event={"ID":"6ef89b7f-3230-49d7-9c32-202bd88c7771","Type":"ContainerStarted","Data":"42574f308e196f4c752940930951a4b876b60ad3fbb607622abf51b92cbcbfaa"}
Jul 29 14:41:42.759121 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:42.758487    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-qglhw"
Jul 29 14:41:42.761722 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:42.761536    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 29 14:41:42.778907 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:42.778869    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qglhw"]
Jul 29 14:41:42.854014 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:42.853974    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj9t2\" (UniqueName: \"kubernetes.io/projected/51d991f1-423f-41e0-81cf-c3d859149afd-kube-api-access-zj9t2\") pod \"model-serving-api-54d89bd5fc-qglhw\" (UID: \"51d991f1-423f-41e0-81cf-c3d859149afd\") " pod="opendatahub/model-serving-api-54d89bd5fc-qglhw"
Jul 29 14:41:42.854487 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:42.854113    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51d991f1-423f-41e0-81cf-c3d859149afd-tls-certs\") pod \"model-serving-api-54d89bd5fc-qglhw\" (UID: \"51d991f1-423f-41e0-81cf-c3d859149afd\") " pod="opendatahub/model-serving-api-54d89bd5fc-qglhw"
Jul 29 14:41:42.954612 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:42.954567    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51d991f1-423f-41e0-81cf-c3d859149afd-tls-certs\") pod \"model-serving-api-54d89bd5fc-qglhw\" (UID: \"51d991f1-423f-41e0-81cf-c3d859149afd\") " pod="opendatahub/model-serving-api-54d89bd5fc-qglhw"
Jul 29 14:41:42.954780 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:42.954639    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj9t2\" (UniqueName: \"kubernetes.io/projected/51d991f1-423f-41e0-81cf-c3d859149afd-kube-api-access-zj9t2\") pod \"model-serving-api-54d89bd5fc-qglhw\" (UID: \"51d991f1-423f-41e0-81cf-c3d859149afd\") " pod="opendatahub/model-serving-api-54d89bd5fc-qglhw"
Jul 29 14:41:42.954780 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:41:42.954737    2578 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 29 14:41:42.954856 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:41:42.954806    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51d991f1-423f-41e0-81cf-c3d859149afd-tls-certs podName:51d991f1-423f-41e0-81cf-c3d859149afd nodeName:}" failed. No retries permitted until 2026-07-29 14:41:43.454785897 +0000 UTC m=+375.757252496 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/51d991f1-423f-41e0-81cf-c3d859149afd-tls-certs") pod "model-serving-api-54d89bd5fc-qglhw" (UID: "51d991f1-423f-41e0-81cf-c3d859149afd") : secret "model-serving-api-tls" not found
Jul 29 14:41:42.969452 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:42.969411    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj9t2\" (UniqueName: \"kubernetes.io/projected/51d991f1-423f-41e0-81cf-c3d859149afd-kube-api-access-zj9t2\") pod \"model-serving-api-54d89bd5fc-qglhw\" (UID: \"51d991f1-423f-41e0-81cf-c3d859149afd\") " pod="opendatahub/model-serving-api-54d89bd5fc-qglhw"
Jul 29 14:41:43.459400 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:43.459359    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51d991f1-423f-41e0-81cf-c3d859149afd-tls-certs\") pod \"model-serving-api-54d89bd5fc-qglhw\" (UID: \"51d991f1-423f-41e0-81cf-c3d859149afd\") " pod="opendatahub/model-serving-api-54d89bd5fc-qglhw"
Jul 29 14:41:43.462491 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:43.462431    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51d991f1-423f-41e0-81cf-c3d859149afd-tls-certs\") pod \"model-serving-api-54d89bd5fc-qglhw\" (UID: \"51d991f1-423f-41e0-81cf-c3d859149afd\") " pod="opendatahub/model-serving-api-54d89bd5fc-qglhw"
Jul 29 14:41:43.680267 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:43.680217    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-qglhw"
Jul 29 14:41:43.829335 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:43.829224    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qglhw"]
Jul 29 14:41:43.835663 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:41:43.835627    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51d991f1_423f_41e0_81cf_c3d859149afd.slice/crio-99193675b2378845afc01a48f769daea4e05d574cf8fb60d2d47d17168d0b469 WatchSource:0}: Error finding container 99193675b2378845afc01a48f769daea4e05d574cf8fb60d2d47d17168d0b469: Status 404 returned error can't find the container with id 99193675b2378845afc01a48f769daea4e05d574cf8fb60d2d47d17168d0b469
Jul 29 14:41:44.765474 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:44.765435    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-qglhw" event={"ID":"51d991f1-423f-41e0-81cf-c3d859149afd","Type":"ContainerStarted","Data":"99193675b2378845afc01a48f769daea4e05d574cf8fb60d2d47d17168d0b469"}
Jul 29 14:41:45.771969 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:45.771932    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-68ffcd8f6-z8x7c" event={"ID":"6ef89b7f-3230-49d7-9c32-202bd88c7771","Type":"ContainerStarted","Data":"2df8dbd7792bec02fbcd7ee3fbbd14b76958a5fc1501d79ea8a185856149bf08"}
Jul 29 14:41:46.777799 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:46.777753    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-qglhw" event={"ID":"51d991f1-423f-41e0-81cf-c3d859149afd","Type":"ContainerStarted","Data":"46c15a92c6ca6325885e8806688e75ac8ce9e3dc1556a1db418e3f8728238868"}
Jul 29 14:41:46.778267 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:46.777901    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-qglhw"
Jul 29 14:41:46.799163 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:46.799104    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-68ffcd8f6-z8x7c" podStartSLOduration=3.14002187 podStartE2EDuration="5.79908896s" totalImagesPullingTime="2.65906709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 14:41:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 14:41:45.798207296 +0000 UTC m=+378.100673932" watchObservedRunningTime="2026-07-29 14:41:46.79908896 +0000 UTC m=+379.101555567"
Jul 29 14:41:46.799394 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:46.799205    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-qglhw" podStartSLOduration=2.5639165 podStartE2EDuration="4.799196298s" totalImagesPullingTime="2.235279798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 14:41:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 14:41:46.798474946 +0000 UTC m=+379.100941553" watchObservedRunningTime="2026-07-29 14:41:46.799196298 +0000 UTC m=+379.101662906"
Jul 29 14:41:48.764670 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:48.764634    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg"]
Jul 29 14:41:48.768063 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:48.768039    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg"
Jul 29 14:41:48.770739 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:48.770714    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-kggxt\""
Jul 29 14:41:48.770981 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:48.770827    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 29 14:41:48.794059 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:48.792615    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg"]
Jul 29 14:41:48.910870 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:48.910835    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93a8478b-bc49-484c-bd3b-7e978bbfb159-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg\" (UID: \"93a8478b-bc49-484c-bd3b-7e978bbfb159\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg"
Jul 29 14:41:48.911076 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:48.910893    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93a8478b-bc49-484c-bd3b-7e978bbfb159-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg\" (UID: \"93a8478b-bc49-484c-bd3b-7e978bbfb159\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg"
Jul 29 14:41:48.911076 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:48.910922    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93a8478b-bc49-484c-bd3b-7e978bbfb159-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg\" (UID: \"93a8478b-bc49-484c-bd3b-7e978bbfb159\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg"
Jul 29 14:41:48.911076 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:48.910946    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93a8478b-bc49-484c-bd3b-7e978bbfb159-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg\" (UID: \"93a8478b-bc49-484c-bd3b-7e978bbfb159\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg"
Jul 29 14:41:48.911076 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:48.910964    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xzjc\" (UniqueName: \"kubernetes.io/projected/93a8478b-bc49-484c-bd3b-7e978bbfb159-kube-api-access-2xzjc\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg\" (UID: \"93a8478b-bc49-484c-bd3b-7e978bbfb159\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg"
Jul 29 14:41:48.911254 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:48.911108    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93a8478b-bc49-484c-bd3b-7e978bbfb159-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg\" (UID: \"93a8478b-bc49-484c-bd3b-7e978bbfb159\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg"
Jul 29 14:41:48.911254 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:48.911142    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93a8478b-bc49-484c-bd3b-7e978bbfb159-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg\" (UID: \"93a8478b-bc49-484c-bd3b-7e978bbfb159\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg"
Jul 29 14:41:48.911254 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:48.911172    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93a8478b-bc49-484c-bd3b-7e978bbfb159-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg\" (UID: \"93a8478b-bc49-484c-bd3b-7e978bbfb159\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg"
Jul 29 14:41:48.911254 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:48.911189    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93a8478b-bc49-484c-bd3b-7e978bbfb159-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg\" (UID: \"93a8478b-bc49-484c-bd3b-7e978bbfb159\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg"
Jul 29 14:41:49.011766 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:49.011717    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93a8478b-bc49-484c-bd3b-7e978bbfb159-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg\" (UID: \"93a8478b-bc49-484c-bd3b-7e978bbfb159\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg"
Jul 29 14:41:49.011766 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:49.011765    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93a8478b-bc49-484c-bd3b-7e978bbfb159-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg\" (UID: \"93a8478b-bc49-484c-bd3b-7e978bbfb159\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg"
Jul 29 14:41:49.012011 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:49.011786    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93a8478b-bc49-484c-bd3b-7e978bbfb159-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg\" (UID: \"93a8478b-bc49-484c-bd3b-7e978bbfb159\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg"
Jul 29 14:41:49.012011 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:49.011909    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xzjc\" (UniqueName: \"kubernetes.io/projected/93a8478b-bc49-484c-bd3b-7e978bbfb159-kube-api-access-2xzjc\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg\" (UID: \"93a8478b-bc49-484c-bd3b-7e978bbfb159\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg"
Jul 29 14:41:49.012011 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:49.011981    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93a8478b-bc49-484c-bd3b-7e978bbfb159-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg\" (UID: \"93a8478b-bc49-484c-bd3b-7e978bbfb159\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg"
Jul 29 14:41:49.012011 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:49.012005    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93a8478b-bc49-484c-bd3b-7e978bbfb159-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg\" (UID: \"93a8478b-bc49-484c-bd3b-7e978bbfb159\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg"
Jul 29 14:41:49.012209 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:49.012027    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93a8478b-bc49-484c-bd3b-7e978bbfb159-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg\" (UID: \"93a8478b-bc49-484c-bd3b-7e978bbfb159\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg"
Jul 29 14:41:49.012209 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:49.012052    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93a8478b-bc49-484c-bd3b-7e978bbfb159-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg\" (UID: \"93a8478b-bc49-484c-bd3b-7e978bbfb159\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg"
Jul 29 14:41:49.012209 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:49.012095    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93a8478b-bc49-484c-bd3b-7e978bbfb159-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg\" (UID: \"93a8478b-bc49-484c-bd3b-7e978bbfb159\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg"
Jul 29 14:41:49.012378 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:49.012286    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93a8478b-bc49-484c-bd3b-7e978bbfb159-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg\" (UID: \"93a8478b-bc49-484c-bd3b-7e978bbfb159\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg"
Jul 29 14:41:49.012478 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:49.012459    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93a8478b-bc49-484c-bd3b-7e978bbfb159-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg\" (UID: \"93a8478b-bc49-484c-bd3b-7e978bbfb159\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg"
Jul 29 14:41:49.012533 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:49.012510    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93a8478b-bc49-484c-bd3b-7e978bbfb159-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg\" (UID: \"93a8478b-bc49-484c-bd3b-7e978bbfb159\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg"
Jul 29 14:41:49.012648 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:49.012616    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93a8478b-bc49-484c-bd3b-7e978bbfb159-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg\" (UID: \"93a8478b-bc49-484c-bd3b-7e978bbfb159\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg"
Jul 29 14:41:49.012779 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:49.012737    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93a8478b-bc49-484c-bd3b-7e978bbfb159-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg\" (UID: \"93a8478b-bc49-484c-bd3b-7e978bbfb159\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg"
Jul 29 14:41:49.014038 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:49.014020    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93a8478b-bc49-484c-bd3b-7e978bbfb159-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg\" (UID: \"93a8478b-bc49-484c-bd3b-7e978bbfb159\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg"
Jul 29 14:41:49.014452 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:49.014434    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93a8478b-bc49-484c-bd3b-7e978bbfb159-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg\" (UID: \"93a8478b-bc49-484c-bd3b-7e978bbfb159\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg"
Jul 29 14:41:49.020563 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:49.020486    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93a8478b-bc49-484c-bd3b-7e978bbfb159-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg\" (UID: \"93a8478b-bc49-484c-bd3b-7e978bbfb159\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg"
Jul 29 14:41:49.020705 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:49.020681    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xzjc\" (UniqueName: \"kubernetes.io/projected/93a8478b-bc49-484c-bd3b-7e978bbfb159-kube-api-access-2xzjc\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg\" (UID: \"93a8478b-bc49-484c-bd3b-7e978bbfb159\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg"
Jul 29 14:41:49.078779 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:49.078736    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg"
Jul 29 14:41:49.236426 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:49.236401    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg"]
Jul 29 14:41:49.238142 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:41:49.238113    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93a8478b_bc49_484c_bd3b_7e978bbfb159.slice/crio-5c906c3a027e435283ec9bac188c7c3cd9b63b4fd8e9b1643359c8c1317c81e6 WatchSource:0}: Error finding container 5c906c3a027e435283ec9bac188c7c3cd9b63b4fd8e9b1643359c8c1317c81e6: Status 404 returned error can't find the container with id 5c906c3a027e435283ec9bac188c7c3cd9b63b4fd8e9b1643359c8c1317c81e6
Jul 29 14:41:49.791376 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:49.791344    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg" event={"ID":"93a8478b-bc49-484c-bd3b-7e978bbfb159","Type":"ContainerStarted","Data":"5c906c3a027e435283ec9bac188c7c3cd9b63b4fd8e9b1643359c8c1317c81e6"}
Jul 29 14:41:49.921093 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:49.921057    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-856778fb54-q4pb7"]
Jul 29 14:41:49.925314 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:49.925292    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-856778fb54-q4pb7"
Jul 29 14:41:49.929174 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:49.929124    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 29 14:41:49.929174 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:49.929124    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 29 14:41:49.929375 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:49.929197    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-7cqkr\""
Jul 29 14:41:49.929375 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:49.929223    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 29 14:41:49.929375 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:49.929227    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 29 14:41:49.929375 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:49.929288    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 29 14:41:49.933422 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:49.933387    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-856778fb54-q4pb7"]
Jul 29 14:41:50.025872 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:50.025839    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bdb265f3-9e91-4702-aecf-7b9d05602728-cert\") pod \"lws-controller-manager-856778fb54-q4pb7\" (UID: \"bdb265f3-9e91-4702-aecf-7b9d05602728\") " pod="openshift-lws-operator/lws-controller-manager-856778fb54-q4pb7"
Jul 29 14:41:50.025872 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:50.025877    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bdb265f3-9e91-4702-aecf-7b9d05602728-metrics-cert\") pod \"lws-controller-manager-856778fb54-q4pb7\" (UID: \"bdb265f3-9e91-4702-aecf-7b9d05602728\") " pod="openshift-lws-operator/lws-controller-manager-856778fb54-q4pb7"
Jul 29 14:41:50.026107 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:50.025951    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bdb265f3-9e91-4702-aecf-7b9d05602728-manager-config\") pod \"lws-controller-manager-856778fb54-q4pb7\" (UID: \"bdb265f3-9e91-4702-aecf-7b9d05602728\") " pod="openshift-lws-operator/lws-controller-manager-856778fb54-q4pb7"
Jul 29 14:41:50.026107 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:50.025989    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8m6r\" (UniqueName: \"kubernetes.io/projected/bdb265f3-9e91-4702-aecf-7b9d05602728-kube-api-access-h8m6r\") pod \"lws-controller-manager-856778fb54-q4pb7\" (UID: \"bdb265f3-9e91-4702-aecf-7b9d05602728\") " pod="openshift-lws-operator/lws-controller-manager-856778fb54-q4pb7"
Jul 29 14:41:50.127333 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:50.127219    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bdb265f3-9e91-4702-aecf-7b9d05602728-manager-config\") pod \"lws-controller-manager-856778fb54-q4pb7\" (UID: \"bdb265f3-9e91-4702-aecf-7b9d05602728\") " pod="openshift-lws-operator/lws-controller-manager-856778fb54-q4pb7"
Jul 29 14:41:50.127333 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:50.127281    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8m6r\" (UniqueName: \"kubernetes.io/projected/bdb265f3-9e91-4702-aecf-7b9d05602728-kube-api-access-h8m6r\") pod \"lws-controller-manager-856778fb54-q4pb7\" (UID: \"bdb265f3-9e91-4702-aecf-7b9d05602728\") " pod="openshift-lws-operator/lws-controller-manager-856778fb54-q4pb7"
Jul 29 14:41:50.127566 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:50.127364    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bdb265f3-9e91-4702-aecf-7b9d05602728-cert\") pod \"lws-controller-manager-856778fb54-q4pb7\" (UID: \"bdb265f3-9e91-4702-aecf-7b9d05602728\") " pod="openshift-lws-operator/lws-controller-manager-856778fb54-q4pb7"
Jul 29 14:41:50.127566 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:50.127392    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bdb265f3-9e91-4702-aecf-7b9d05602728-metrics-cert\") pod \"lws-controller-manager-856778fb54-q4pb7\" (UID: \"bdb265f3-9e91-4702-aecf-7b9d05602728\") " pod="openshift-lws-operator/lws-controller-manager-856778fb54-q4pb7"
Jul 29 14:41:50.127855 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:50.127831    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bdb265f3-9e91-4702-aecf-7b9d05602728-manager-config\") pod \"lws-controller-manager-856778fb54-q4pb7\" (UID: \"bdb265f3-9e91-4702-aecf-7b9d05602728\") " pod="openshift-lws-operator/lws-controller-manager-856778fb54-q4pb7"
Jul 29 14:41:50.129765 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:50.129743    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bdb265f3-9e91-4702-aecf-7b9d05602728-metrics-cert\") pod \"lws-controller-manager-856778fb54-q4pb7\" (UID: \"bdb265f3-9e91-4702-aecf-7b9d05602728\") " pod="openshift-lws-operator/lws-controller-manager-856778fb54-q4pb7"
Jul 29 14:41:50.129850 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:50.129836    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bdb265f3-9e91-4702-aecf-7b9d05602728-cert\") pod \"lws-controller-manager-856778fb54-q4pb7\" (UID: \"bdb265f3-9e91-4702-aecf-7b9d05602728\") " pod="openshift-lws-operator/lws-controller-manager-856778fb54-q4pb7"
Jul 29 14:41:50.135167 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:50.135150    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8m6r\" (UniqueName: \"kubernetes.io/projected/bdb265f3-9e91-4702-aecf-7b9d05602728-kube-api-access-h8m6r\") pod \"lws-controller-manager-856778fb54-q4pb7\" (UID: \"bdb265f3-9e91-4702-aecf-7b9d05602728\") " pod="openshift-lws-operator/lws-controller-manager-856778fb54-q4pb7"
Jul 29 14:41:50.235337 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:50.235297    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-856778fb54-q4pb7"
Jul 29 14:41:50.376618 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:50.376590    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-856778fb54-q4pb7"]
Jul 29 14:41:50.379353 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:41:50.379278    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdb265f3_9e91_4702_aecf_7b9d05602728.slice/crio-15cb42b759d881d0d83a3fcd114d87733acd6097b20c7e977cf62c8ca12500e8 WatchSource:0}: Error finding container 15cb42b759d881d0d83a3fcd114d87733acd6097b20c7e977cf62c8ca12500e8: Status 404 returned error can't find the container with id 15cb42b759d881d0d83a3fcd114d87733acd6097b20c7e977cf62c8ca12500e8
Jul 29 14:41:50.796844 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:50.796808    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-856778fb54-q4pb7" event={"ID":"bdb265f3-9e91-4702-aecf-7b9d05602728","Type":"ContainerStarted","Data":"15cb42b759d881d0d83a3fcd114d87733acd6097b20c7e977cf62c8ca12500e8"}
Jul 29 14:41:53.811225 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:53.811189    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-856778fb54-q4pb7" event={"ID":"bdb265f3-9e91-4702-aecf-7b9d05602728","Type":"ContainerStarted","Data":"b1c8dd896dedde503a720d31de71b91f9771b9b89b5505f14fa16c8dca8bcc16"}
Jul 29 14:41:53.811600 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:53.811282    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-856778fb54-q4pb7"
Jul 29 14:41:53.834056 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:53.834011    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-856778fb54-q4pb7" podStartSLOduration=2.224604914 podStartE2EDuration="4.833996701s" totalImagesPullingTime="2.609391787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 14:41:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 14:41:53.832092661 +0000 UTC m=+386.134559294" watchObservedRunningTime="2026-07-29 14:41:53.833996701 +0000 UTC m=+386.136463367"
Jul 29 14:41:57.786001 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:41:57.785971    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-qglhw"
Jul 29 14:42:00.787192 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:42:00.787155    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 14:42:00.787556 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:42:00.787259    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 14:42:00.787556 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:42:00.787304    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 14:42:01.848409 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:42:01.848367    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg" event={"ID":"93a8478b-bc49-484c-bd3b-7e978bbfb159","Type":"ContainerStarted","Data":"dae8a861c9c0976efb58a57021b248f104632761fcfdc5a244f663c9d61f5ce8"}
Jul 29 14:42:01.871634 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:42:01.871586    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg" podStartSLOduration=2.324756119 podStartE2EDuration="13.871570449s" totalImagesPullingTime="11.54681433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 14:41:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 14:42:01.870943334 +0000 UTC m=+394.173409940" watchObservedRunningTime="2026-07-29 14:42:01.871570449 +0000 UTC m=+394.174037056"
Jul 29 14:42:02.079838 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:42:02.079799    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg"
Jul 29 14:42:02.084175 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:42:02.084151    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg"
Jul 29 14:42:02.854012 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:42:02.853854    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg"
Jul 29 14:42:02.855397 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:42:02.855376    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg"
Jul 29 14:42:04.818876 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:42:04.818843    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-856778fb54-q4pb7"
Jul 29 14:43:28.148495 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:43:28.148466    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-pm2l8"]
Jul 29 14:43:28.151746 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:43:28.151729    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pm2l8"
Jul 29 14:43:28.154481 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:43:28.154446    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 29 14:43:28.154582 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:43:28.154568    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 29 14:43:28.154637 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:43:28.154567    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-bvthn\""
Jul 29 14:43:28.155715 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:43:28.155702    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 29 14:43:28.155790 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:43:28.155703    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 29 14:43:28.159948 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:43:28.159921    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-pm2l8"]
Jul 29 14:43:28.186060 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:43:28.186039    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/676a23a3-d552-493a-818c-2460ccd064e6-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-pm2l8\" (UID: \"676a23a3-d552-493a-818c-2460ccd064e6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pm2l8"
Jul 29 14:43:28.186151 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:43:28.186069    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxwqw\" (UniqueName: \"kubernetes.io/projected/676a23a3-d552-493a-818c-2460ccd064e6-kube-api-access-fxwqw\") pod \"kuadrant-console-plugin-66b5774985-pm2l8\" (UID: \"676a23a3-d552-493a-818c-2460ccd064e6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pm2l8"
Jul 29 14:43:28.186151 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:43:28.186110    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/676a23a3-d552-493a-818c-2460ccd064e6-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-pm2l8\" (UID: \"676a23a3-d552-493a-818c-2460ccd064e6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pm2l8"
Jul 29 14:43:28.287309 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:43:28.287283    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/676a23a3-d552-493a-818c-2460ccd064e6-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-pm2l8\" (UID: \"676a23a3-d552-493a-818c-2460ccd064e6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pm2l8"
Jul 29 14:43:28.287449 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:43:28.287360    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/676a23a3-d552-493a-818c-2460ccd064e6-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-pm2l8\" (UID: \"676a23a3-d552-493a-818c-2460ccd064e6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pm2l8"
Jul 29 14:43:28.287449 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:43:28.287389    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxwqw\" (UniqueName: \"kubernetes.io/projected/676a23a3-d552-493a-818c-2460ccd064e6-kube-api-access-fxwqw\") pod \"kuadrant-console-plugin-66b5774985-pm2l8\" (UID: \"676a23a3-d552-493a-818c-2460ccd064e6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pm2l8"
Jul 29 14:43:28.288206 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:43:28.288173    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/676a23a3-d552-493a-818c-2460ccd064e6-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-pm2l8\" (UID: \"676a23a3-d552-493a-818c-2460ccd064e6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pm2l8"
Jul 29 14:43:28.289701 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:43:28.289681    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/676a23a3-d552-493a-818c-2460ccd064e6-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-pm2l8\" (UID: \"676a23a3-d552-493a-818c-2460ccd064e6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pm2l8"
Jul 29 14:43:28.296848 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:43:28.296827    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxwqw\" (UniqueName: \"kubernetes.io/projected/676a23a3-d552-493a-818c-2460ccd064e6-kube-api-access-fxwqw\") pod \"kuadrant-console-plugin-66b5774985-pm2l8\" (UID: \"676a23a3-d552-493a-818c-2460ccd064e6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pm2l8"
Jul 29 14:43:28.460385 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:43:28.460321    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pm2l8"
Jul 29 14:43:28.583820 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:43:28.583751    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-pm2l8"]
Jul 29 14:43:28.586026 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:43:28.585999    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod676a23a3_d552_493a_818c_2460ccd064e6.slice/crio-4a6266c056e3ecacbdd0f599a7aec63e3f56313b5124b438e49e4e900be2ecb5 WatchSource:0}: Error finding container 4a6266c056e3ecacbdd0f599a7aec63e3f56313b5124b438e49e4e900be2ecb5: Status 404 returned error can't find the container with id 4a6266c056e3ecacbdd0f599a7aec63e3f56313b5124b438e49e4e900be2ecb5
Jul 29 14:43:29.225997 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:43:29.225965    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pm2l8" event={"ID":"676a23a3-d552-493a-818c-2460ccd064e6","Type":"ContainerStarted","Data":"4a6266c056e3ecacbdd0f599a7aec63e3f56313b5124b438e49e4e900be2ecb5"}
Jul 29 14:43:52.333896 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:43:52.333855    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pm2l8" event={"ID":"676a23a3-d552-493a-818c-2460ccd064e6","Type":"ContainerStarted","Data":"5a1c6911df4589ea007d7c6f64a375f930e48ce2c4e8722800887ad86a93ff3b"}
Jul 29 14:43:52.357148 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:43:52.357099    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pm2l8" podStartSLOduration=1.388396408 podStartE2EDuration="24.357085696s" totalImagesPullingTime="22.968689288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 14:43:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 14:43:52.355796029 +0000 UTC m=+504.658262637" watchObservedRunningTime="2026-07-29 14:43:52.357085696 +0000 UTC m=+504.659552302"
Jul 29 14:44:07.714837 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:07.714801    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn"]
Jul 29 14:44:07.757440 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:07.757414    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn"]
Jul 29 14:44:07.757589 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:07.757508    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn"
Jul 29 14:44:07.761316 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:07.761293    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-vj8kx\""
Jul 29 14:44:07.927421 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:07.927388    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5571b540-dc6c-40a3-936d-3bf485e23a83-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g2pdn\" (UID: \"5571b540-dc6c-40a3-936d-3bf485e23a83\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn"
Jul 29 14:44:07.927421 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:07.927422    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5571b540-dc6c-40a3-936d-3bf485e23a83-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g2pdn\" (UID: \"5571b540-dc6c-40a3-936d-3bf485e23a83\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn"
Jul 29 14:44:07.927668 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:07.927455    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5571b540-dc6c-40a3-936d-3bf485e23a83-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g2pdn\" (UID: \"5571b540-dc6c-40a3-936d-3bf485e23a83\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn"
Jul 29 14:44:07.927668 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:07.927508    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5571b540-dc6c-40a3-936d-3bf485e23a83-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g2pdn\" (UID: \"5571b540-dc6c-40a3-936d-3bf485e23a83\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn"
Jul 29 14:44:07.927668 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:07.927552    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5571b540-dc6c-40a3-936d-3bf485e23a83-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g2pdn\" (UID: \"5571b540-dc6c-40a3-936d-3bf485e23a83\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn"
Jul 29 14:44:07.927668 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:07.927598    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6htq\" (UniqueName: \"kubernetes.io/projected/5571b540-dc6c-40a3-936d-3bf485e23a83-kube-api-access-j6htq\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g2pdn\" (UID: \"5571b540-dc6c-40a3-936d-3bf485e23a83\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn"
Jul 29 14:44:07.927668 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:07.927640    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5571b540-dc6c-40a3-936d-3bf485e23a83-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g2pdn\" (UID: \"5571b540-dc6c-40a3-936d-3bf485e23a83\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn"
Jul 29 14:44:07.927850 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:07.927712    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5571b540-dc6c-40a3-936d-3bf485e23a83-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g2pdn\" (UID: \"5571b540-dc6c-40a3-936d-3bf485e23a83\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn"
Jul 29 14:44:07.927850 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:07.927734    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5571b540-dc6c-40a3-936d-3bf485e23a83-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g2pdn\" (UID: \"5571b540-dc6c-40a3-936d-3bf485e23a83\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn"
Jul 29 14:44:08.028321 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:08.028287    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5571b540-dc6c-40a3-936d-3bf485e23a83-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g2pdn\" (UID: \"5571b540-dc6c-40a3-936d-3bf485e23a83\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn"
Jul 29 14:44:08.028321 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:08.028325    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5571b540-dc6c-40a3-936d-3bf485e23a83-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g2pdn\" (UID: \"5571b540-dc6c-40a3-936d-3bf485e23a83\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn"
Jul 29 14:44:08.028507 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:08.028342    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5571b540-dc6c-40a3-936d-3bf485e23a83-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g2pdn\" (UID: \"5571b540-dc6c-40a3-936d-3bf485e23a83\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn"
Jul 29 14:44:08.028507 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:08.028459    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5571b540-dc6c-40a3-936d-3bf485e23a83-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g2pdn\" (UID: \"5571b540-dc6c-40a3-936d-3bf485e23a83\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn"
Jul 29 14:44:08.028612 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:08.028597    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5571b540-dc6c-40a3-936d-3bf485e23a83-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g2pdn\" (UID: \"5571b540-dc6c-40a3-936d-3bf485e23a83\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn"
Jul 29 14:44:08.028668 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:08.028624    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5571b540-dc6c-40a3-936d-3bf485e23a83-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g2pdn\" (UID: \"5571b540-dc6c-40a3-936d-3bf485e23a83\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn"
Jul 29 14:44:08.028668 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:08.028655    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5571b540-dc6c-40a3-936d-3bf485e23a83-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g2pdn\" (UID: \"5571b540-dc6c-40a3-936d-3bf485e23a83\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn"
Jul 29 14:44:08.028668 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:08.028659    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5571b540-dc6c-40a3-936d-3bf485e23a83-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g2pdn\" (UID: \"5571b540-dc6c-40a3-936d-3bf485e23a83\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn"
Jul 29 14:44:08.028880 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:08.028685    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6htq\" (UniqueName: \"kubernetes.io/projected/5571b540-dc6c-40a3-936d-3bf485e23a83-kube-api-access-j6htq\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g2pdn\" (UID: \"5571b540-dc6c-40a3-936d-3bf485e23a83\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn"
Jul 29 14:44:08.028880 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:08.028721    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5571b540-dc6c-40a3-936d-3bf485e23a83-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g2pdn\" (UID: \"5571b540-dc6c-40a3-936d-3bf485e23a83\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn"
Jul 29 14:44:08.028880 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:08.028792    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5571b540-dc6c-40a3-936d-3bf485e23a83-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g2pdn\" (UID: \"5571b540-dc6c-40a3-936d-3bf485e23a83\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn"
Jul 29 14:44:08.029044 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:08.028983    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5571b540-dc6c-40a3-936d-3bf485e23a83-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g2pdn\" (UID: \"5571b540-dc6c-40a3-936d-3bf485e23a83\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn"
Jul 29 14:44:08.029044 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:08.029012    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5571b540-dc6c-40a3-936d-3bf485e23a83-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g2pdn\" (UID: \"5571b540-dc6c-40a3-936d-3bf485e23a83\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn"
Jul 29 14:44:08.029368 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:08.029348    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5571b540-dc6c-40a3-936d-3bf485e23a83-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g2pdn\" (UID: \"5571b540-dc6c-40a3-936d-3bf485e23a83\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn"
Jul 29 14:44:08.030600 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:08.030581    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5571b540-dc6c-40a3-936d-3bf485e23a83-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g2pdn\" (UID: \"5571b540-dc6c-40a3-936d-3bf485e23a83\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn"
Jul 29 14:44:08.030821 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:08.030802    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5571b540-dc6c-40a3-936d-3bf485e23a83-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g2pdn\" (UID: \"5571b540-dc6c-40a3-936d-3bf485e23a83\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn"
Jul 29 14:44:08.039595 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:08.039574    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6htq\" (UniqueName: \"kubernetes.io/projected/5571b540-dc6c-40a3-936d-3bf485e23a83-kube-api-access-j6htq\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g2pdn\" (UID: \"5571b540-dc6c-40a3-936d-3bf485e23a83\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn"
Jul 29 14:44:08.039693 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:08.039619    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5571b540-dc6c-40a3-936d-3bf485e23a83-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-g2pdn\" (UID: \"5571b540-dc6c-40a3-936d-3bf485e23a83\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn"
Jul 29 14:44:08.067642 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:08.067611    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn"
Jul 29 14:44:08.237254 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:08.237205    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn"]
Jul 29 14:44:08.240252 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:44:08.240218    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5571b540_dc6c_40a3_936d_3bf485e23a83.slice/crio-c4dfdbe0eab8a2181cadbade42fe7d18cdfed7e0c0a0fcf79005a37f283bc0c8 WatchSource:0}: Error finding container c4dfdbe0eab8a2181cadbade42fe7d18cdfed7e0c0a0fcf79005a37f283bc0c8: Status 404 returned error can't find the container with id c4dfdbe0eab8a2181cadbade42fe7d18cdfed7e0c0a0fcf79005a37f283bc0c8
Jul 29 14:44:08.242120 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:08.242093    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 14:44:08.242175 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:08.242155    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 14:44:08.242209 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:08.242184    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 14:44:08.403515 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:08.403479    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn" event={"ID":"5571b540-dc6c-40a3-936d-3bf485e23a83","Type":"ContainerStarted","Data":"0b6d55ff5a2ce0edbd6ea984af7d192fbd25cddbed0228d56a00466d12fc2c14"}
Jul 29 14:44:08.403676 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:08.403528    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn" event={"ID":"5571b540-dc6c-40a3-936d-3bf485e23a83","Type":"ContainerStarted","Data":"c4dfdbe0eab8a2181cadbade42fe7d18cdfed7e0c0a0fcf79005a37f283bc0c8"}
Jul 29 14:44:08.431629 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:08.431578    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn" podStartSLOduration=1.43156401 podStartE2EDuration="1.43156401s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 14:44:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 14:44:08.43046666 +0000 UTC m=+520.732933268" watchObservedRunningTime="2026-07-29 14:44:08.43156401 +0000 UTC m=+520.734030617"
Jul 29 14:44:09.068180 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:09.068143    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn"
Jul 29 14:44:09.072658 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:09.072634    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn"
Jul 29 14:44:09.408136 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:09.408059    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn"
Jul 29 14:44:09.408869 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:09.408847    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn"
Jul 29 14:44:22.613158 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:22.613084    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:44:22.670631 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:22.670603    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:44:22.670765 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:22.670641    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:44:22.670765 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:22.670709    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"
Jul 29 14:44:22.673314 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:22.673292    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 29 14:44:22.750578 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:22.750557    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9zh9\" (UniqueName: \"kubernetes.io/projected/85b718ed-49e5-419c-a635-5033955e9805-kube-api-access-v9zh9\") pod \"limitador-limitador-54d6d988d5-jnr2g\" (UID: \"85b718ed-49e5-419c-a635-5033955e9805\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"
Jul 29 14:44:22.750679 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:22.750617    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/85b718ed-49e5-419c-a635-5033955e9805-config-file\") pod \"limitador-limitador-54d6d988d5-jnr2g\" (UID: \"85b718ed-49e5-419c-a635-5033955e9805\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"
Jul 29 14:44:22.851087 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:22.851060    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/85b718ed-49e5-419c-a635-5033955e9805-config-file\") pod \"limitador-limitador-54d6d988d5-jnr2g\" (UID: \"85b718ed-49e5-419c-a635-5033955e9805\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"
Jul 29 14:44:22.851183 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:22.851117    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9zh9\" (UniqueName: \"kubernetes.io/projected/85b718ed-49e5-419c-a635-5033955e9805-kube-api-access-v9zh9\") pod \"limitador-limitador-54d6d988d5-jnr2g\" (UID: \"85b718ed-49e5-419c-a635-5033955e9805\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"
Jul 29 14:44:22.851655 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:22.851636    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/85b718ed-49e5-419c-a635-5033955e9805-config-file\") pod \"limitador-limitador-54d6d988d5-jnr2g\" (UID: \"85b718ed-49e5-419c-a635-5033955e9805\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"
Jul 29 14:44:22.860804 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:22.860779    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9zh9\" (UniqueName: \"kubernetes.io/projected/85b718ed-49e5-419c-a635-5033955e9805-kube-api-access-v9zh9\") pod \"limitador-limitador-54d6d988d5-jnr2g\" (UID: \"85b718ed-49e5-419c-a635-5033955e9805\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"
Jul 29 14:44:22.980454 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:22.980396    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"
Jul 29 14:44:23.106624 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:23.106572    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:44:23.108668 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:44:23.108630    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85b718ed_49e5_419c_a635_5033955e9805.slice/crio-eae6664f7ad8eb6946abe4ba5e655c3abdb7f99852b36265759c0a5c53d15b67 WatchSource:0}: Error finding container eae6664f7ad8eb6946abe4ba5e655c3abdb7f99852b36265759c0a5c53d15b67: Status 404 returned error can't find the container with id eae6664f7ad8eb6946abe4ba5e655c3abdb7f99852b36265759c0a5c53d15b67
Jul 29 14:44:23.226790 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:23.226762    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-b7jzt"]
Jul 29 14:44:23.229218 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:23.229203    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-b7jzt"
Jul 29 14:44:23.231969 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:23.231920    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-6zqnh\""
Jul 29 14:44:23.238125 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:23.238101    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-b7jzt"]
Jul 29 14:44:23.254901 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:23.254880    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnrlq\" (UniqueName: \"kubernetes.io/projected/0ae0dba3-1194-4637-b829-d6f57d115595-kube-api-access-mnrlq\") pod \"authorino-75d556bd77-b7jzt\" (UID: \"0ae0dba3-1194-4637-b829-d6f57d115595\") " pod="kuadrant-system/authorino-75d556bd77-b7jzt"
Jul 29 14:44:23.355852 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:23.355818    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnrlq\" (UniqueName: \"kubernetes.io/projected/0ae0dba3-1194-4637-b829-d6f57d115595-kube-api-access-mnrlq\") pod \"authorino-75d556bd77-b7jzt\" (UID: \"0ae0dba3-1194-4637-b829-d6f57d115595\") " pod="kuadrant-system/authorino-75d556bd77-b7jzt"
Jul 29 14:44:23.364224 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:23.364201    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnrlq\" (UniqueName: \"kubernetes.io/projected/0ae0dba3-1194-4637-b829-d6f57d115595-kube-api-access-mnrlq\") pod \"authorino-75d556bd77-b7jzt\" (UID: \"0ae0dba3-1194-4637-b829-d6f57d115595\") " pod="kuadrant-system/authorino-75d556bd77-b7jzt"
Jul 29 14:44:23.465087 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:23.465056    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-jnr2g" event={"ID":"85b718ed-49e5-419c-a635-5033955e9805","Type":"ContainerStarted","Data":"eae6664f7ad8eb6946abe4ba5e655c3abdb7f99852b36265759c0a5c53d15b67"}
Jul 29 14:44:23.538880 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:23.538858    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-b7jzt"
Jul 29 14:44:23.657972 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:23.657939    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-b7jzt"]
Jul 29 14:44:23.660798 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:44:23.660769    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ae0dba3_1194_4637_b829_d6f57d115595.slice/crio-9cc29d01d81f6cb2934a6ee5395a268e58b76d7cb786c68040294b5d27fd5cbc WatchSource:0}: Error finding container 9cc29d01d81f6cb2934a6ee5395a268e58b76d7cb786c68040294b5d27fd5cbc: Status 404 returned error can't find the container with id 9cc29d01d81f6cb2934a6ee5395a268e58b76d7cb786c68040294b5d27fd5cbc
Jul 29 14:44:24.473791 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:24.473731    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-b7jzt" event={"ID":"0ae0dba3-1194-4637-b829-d6f57d115595","Type":"ContainerStarted","Data":"9cc29d01d81f6cb2934a6ee5395a268e58b76d7cb786c68040294b5d27fd5cbc"}
Jul 29 14:44:28.497394 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:28.497352    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-jnr2g" event={"ID":"85b718ed-49e5-419c-a635-5033955e9805","Type":"ContainerStarted","Data":"f37525940bc15e823a653b35fe39df8b5ba1190cf5a20fcfebe51ef97ae43f03"}
Jul 29 14:44:28.497789 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:28.497506    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"
Jul 29 14:44:28.498807 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:28.498785    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-b7jzt" event={"ID":"0ae0dba3-1194-4637-b829-d6f57d115595","Type":"ContainerStarted","Data":"e5a4b0fd98fcd0ef5da4de12ef8c3d4c05ed0ecc4e9ef27276c68acaa98ea289"}
Jul 29 14:44:28.538991 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:28.538947    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-jnr2g" podStartSLOduration=1.811513387 podStartE2EDuration="6.538933132s" totalImagesPullingTime="4.727419745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 14:44:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 14:44:28.519442395 +0000 UTC m=+540.821909001" watchObservedRunningTime="2026-07-29 14:44:28.538933132 +0000 UTC m=+540.841399738"
Jul 29 14:44:28.539135 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:28.539021    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-b7jzt" podStartSLOduration=1.36215348 podStartE2EDuration="5.539016474s" totalImagesPullingTime="4.176862994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 14:44:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 14:44:28.537660696 +0000 UTC m=+540.840127300" watchObservedRunningTime="2026-07-29 14:44:28.539016474 +0000 UTC m=+540.841483081"
Jul 29 14:44:39.503336 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:39.503306    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"
Jul 29 14:44:55.140339 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:55.140299    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-b7jzt"]
Jul 29 14:44:55.140860 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:55.140488    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-b7jzt" podUID="0ae0dba3-1194-4637-b829-d6f57d115595" containerName="authorino" containerID="cri-o://e5a4b0fd98fcd0ef5da4de12ef8c3d4c05ed0ecc4e9ef27276c68acaa98ea289" gracePeriod=30
Jul 29 14:44:55.384507 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:55.384486    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-b7jzt"
Jul 29 14:44:55.513769 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:55.513744    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mnrlq\" (UniqueName: \"kubernetes.io/projected/0ae0dba3-1194-4637-b829-d6f57d115595-kube-api-access-mnrlq\") pod \"0ae0dba3-1194-4637-b829-d6f57d115595\" (UID: \"0ae0dba3-1194-4637-b829-d6f57d115595\") "
Jul 29 14:44:55.515572 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:55.515541    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ae0dba3-1194-4637-b829-d6f57d115595-kube-api-access-mnrlq" (OuterVolumeSpecName: "kube-api-access-mnrlq") pod "0ae0dba3-1194-4637-b829-d6f57d115595" (UID: "0ae0dba3-1194-4637-b829-d6f57d115595"). InnerVolumeSpecName "kube-api-access-mnrlq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 14:44:55.614442 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:55.614419    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mnrlq\" (UniqueName: \"kubernetes.io/projected/0ae0dba3-1194-4637-b829-d6f57d115595-kube-api-access-mnrlq\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:44:55.614607 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:55.614585    2578 generic.go:356] "Generic (PLEG): container finished" podID="0ae0dba3-1194-4637-b829-d6f57d115595" containerID="e5a4b0fd98fcd0ef5da4de12ef8c3d4c05ed0ecc4e9ef27276c68acaa98ea289" exitCode=0
Jul 29 14:44:55.614657 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:55.614621    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-b7jzt"
Jul 29 14:44:55.614657 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:55.614647    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-b7jzt" event={"ID":"0ae0dba3-1194-4637-b829-d6f57d115595","Type":"ContainerDied","Data":"e5a4b0fd98fcd0ef5da4de12ef8c3d4c05ed0ecc4e9ef27276c68acaa98ea289"}
Jul 29 14:44:55.614719 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:55.614678    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-b7jzt" event={"ID":"0ae0dba3-1194-4637-b829-d6f57d115595","Type":"ContainerDied","Data":"9cc29d01d81f6cb2934a6ee5395a268e58b76d7cb786c68040294b5d27fd5cbc"}
Jul 29 14:44:55.614719 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:55.614694    2578 scope.go:117] "RemoveContainer" containerID="e5a4b0fd98fcd0ef5da4de12ef8c3d4c05ed0ecc4e9ef27276c68acaa98ea289"
Jul 29 14:44:55.623156 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:55.623137    2578 scope.go:117] "RemoveContainer" containerID="e5a4b0fd98fcd0ef5da4de12ef8c3d4c05ed0ecc4e9ef27276c68acaa98ea289"
Jul 29 14:44:55.623422 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:44:55.623397    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5a4b0fd98fcd0ef5da4de12ef8c3d4c05ed0ecc4e9ef27276c68acaa98ea289\": container with ID starting with e5a4b0fd98fcd0ef5da4de12ef8c3d4c05ed0ecc4e9ef27276c68acaa98ea289 not found: ID does not exist" containerID="e5a4b0fd98fcd0ef5da4de12ef8c3d4c05ed0ecc4e9ef27276c68acaa98ea289"
Jul 29 14:44:55.623497 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:55.623424    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5a4b0fd98fcd0ef5da4de12ef8c3d4c05ed0ecc4e9ef27276c68acaa98ea289"} err="failed to get container status \"e5a4b0fd98fcd0ef5da4de12ef8c3d4c05ed0ecc4e9ef27276c68acaa98ea289\": rpc error: code = NotFound desc = could not find container \"e5a4b0fd98fcd0ef5da4de12ef8c3d4c05ed0ecc4e9ef27276c68acaa98ea289\": container with ID starting with e5a4b0fd98fcd0ef5da4de12ef8c3d4c05ed0ecc4e9ef27276c68acaa98ea289 not found: ID does not exist"
Jul 29 14:44:55.634337 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:55.634317    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-b7jzt"]
Jul 29 14:44:55.637642 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:55.637620    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-b7jzt"]
Jul 29 14:44:56.282513 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:44:56.282465    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ae0dba3-1194-4637-b829-d6f57d115595" path="/var/lib/kubelet/pods/0ae0dba3-1194-4637-b829-d6f57d115595/volumes"
Jul 29 14:45:37.056904 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:45:37.056868    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:45:44.842479 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:45:44.842442    2578 generic.go:356] "Generic (PLEG): container finished" podID="5571b540-dc6c-40a3-936d-3bf485e23a83" containerID="0b6d55ff5a2ce0edbd6ea984af7d192fbd25cddbed0228d56a00466d12fc2c14" exitCode=0
Jul 29 14:45:44.842878 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:45:44.842488    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn" event={"ID":"5571b540-dc6c-40a3-936d-3bf485e23a83","Type":"ContainerDied","Data":"0b6d55ff5a2ce0edbd6ea984af7d192fbd25cddbed0228d56a00466d12fc2c14"}
Jul 29 14:45:44.842878 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:45:44.842859    2578 scope.go:117] "RemoveContainer" containerID="0b6d55ff5a2ce0edbd6ea984af7d192fbd25cddbed0228d56a00466d12fc2c14"
Jul 29 14:45:44.843763 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:45:44.843739    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 14:45:44.843812 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:45:44.843800    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 14:45:44.843845 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:45:44.843834    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 14:45:45.848530 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:45:45.848496    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn" event={"ID":"5571b540-dc6c-40a3-936d-3bf485e23a83","Type":"ContainerStarted","Data":"956724ec2f05e9f4ad6e1d04f9a8711128bb3dcacc85ae417c5f9e231938a5c8"}
Jul 29 14:45:46.068622 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:45:46.068588    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn"
Jul 29 14:45:46.068787 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:45:46.068766    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-g2pdn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Jul 29 14:45:46.068830 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:45:46.068811    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn" podUID="5571b540-dc6c-40a3-936d-3bf485e23a83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Jul 29 14:45:47.068544 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:45:47.068508    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-g2pdn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Jul 29 14:45:47.068917 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:45:47.068561    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn" podUID="5571b540-dc6c-40a3-936d-3bf485e23a83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Jul 29 14:45:48.068114 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:45:48.068080    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-g2pdn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Jul 29 14:45:48.068307 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:45:48.068135    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn" podUID="5571b540-dc6c-40a3-936d-3bf485e23a83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Jul 29 14:45:49.068695 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:45:49.068659    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-g2pdn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Jul 29 14:45:49.069088 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:45:49.068730    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn" podUID="5571b540-dc6c-40a3-936d-3bf485e23a83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Jul 29 14:45:50.068120 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:45:50.068081    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-g2pdn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Jul 29 14:45:50.068302 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:45:50.068141    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn" podUID="5571b540-dc6c-40a3-936d-3bf485e23a83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Jul 29 14:45:51.071997 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:45:51.071963    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn"
Jul 29 14:45:51.072481 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:45:51.072338    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn"
Jul 29 14:45:51.073008 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:45:51.072989    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g2pdn"
Jul 29 14:46:05.598421 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:46:05.598389    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:46:12.100503 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:46:12.100467    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:46:22.308420 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:46:22.308387    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:46:38.909118 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:46:38.909082    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:46:53.203836 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:46:53.203802    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:46:53.502803 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:46:53.502773    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-nswgs"]
Jul 29 14:46:53.503133 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:46:53.503121    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ae0dba3-1194-4637-b829-d6f57d115595" containerName="authorino"
Jul 29 14:46:53.503177 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:46:53.503135    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ae0dba3-1194-4637-b829-d6f57d115595" containerName="authorino"
Jul 29 14:46:53.503210 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:46:53.503203    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ae0dba3-1194-4637-b829-d6f57d115595" containerName="authorino"
Jul 29 14:46:53.506036 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:46:53.506016    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nswgs"
Jul 29 14:46:53.510177 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:46:53.510155    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6c2gw\""
Jul 29 14:46:53.510287 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:46:53.510179    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 29 14:46:53.510287 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:46:53.510180    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 29 14:46:53.510287 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:46:53.510157    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 29 14:46:53.516514 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:46:53.516488    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-nswgs"]
Jul 29 14:46:53.521359 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:46:53.521339    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6bcc2414-7465-41a5-b6ca-8d71498716dd-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nswgs\" (UID: \"6bcc2414-7465-41a5-b6ca-8d71498716dd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nswgs"
Jul 29 14:46:53.521451 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:46:53.521369    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bcc2414-7465-41a5-b6ca-8d71498716dd-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nswgs\" (UID: \"6bcc2414-7465-41a5-b6ca-8d71498716dd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nswgs"
Jul 29 14:46:53.521451 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:46:53.521396    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bcc2414-7465-41a5-b6ca-8d71498716dd-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nswgs\" (UID: \"6bcc2414-7465-41a5-b6ca-8d71498716dd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nswgs"
Jul 29 14:46:53.521451 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:46:53.521445    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6bcc2414-7465-41a5-b6ca-8d71498716dd-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nswgs\" (UID: \"6bcc2414-7465-41a5-b6ca-8d71498716dd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nswgs"
Jul 29 14:46:53.521601 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:46:53.521469    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j274x\" (UniqueName: \"kubernetes.io/projected/6bcc2414-7465-41a5-b6ca-8d71498716dd-kube-api-access-j274x\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nswgs\" (UID: \"6bcc2414-7465-41a5-b6ca-8d71498716dd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nswgs"
Jul 29 14:46:53.521601 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:46:53.521573    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6bcc2414-7465-41a5-b6ca-8d71498716dd-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nswgs\" (UID: \"6bcc2414-7465-41a5-b6ca-8d71498716dd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nswgs"
Jul 29 14:46:53.622186 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:46:53.622157    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6bcc2414-7465-41a5-b6ca-8d71498716dd-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nswgs\" (UID: \"6bcc2414-7465-41a5-b6ca-8d71498716dd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nswgs"
Jul 29 14:46:53.622346 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:46:53.622190    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j274x\" (UniqueName: \"kubernetes.io/projected/6bcc2414-7465-41a5-b6ca-8d71498716dd-kube-api-access-j274x\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nswgs\" (UID: \"6bcc2414-7465-41a5-b6ca-8d71498716dd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nswgs"
Jul 29 14:46:53.622346 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:46:53.622231    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6bcc2414-7465-41a5-b6ca-8d71498716dd-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nswgs\" (UID: \"6bcc2414-7465-41a5-b6ca-8d71498716dd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nswgs"
Jul 29 14:46:53.622346 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:46:53.622306    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6bcc2414-7465-41a5-b6ca-8d71498716dd-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nswgs\" (UID: \"6bcc2414-7465-41a5-b6ca-8d71498716dd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nswgs"
Jul 29 14:46:53.622346 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:46:53.622341    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bcc2414-7465-41a5-b6ca-8d71498716dd-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nswgs\" (UID: \"6bcc2414-7465-41a5-b6ca-8d71498716dd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nswgs"
Jul 29 14:46:53.622532 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:46:53.622387    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bcc2414-7465-41a5-b6ca-8d71498716dd-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nswgs\" (UID: \"6bcc2414-7465-41a5-b6ca-8d71498716dd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nswgs"
Jul 29 14:46:53.622692 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:46:53.622663    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6bcc2414-7465-41a5-b6ca-8d71498716dd-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nswgs\" (UID: \"6bcc2414-7465-41a5-b6ca-8d71498716dd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nswgs"
Jul 29 14:46:53.622818 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:46:53.622752    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6bcc2414-7465-41a5-b6ca-8d71498716dd-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nswgs\" (UID: \"6bcc2414-7465-41a5-b6ca-8d71498716dd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nswgs"
Jul 29 14:46:53.622818 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:46:53.622763    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bcc2414-7465-41a5-b6ca-8d71498716dd-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nswgs\" (UID: \"6bcc2414-7465-41a5-b6ca-8d71498716dd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nswgs"
Jul 29 14:46:53.624536 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:46:53.624514    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6bcc2414-7465-41a5-b6ca-8d71498716dd-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nswgs\" (UID: \"6bcc2414-7465-41a5-b6ca-8d71498716dd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nswgs"
Jul 29 14:46:53.624712 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:46:53.624698    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bcc2414-7465-41a5-b6ca-8d71498716dd-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nswgs\" (UID: \"6bcc2414-7465-41a5-b6ca-8d71498716dd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nswgs"
Jul 29 14:46:53.632068 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:46:53.632040    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j274x\" (UniqueName: \"kubernetes.io/projected/6bcc2414-7465-41a5-b6ca-8d71498716dd-kube-api-access-j274x\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nswgs\" (UID: \"6bcc2414-7465-41a5-b6ca-8d71498716dd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nswgs"
Jul 29 14:46:53.815188 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:46:53.815102    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nswgs"
Jul 29 14:46:53.944109 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:46:53.944075    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-nswgs"]
Jul 29 14:46:53.946644 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:46:53.946599    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6bcc2414_7465_41a5_b6ca_8d71498716dd.slice/crio-b584784c4ba0b8c91dc844bd151070fd61e26bd5a961c786c3fe942f7204e70f WatchSource:0}: Error finding container b584784c4ba0b8c91dc844bd151070fd61e26bd5a961c786c3fe942f7204e70f: Status 404 returned error can't find the container with id b584784c4ba0b8c91dc844bd151070fd61e26bd5a961c786c3fe942f7204e70f
Jul 29 14:46:53.947982 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:46:53.947959    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 14:46:54.147441 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:46:54.147358    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nswgs" event={"ID":"6bcc2414-7465-41a5-b6ca-8d71498716dd","Type":"ContainerStarted","Data":"b584784c4ba0b8c91dc844bd151070fd61e26bd5a961c786c3fe942f7204e70f"}
Jul 29 14:46:56.158506 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:46:56.158470    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nswgs" event={"ID":"6bcc2414-7465-41a5-b6ca-8d71498716dd","Type":"ContainerStarted","Data":"d6f977f9e25c44c282894c575a387ee3232e58a5ea7f560d0b8bf406f3ee6928"}
Jul 29 14:46:56.179153 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:46:56.179104    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nswgs" podStartSLOduration=1.9277453869999999 podStartE2EDuration="3.17909006s" totalImagesPullingTime="1.251344673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 14:46:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 14:46:56.177969023 +0000 UTC m=+688.480435633" watchObservedRunningTime="2026-07-29 14:46:56.17909006 +0000 UTC m=+688.481556666"
Jul 29 14:47:03.815692 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:47:03.815654    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nswgs"
Jul 29 14:47:03.815692 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:47:03.815698    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nswgs"
Jul 29 14:47:03.828446 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:47:03.828419    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nswgs"
Jul 29 14:47:04.200834 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:47:04.200750    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:47:04.205270 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:47:04.205228    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nswgs"
Jul 29 14:47:38.817629 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:47:38.817550    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-54795fb46c-r45s2"]
Jul 29 14:47:38.821995 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:47:38.821972    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54795fb46c-r45s2"
Jul 29 14:47:38.824762 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:47:38.824742    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-6zqnh\""
Jul 29 14:47:38.825815 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:47:38.825796    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 29 14:47:38.829191 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:47:38.829170    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54795fb46c-r45s2"]
Jul 29 14:47:38.935703 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:47:38.935665    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/485ee488-44de-43ec-a35d-f84bde2dd733-tls-cert\") pod \"authorino-54795fb46c-r45s2\" (UID: \"485ee488-44de-43ec-a35d-f84bde2dd733\") " pod="kuadrant-system/authorino-54795fb46c-r45s2"
Jul 29 14:47:38.935703 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:47:38.935710    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97qgp\" (UniqueName: \"kubernetes.io/projected/485ee488-44de-43ec-a35d-f84bde2dd733-kube-api-access-97qgp\") pod \"authorino-54795fb46c-r45s2\" (UID: \"485ee488-44de-43ec-a35d-f84bde2dd733\") " pod="kuadrant-system/authorino-54795fb46c-r45s2"
Jul 29 14:47:39.037062 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:47:39.037026    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/485ee488-44de-43ec-a35d-f84bde2dd733-tls-cert\") pod \"authorino-54795fb46c-r45s2\" (UID: \"485ee488-44de-43ec-a35d-f84bde2dd733\") " pod="kuadrant-system/authorino-54795fb46c-r45s2"
Jul 29 14:47:39.037062 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:47:39.037066    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97qgp\" (UniqueName: \"kubernetes.io/projected/485ee488-44de-43ec-a35d-f84bde2dd733-kube-api-access-97qgp\") pod \"authorino-54795fb46c-r45s2\" (UID: \"485ee488-44de-43ec-a35d-f84bde2dd733\") " pod="kuadrant-system/authorino-54795fb46c-r45s2"
Jul 29 14:47:39.039543 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:47:39.039520    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/485ee488-44de-43ec-a35d-f84bde2dd733-tls-cert\") pod \"authorino-54795fb46c-r45s2\" (UID: \"485ee488-44de-43ec-a35d-f84bde2dd733\") " pod="kuadrant-system/authorino-54795fb46c-r45s2"
Jul 29 14:47:39.046160 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:47:39.046137    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97qgp\" (UniqueName: \"kubernetes.io/projected/485ee488-44de-43ec-a35d-f84bde2dd733-kube-api-access-97qgp\") pod \"authorino-54795fb46c-r45s2\" (UID: \"485ee488-44de-43ec-a35d-f84bde2dd733\") " pod="kuadrant-system/authorino-54795fb46c-r45s2"
Jul 29 14:47:39.131999 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:47:39.131921    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54795fb46c-r45s2"
Jul 29 14:47:39.269056 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:47:39.269018    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54795fb46c-r45s2"]
Jul 29 14:47:39.272950 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:47:39.272921    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod485ee488_44de_43ec_a35d_f84bde2dd733.slice/crio-5f3e3d8691646dbe38b7c63805ceefa513cfe8fe4f1f53c4a5ddbd4eb249775e WatchSource:0}: Error finding container 5f3e3d8691646dbe38b7c63805ceefa513cfe8fe4f1f53c4a5ddbd4eb249775e: Status 404 returned error can't find the container with id 5f3e3d8691646dbe38b7c63805ceefa513cfe8fe4f1f53c4a5ddbd4eb249775e
Jul 29 14:47:39.341629 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:47:39.341597    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54795fb46c-r45s2" event={"ID":"485ee488-44de-43ec-a35d-f84bde2dd733","Type":"ContainerStarted","Data":"5f3e3d8691646dbe38b7c63805ceefa513cfe8fe4f1f53c4a5ddbd4eb249775e"}
Jul 29 14:47:40.347770 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:47:40.347729    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54795fb46c-r45s2" event={"ID":"485ee488-44de-43ec-a35d-f84bde2dd733","Type":"ContainerStarted","Data":"b54c56918e33225781ad8455caa5bbeb64af74c1b115ea2acb7498d655daff41"}
Jul 29 14:47:40.370634 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:47:40.370575    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-54795fb46c-r45s2" podStartSLOduration=1.888600509 podStartE2EDuration="2.370557167s" totalImagesPullingTime="481.956658ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 14:47:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 14:47:40.369021982 +0000 UTC m=+732.671488590" watchObservedRunningTime="2026-07-29 14:47:40.370557167 +0000 UTC m=+732.673023776"
Jul 29 14:48:09.117795 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:48:09.117746    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:48:18.505753 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:48:18.505718    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:48:28.211304 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:48:28.211268    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:50:12.308766 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:50:12.308734    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:50:20.808539 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:50:20.808462    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:50:56.396722 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:50:56.396690    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:51:04.803900 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:51:04.803862    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:51:14.201506 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:51:14.201468    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:51:19.399893 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:51:19.399857    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:51:30.316907 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:51:30.316870    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:51:39.113273 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:51:39.113219    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:51:51.401153 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:51:51.401062    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:52:00.509712 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:52:00.509675    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:52:23.503229 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:52:23.503192    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:52:33.112611 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:52:33.112577    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:52:56.714562 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:52:56.714525    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:53:06.312498 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:53:06.312462    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:53:15.505519 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:53:15.505484    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:53:29.802672 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:53:29.802590    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:53:40.719273 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:53:40.719217    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:53:49.811350 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:53:49.811312    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:53:58.401569 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:53:58.401537    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:54:08.312909 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:54:08.312874    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:54:19.899879 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:54:19.899830    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:54:28.816473 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:54:28.816434    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:56:07.910544 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:56:07.910497    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:56:18.515869 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:56:18.515835    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:56:31.714349 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:56:31.714259    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:56:41.236322 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:56:41.236286    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:56:52.012012 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:56:52.011981    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:57:03.516402 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:57:03.516356    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:57:10.714145 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:57:10.714110    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:57:19.007916 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:57:19.007881    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:57:27.215482 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:57:27.215446    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:57:37.210000 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:57:37.209963    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:57:49.500117 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:57:49.500075    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:57:56.704391 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:57:56.704298    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:58:15.417526 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:15.417491    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:58:25.320219 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:25.320174    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:58:29.213110 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:29.213050    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb"]
Jul 29 14:58:29.216414 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:29.216396    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb"
Jul 29 14:58:29.219103 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:29.219085    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-c96fe785-kserve-self-signed-certs\""
Jul 29 14:58:29.235663 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:29.235639    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb"]
Jul 29 14:58:29.346125 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:29.346094    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/05a564fd-6b16-47bc-ac5a-cdb7f6b28e90-dshm\") pod \"e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb\" (UID: \"05a564fd-6b16-47bc-ac5a-cdb7f6b28e90\") " pod="llm/e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb"
Jul 29 14:58:29.346307 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:29.346131    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05a564fd-6b16-47bc-ac5a-cdb7f6b28e90-tmp-dir\") pod \"e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb\" (UID: \"05a564fd-6b16-47bc-ac5a-cdb7f6b28e90\") " pod="llm/e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb"
Jul 29 14:58:29.346307 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:29.346216    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/05a564fd-6b16-47bc-ac5a-cdb7f6b28e90-model-cache\") pod \"e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb\" (UID: \"05a564fd-6b16-47bc-ac5a-cdb7f6b28e90\") " pod="llm/e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb"
Jul 29 14:58:29.346307 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:29.346282    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/05a564fd-6b16-47bc-ac5a-cdb7f6b28e90-home\") pod \"e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb\" (UID: \"05a564fd-6b16-47bc-ac5a-cdb7f6b28e90\") " pod="llm/e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb"
Jul 29 14:58:29.346421 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:29.346352    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-splhk\" (UniqueName: \"kubernetes.io/projected/05a564fd-6b16-47bc-ac5a-cdb7f6b28e90-kube-api-access-splhk\") pod \"e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb\" (UID: \"05a564fd-6b16-47bc-ac5a-cdb7f6b28e90\") " pod="llm/e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb"
Jul 29 14:58:29.346421 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:29.346372    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05a564fd-6b16-47bc-ac5a-cdb7f6b28e90-tls-certs\") pod \"e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb\" (UID: \"05a564fd-6b16-47bc-ac5a-cdb7f6b28e90\") " pod="llm/e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb"
Jul 29 14:58:29.447475 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:29.447438    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/05a564fd-6b16-47bc-ac5a-cdb7f6b28e90-model-cache\") pod \"e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb\" (UID: \"05a564fd-6b16-47bc-ac5a-cdb7f6b28e90\") " pod="llm/e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb"
Jul 29 14:58:29.447475 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:29.447480    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/05a564fd-6b16-47bc-ac5a-cdb7f6b28e90-home\") pod \"e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb\" (UID: \"05a564fd-6b16-47bc-ac5a-cdb7f6b28e90\") " pod="llm/e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb"
Jul 29 14:58:29.447672 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:29.447521    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-splhk\" (UniqueName: \"kubernetes.io/projected/05a564fd-6b16-47bc-ac5a-cdb7f6b28e90-kube-api-access-splhk\") pod \"e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb\" (UID: \"05a564fd-6b16-47bc-ac5a-cdb7f6b28e90\") " pod="llm/e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb"
Jul 29 14:58:29.447672 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:29.447540    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05a564fd-6b16-47bc-ac5a-cdb7f6b28e90-tls-certs\") pod \"e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb\" (UID: \"05a564fd-6b16-47bc-ac5a-cdb7f6b28e90\") " pod="llm/e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb"
Jul 29 14:58:29.447672 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:29.447558    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/05a564fd-6b16-47bc-ac5a-cdb7f6b28e90-dshm\") pod \"e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb\" (UID: \"05a564fd-6b16-47bc-ac5a-cdb7f6b28e90\") " pod="llm/e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb"
Jul 29 14:58:29.447672 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:29.447578    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05a564fd-6b16-47bc-ac5a-cdb7f6b28e90-tmp-dir\") pod \"e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb\" (UID: \"05a564fd-6b16-47bc-ac5a-cdb7f6b28e90\") " pod="llm/e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb"
Jul 29 14:58:29.447921 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:29.447900    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/05a564fd-6b16-47bc-ac5a-cdb7f6b28e90-model-cache\") pod \"e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb\" (UID: \"05a564fd-6b16-47bc-ac5a-cdb7f6b28e90\") " pod="llm/e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb"
Jul 29 14:58:29.447957 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:29.447944    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05a564fd-6b16-47bc-ac5a-cdb7f6b28e90-tmp-dir\") pod \"e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb\" (UID: \"05a564fd-6b16-47bc-ac5a-cdb7f6b28e90\") " pod="llm/e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb"
Jul 29 14:58:29.448018 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:29.447997    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/05a564fd-6b16-47bc-ac5a-cdb7f6b28e90-home\") pod \"e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb\" (UID: \"05a564fd-6b16-47bc-ac5a-cdb7f6b28e90\") " pod="llm/e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb"
Jul 29 14:58:29.449863 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:29.449840    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/05a564fd-6b16-47bc-ac5a-cdb7f6b28e90-dshm\") pod \"e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb\" (UID: \"05a564fd-6b16-47bc-ac5a-cdb7f6b28e90\") " pod="llm/e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb"
Jul 29 14:58:29.450143 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:29.450124    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05a564fd-6b16-47bc-ac5a-cdb7f6b28e90-tls-certs\") pod \"e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb\" (UID: \"05a564fd-6b16-47bc-ac5a-cdb7f6b28e90\") " pod="llm/e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb"
Jul 29 14:58:29.455454 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:29.455432    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-splhk\" (UniqueName: \"kubernetes.io/projected/05a564fd-6b16-47bc-ac5a-cdb7f6b28e90-kube-api-access-splhk\") pod \"e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb\" (UID: \"05a564fd-6b16-47bc-ac5a-cdb7f6b28e90\") " pod="llm/e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb"
Jul 29 14:58:29.525448 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:29.525425    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb"
Jul 29 14:58:29.653594 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:29.653500    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb"]
Jul 29 14:58:29.655759 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:58:29.655734    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod05a564fd_6b16_47bc_ac5a_cdb7f6b28e90.slice/crio-c6de3569473116362bb8a677775898f216f8f24eacfb6504e2f81a18a9f45b6d WatchSource:0}: Error finding container c6de3569473116362bb8a677775898f216f8f24eacfb6504e2f81a18a9f45b6d: Status 404 returned error can't find the container with id c6de3569473116362bb8a677775898f216f8f24eacfb6504e2f81a18a9f45b6d
Jul 29 14:58:30.277207 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:30.277173    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb" event={"ID":"05a564fd-6b16-47bc-ac5a-cdb7f6b28e90","Type":"ContainerStarted","Data":"ba329e9c7c3b842e0415a068b363c114ced8c5521d15839ede421a5409cfcb60"}
Jul 29 14:58:30.277207 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:30.277211    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb" event={"ID":"05a564fd-6b16-47bc-ac5a-cdb7f6b28e90","Type":"ContainerStarted","Data":"c6de3569473116362bb8a677775898f216f8f24eacfb6504e2f81a18a9f45b6d"}
Jul 29 14:58:30.294350 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:30.294305    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb" podStartSLOduration=1.2942886470000001 podStartE2EDuration="1.294288647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 14:58:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 14:58:30.292451867 +0000 UTC m=+1382.594918476" watchObservedRunningTime="2026-07-29 14:58:30.294288647 +0000 UTC m=+1382.596755255"
Jul 29 14:58:39.526299 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:39.526259    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb"
Jul 29 14:58:39.526762 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:39.526320    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb"
Jul 29 14:58:39.539035 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:39.539002    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb"
Jul 29 14:58:40.331027 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:40.330991    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb"
Jul 29 14:58:41.801464 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:41.801430    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:58:45.309024 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:45.308990    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b"]
Jul 29 14:58:45.313304 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:45.313284    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b"
Jul 29 14:58:45.316010 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:45.315986    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-c96fe785-kserve-self-signed-certs\""
Jul 29 14:58:45.321993 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:45.321970    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b"]
Jul 29 14:58:45.378628 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:45.378596    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d996c357-bc21-4b93-8a6f-abe371c6dbeb-tls-certs\") pod \"e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b\" (UID: \"d996c357-bc21-4b93-8a6f-abe371c6dbeb\") " pod="llm/e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b"
Jul 29 14:58:45.378888 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:45.378850    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnwpn\" (UniqueName: \"kubernetes.io/projected/d996c357-bc21-4b93-8a6f-abe371c6dbeb-kube-api-access-mnwpn\") pod \"e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b\" (UID: \"d996c357-bc21-4b93-8a6f-abe371c6dbeb\") " pod="llm/e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b"
Jul 29 14:58:45.379009 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:45.378928    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d996c357-bc21-4b93-8a6f-abe371c6dbeb-dshm\") pod \"e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b\" (UID: \"d996c357-bc21-4b93-8a6f-abe371c6dbeb\") " pod="llm/e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b"
Jul 29 14:58:45.379009 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:45.378958    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d996c357-bc21-4b93-8a6f-abe371c6dbeb-model-cache\") pod \"e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b\" (UID: \"d996c357-bc21-4b93-8a6f-abe371c6dbeb\") " pod="llm/e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b"
Jul 29 14:58:45.379009 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:45.378981    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d996c357-bc21-4b93-8a6f-abe371c6dbeb-tmp-dir\") pod \"e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b\" (UID: \"d996c357-bc21-4b93-8a6f-abe371c6dbeb\") " pod="llm/e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b"
Jul 29 14:58:45.379175 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:45.379009    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d996c357-bc21-4b93-8a6f-abe371c6dbeb-home\") pod \"e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b\" (UID: \"d996c357-bc21-4b93-8a6f-abe371c6dbeb\") " pod="llm/e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b"
Jul 29 14:58:45.479621 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:45.479579    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnwpn\" (UniqueName: \"kubernetes.io/projected/d996c357-bc21-4b93-8a6f-abe371c6dbeb-kube-api-access-mnwpn\") pod \"e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b\" (UID: \"d996c357-bc21-4b93-8a6f-abe371c6dbeb\") " pod="llm/e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b"
Jul 29 14:58:45.479825 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:45.479659    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d996c357-bc21-4b93-8a6f-abe371c6dbeb-dshm\") pod \"e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b\" (UID: \"d996c357-bc21-4b93-8a6f-abe371c6dbeb\") " pod="llm/e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b"
Jul 29 14:58:45.479825 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:45.479690    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d996c357-bc21-4b93-8a6f-abe371c6dbeb-model-cache\") pod \"e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b\" (UID: \"d996c357-bc21-4b93-8a6f-abe371c6dbeb\") " pod="llm/e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b"
Jul 29 14:58:45.479825 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:45.479715    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d996c357-bc21-4b93-8a6f-abe371c6dbeb-tmp-dir\") pod \"e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b\" (UID: \"d996c357-bc21-4b93-8a6f-abe371c6dbeb\") " pod="llm/e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b"
Jul 29 14:58:45.479825 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:45.479744    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d996c357-bc21-4b93-8a6f-abe371c6dbeb-home\") pod \"e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b\" (UID: \"d996c357-bc21-4b93-8a6f-abe371c6dbeb\") " pod="llm/e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b"
Jul 29 14:58:45.480044 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:45.479866    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d996c357-bc21-4b93-8a6f-abe371c6dbeb-tls-certs\") pod \"e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b\" (UID: \"d996c357-bc21-4b93-8a6f-abe371c6dbeb\") " pod="llm/e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b"
Jul 29 14:58:45.480159 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:45.480131    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d996c357-bc21-4b93-8a6f-abe371c6dbeb-tmp-dir\") pod \"e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b\" (UID: \"d996c357-bc21-4b93-8a6f-abe371c6dbeb\") " pod="llm/e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b"
Jul 29 14:58:45.480483 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:45.480458    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d996c357-bc21-4b93-8a6f-abe371c6dbeb-home\") pod \"e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b\" (UID: \"d996c357-bc21-4b93-8a6f-abe371c6dbeb\") " pod="llm/e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b"
Jul 29 14:58:45.480896 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:45.480874    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d996c357-bc21-4b93-8a6f-abe371c6dbeb-model-cache\") pod \"e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b\" (UID: \"d996c357-bc21-4b93-8a6f-abe371c6dbeb\") " pod="llm/e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b"
Jul 29 14:58:45.482828 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:45.482801    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d996c357-bc21-4b93-8a6f-abe371c6dbeb-dshm\") pod \"e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b\" (UID: \"d996c357-bc21-4b93-8a6f-abe371c6dbeb\") " pod="llm/e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b"
Jul 29 14:58:45.482954 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:45.482936    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d996c357-bc21-4b93-8a6f-abe371c6dbeb-tls-certs\") pod \"e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b\" (UID: \"d996c357-bc21-4b93-8a6f-abe371c6dbeb\") " pod="llm/e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b"
Jul 29 14:58:45.488033 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:45.488007    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnwpn\" (UniqueName: \"kubernetes.io/projected/d996c357-bc21-4b93-8a6f-abe371c6dbeb-kube-api-access-mnwpn\") pod \"e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b\" (UID: \"d996c357-bc21-4b93-8a6f-abe371c6dbeb\") " pod="llm/e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b"
Jul 29 14:58:45.623007 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:45.622929    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b"
Jul 29 14:58:45.751032 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:45.751008    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b"]
Jul 29 14:58:45.753276 ip-10-0-142-130 kubenswrapper[2578]: W0729 14:58:45.753222    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd996c357_bc21_4b93_8a6f_abe371c6dbeb.slice/crio-351452130ae4d96443bb4972fd5511223298f2f9e4aaf816bbf14076dcf86dc3 WatchSource:0}: Error finding container 351452130ae4d96443bb4972fd5511223298f2f9e4aaf816bbf14076dcf86dc3: Status 404 returned error can't find the container with id 351452130ae4d96443bb4972fd5511223298f2f9e4aaf816bbf14076dcf86dc3
Jul 29 14:58:46.346780 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:46.346742    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b" event={"ID":"d996c357-bc21-4b93-8a6f-abe371c6dbeb","Type":"ContainerStarted","Data":"8fc5da2b3ee14168817ed4521d8af4174326a509156ed9d8bc6928ae577f2c07"}
Jul 29 14:58:46.347174 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:46.346793    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b" event={"ID":"d996c357-bc21-4b93-8a6f-abe371c6dbeb","Type":"ContainerStarted","Data":"351452130ae4d96443bb4972fd5511223298f2f9e4aaf816bbf14076dcf86dc3"}
Jul 29 14:58:46.365124 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:46.365073    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b" podStartSLOduration=1.365057945 podStartE2EDuration="1.365057945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 14:58:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 14:58:46.363218381 +0000 UTC m=+1398.665684989" watchObservedRunningTime="2026-07-29 14:58:46.365057945 +0000 UTC m=+1398.667524553"
Jul 29 14:58:51.509389 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:51.509349    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:58:55.624071 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:55.624029    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b"
Jul 29 14:58:55.624071 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:55.624084    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b"
Jul 29 14:58:55.636429 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:55.636406    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b"
Jul 29 14:58:56.402194 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:58:56.402165    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b"
Jul 29 14:59:27.773744 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:27.773665    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb"]
Jul 29 14:59:28.572563 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:28.572529    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b"]
Jul 29 14:59:31.912893 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:31.912856    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:59:42.792571 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:42.792507    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb" podUID="05a564fd-6b16-47bc-ac5a-cdb7f6b28e90" containerName="main" containerID="cri-o://ba329e9c7c3b842e0415a068b363c114ced8c5521d15839ede421a5409cfcb60" gracePeriod=45
Jul 29 14:59:43.031136 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.031112    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb"
Jul 29 14:59:43.088689 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.088615    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05a564fd-6b16-47bc-ac5a-cdb7f6b28e90-tmp-dir\") pod \"05a564fd-6b16-47bc-ac5a-cdb7f6b28e90\" (UID: \"05a564fd-6b16-47bc-ac5a-cdb7f6b28e90\") "
Jul 29 14:59:43.088689 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.088656    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05a564fd-6b16-47bc-ac5a-cdb7f6b28e90-tls-certs\") pod \"05a564fd-6b16-47bc-ac5a-cdb7f6b28e90\" (UID: \"05a564fd-6b16-47bc-ac5a-cdb7f6b28e90\") "
Jul 29 14:59:43.088886 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.088752    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/05a564fd-6b16-47bc-ac5a-cdb7f6b28e90-home\") pod \"05a564fd-6b16-47bc-ac5a-cdb7f6b28e90\" (UID: \"05a564fd-6b16-47bc-ac5a-cdb7f6b28e90\") "
Jul 29 14:59:43.088886 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.088779    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-splhk\" (UniqueName: \"kubernetes.io/projected/05a564fd-6b16-47bc-ac5a-cdb7f6b28e90-kube-api-access-splhk\") pod \"05a564fd-6b16-47bc-ac5a-cdb7f6b28e90\" (UID: \"05a564fd-6b16-47bc-ac5a-cdb7f6b28e90\") "
Jul 29 14:59:43.088886 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.088866    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/05a564fd-6b16-47bc-ac5a-cdb7f6b28e90-dshm\") pod \"05a564fd-6b16-47bc-ac5a-cdb7f6b28e90\" (UID: \"05a564fd-6b16-47bc-ac5a-cdb7f6b28e90\") "
Jul 29 14:59:43.089060 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.088907    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/05a564fd-6b16-47bc-ac5a-cdb7f6b28e90-model-cache\") pod \"05a564fd-6b16-47bc-ac5a-cdb7f6b28e90\" (UID: \"05a564fd-6b16-47bc-ac5a-cdb7f6b28e90\") "
Jul 29 14:59:43.089060 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.088860    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05a564fd-6b16-47bc-ac5a-cdb7f6b28e90-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "05a564fd-6b16-47bc-ac5a-cdb7f6b28e90" (UID: "05a564fd-6b16-47bc-ac5a-cdb7f6b28e90"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 14:59:43.089060 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.088987    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05a564fd-6b16-47bc-ac5a-cdb7f6b28e90-home" (OuterVolumeSpecName: "home") pod "05a564fd-6b16-47bc-ac5a-cdb7f6b28e90" (UID: "05a564fd-6b16-47bc-ac5a-cdb7f6b28e90"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 14:59:43.089218 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.089201    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/05a564fd-6b16-47bc-ac5a-cdb7f6b28e90-home\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:59:43.089290 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.089202    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05a564fd-6b16-47bc-ac5a-cdb7f6b28e90-model-cache" (OuterVolumeSpecName: "model-cache") pod "05a564fd-6b16-47bc-ac5a-cdb7f6b28e90" (UID: "05a564fd-6b16-47bc-ac5a-cdb7f6b28e90"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 14:59:43.089290 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.089273    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05a564fd-6b16-47bc-ac5a-cdb7f6b28e90-tmp-dir\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:59:43.090981 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.090958    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05a564fd-6b16-47bc-ac5a-cdb7f6b28e90-kube-api-access-splhk" (OuterVolumeSpecName: "kube-api-access-splhk") pod "05a564fd-6b16-47bc-ac5a-cdb7f6b28e90" (UID: "05a564fd-6b16-47bc-ac5a-cdb7f6b28e90"). InnerVolumeSpecName "kube-api-access-splhk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 14:59:43.091141 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.091128    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05a564fd-6b16-47bc-ac5a-cdb7f6b28e90-dshm" (OuterVolumeSpecName: "dshm") pod "05a564fd-6b16-47bc-ac5a-cdb7f6b28e90" (UID: "05a564fd-6b16-47bc-ac5a-cdb7f6b28e90"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 14:59:43.091203 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.091183    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05a564fd-6b16-47bc-ac5a-cdb7f6b28e90-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "05a564fd-6b16-47bc-ac5a-cdb7f6b28e90" (UID: "05a564fd-6b16-47bc-ac5a-cdb7f6b28e90"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 14:59:43.190405 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.190377    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-splhk\" (UniqueName: \"kubernetes.io/projected/05a564fd-6b16-47bc-ac5a-cdb7f6b28e90-kube-api-access-splhk\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:59:43.190405 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.190401    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/05a564fd-6b16-47bc-ac5a-cdb7f6b28e90-dshm\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:59:43.190540 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.190416    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/05a564fd-6b16-47bc-ac5a-cdb7f6b28e90-model-cache\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:59:43.190540 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.190428    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05a564fd-6b16-47bc-ac5a-cdb7f6b28e90-tls-certs\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:59:43.591487 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.591447    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b" podUID="d996c357-bc21-4b93-8a6f-abe371c6dbeb" containerName="main" containerID="cri-o://8fc5da2b3ee14168817ed4521d8af4174326a509156ed9d8bc6928ae577f2c07" gracePeriod=45
Jul 29 14:59:43.603926 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.603900    2578 generic.go:356] "Generic (PLEG): container finished" podID="05a564fd-6b16-47bc-ac5a-cdb7f6b28e90" containerID="ba329e9c7c3b842e0415a068b363c114ced8c5521d15839ede421a5409cfcb60" exitCode=0
Jul 29 14:59:43.604051 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.603945    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb"
Jul 29 14:59:43.604051 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.603952    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb" event={"ID":"05a564fd-6b16-47bc-ac5a-cdb7f6b28e90","Type":"ContainerDied","Data":"ba329e9c7c3b842e0415a068b363c114ced8c5521d15839ede421a5409cfcb60"}
Jul 29 14:59:43.604051 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.603983    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb" event={"ID":"05a564fd-6b16-47bc-ac5a-cdb7f6b28e90","Type":"ContainerDied","Data":"c6de3569473116362bb8a677775898f216f8f24eacfb6504e2f81a18a9f45b6d"}
Jul 29 14:59:43.604051 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.604002    2578 scope.go:117] "RemoveContainer" containerID="ba329e9c7c3b842e0415a068b363c114ced8c5521d15839ede421a5409cfcb60"
Jul 29 14:59:43.651435 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.651411    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb"]
Jul 29 14:59:43.655111 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.655087    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-c96fe785-kserve-7ddd66b76c-2vhjb"]
Jul 29 14:59:43.701761 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.701731    2578 scope.go:117] "RemoveContainer" containerID="ba329e9c7c3b842e0415a068b363c114ced8c5521d15839ede421a5409cfcb60"
Jul 29 14:59:43.702088 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:59:43.702068    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba329e9c7c3b842e0415a068b363c114ced8c5521d15839ede421a5409cfcb60\": container with ID starting with ba329e9c7c3b842e0415a068b363c114ced8c5521d15839ede421a5409cfcb60 not found: ID does not exist" containerID="ba329e9c7c3b842e0415a068b363c114ced8c5521d15839ede421a5409cfcb60"
Jul 29 14:59:43.702137 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.702099    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba329e9c7c3b842e0415a068b363c114ced8c5521d15839ede421a5409cfcb60"} err="failed to get container status \"ba329e9c7c3b842e0415a068b363c114ced8c5521d15839ede421a5409cfcb60\": rpc error: code = NotFound desc = could not find container \"ba329e9c7c3b842e0415a068b363c114ced8c5521d15839ede421a5409cfcb60\": container with ID starting with ba329e9c7c3b842e0415a068b363c114ced8c5521d15839ede421a5409cfcb60 not found: ID does not exist"
Jul 29 14:59:43.846955 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.846904    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b"
Jul 29 14:59:43.896120 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.896098    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mnwpn\" (UniqueName: \"kubernetes.io/projected/d996c357-bc21-4b93-8a6f-abe371c6dbeb-kube-api-access-mnwpn\") pod \"d996c357-bc21-4b93-8a6f-abe371c6dbeb\" (UID: \"d996c357-bc21-4b93-8a6f-abe371c6dbeb\") "
Jul 29 14:59:43.896268 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.896138    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d996c357-bc21-4b93-8a6f-abe371c6dbeb-model-cache\") pod \"d996c357-bc21-4b93-8a6f-abe371c6dbeb\" (UID: \"d996c357-bc21-4b93-8a6f-abe371c6dbeb\") "
Jul 29 14:59:43.896268 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.896157    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d996c357-bc21-4b93-8a6f-abe371c6dbeb-tmp-dir\") pod \"d996c357-bc21-4b93-8a6f-abe371c6dbeb\" (UID: \"d996c357-bc21-4b93-8a6f-abe371c6dbeb\") "
Jul 29 14:59:43.896268 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.896176    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d996c357-bc21-4b93-8a6f-abe371c6dbeb-dshm\") pod \"d996c357-bc21-4b93-8a6f-abe371c6dbeb\" (UID: \"d996c357-bc21-4b93-8a6f-abe371c6dbeb\") "
Jul 29 14:59:43.896444 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.896296    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d996c357-bc21-4b93-8a6f-abe371c6dbeb-tls-certs\") pod \"d996c357-bc21-4b93-8a6f-abe371c6dbeb\" (UID: \"d996c357-bc21-4b93-8a6f-abe371c6dbeb\") "
Jul 29 14:59:43.896444 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.896334    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d996c357-bc21-4b93-8a6f-abe371c6dbeb-home\") pod \"d996c357-bc21-4b93-8a6f-abe371c6dbeb\" (UID: \"d996c357-bc21-4b93-8a6f-abe371c6dbeb\") "
Jul 29 14:59:43.896541 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.896427    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d996c357-bc21-4b93-8a6f-abe371c6dbeb-model-cache" (OuterVolumeSpecName: "model-cache") pod "d996c357-bc21-4b93-8a6f-abe371c6dbeb" (UID: "d996c357-bc21-4b93-8a6f-abe371c6dbeb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 14:59:43.896541 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.896471    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d996c357-bc21-4b93-8a6f-abe371c6dbeb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d996c357-bc21-4b93-8a6f-abe371c6dbeb" (UID: "d996c357-bc21-4b93-8a6f-abe371c6dbeb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 14:59:43.896641 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.896596    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d996c357-bc21-4b93-8a6f-abe371c6dbeb-home" (OuterVolumeSpecName: "home") pod "d996c357-bc21-4b93-8a6f-abe371c6dbeb" (UID: "d996c357-bc21-4b93-8a6f-abe371c6dbeb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 14:59:43.896686 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.896655    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d996c357-bc21-4b93-8a6f-abe371c6dbeb-home\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:59:43.896686 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.896673    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d996c357-bc21-4b93-8a6f-abe371c6dbeb-model-cache\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:59:43.896793 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.896687    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d996c357-bc21-4b93-8a6f-abe371c6dbeb-tmp-dir\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:59:43.898340 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.898314    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d996c357-bc21-4b93-8a6f-abe371c6dbeb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d996c357-bc21-4b93-8a6f-abe371c6dbeb" (UID: "d996c357-bc21-4b93-8a6f-abe371c6dbeb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 14:59:43.898432 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.898363    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d996c357-bc21-4b93-8a6f-abe371c6dbeb-dshm" (OuterVolumeSpecName: "dshm") pod "d996c357-bc21-4b93-8a6f-abe371c6dbeb" (UID: "d996c357-bc21-4b93-8a6f-abe371c6dbeb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 14:59:43.898432 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.898378    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d996c357-bc21-4b93-8a6f-abe371c6dbeb-kube-api-access-mnwpn" (OuterVolumeSpecName: "kube-api-access-mnwpn") pod "d996c357-bc21-4b93-8a6f-abe371c6dbeb" (UID: "d996c357-bc21-4b93-8a6f-abe371c6dbeb"). InnerVolumeSpecName "kube-api-access-mnwpn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 14:59:43.997271 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.997223    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d996c357-bc21-4b93-8a6f-abe371c6dbeb-tls-certs\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:59:43.997271 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.997267    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mnwpn\" (UniqueName: \"kubernetes.io/projected/d996c357-bc21-4b93-8a6f-abe371c6dbeb-kube-api-access-mnwpn\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:59:43.997465 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:43.997281    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d996c357-bc21-4b93-8a6f-abe371c6dbeb-dshm\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 14:59:44.278220 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:44.278186    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05a564fd-6b16-47bc-ac5a-cdb7f6b28e90" path="/var/lib/kubelet/pods/05a564fd-6b16-47bc-ac5a-cdb7f6b28e90/volumes"
Jul 29 14:59:44.610156 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:44.610065    2578 generic.go:356] "Generic (PLEG): container finished" podID="d996c357-bc21-4b93-8a6f-abe371c6dbeb" containerID="8fc5da2b3ee14168817ed4521d8af4174326a509156ed9d8bc6928ae577f2c07" exitCode=0
Jul 29 14:59:44.610156 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:44.610122    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b" event={"ID":"d996c357-bc21-4b93-8a6f-abe371c6dbeb","Type":"ContainerDied","Data":"8fc5da2b3ee14168817ed4521d8af4174326a509156ed9d8bc6928ae577f2c07"}
Jul 29 14:59:44.610156 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:44.610151    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b" event={"ID":"d996c357-bc21-4b93-8a6f-abe371c6dbeb","Type":"ContainerDied","Data":"351452130ae4d96443bb4972fd5511223298f2f9e4aaf816bbf14076dcf86dc3"}
Jul 29 14:59:44.610441 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:44.610167    2578 scope.go:117] "RemoveContainer" containerID="8fc5da2b3ee14168817ed4521d8af4174326a509156ed9d8bc6928ae577f2c07"
Jul 29 14:59:44.610441 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:44.610124    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b"
Jul 29 14:59:44.618309 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:44.618295    2578 scope.go:117] "RemoveContainer" containerID="8fc5da2b3ee14168817ed4521d8af4174326a509156ed9d8bc6928ae577f2c07"
Jul 29 14:59:44.618574 ip-10-0-142-130 kubenswrapper[2578]: E0729 14:59:44.618552    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fc5da2b3ee14168817ed4521d8af4174326a509156ed9d8bc6928ae577f2c07\": container with ID starting with 8fc5da2b3ee14168817ed4521d8af4174326a509156ed9d8bc6928ae577f2c07 not found: ID does not exist" containerID="8fc5da2b3ee14168817ed4521d8af4174326a509156ed9d8bc6928ae577f2c07"
Jul 29 14:59:44.618648 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:44.618584    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fc5da2b3ee14168817ed4521d8af4174326a509156ed9d8bc6928ae577f2c07"} err="failed to get container status \"8fc5da2b3ee14168817ed4521d8af4174326a509156ed9d8bc6928ae577f2c07\": rpc error: code = NotFound desc = could not find container \"8fc5da2b3ee14168817ed4521d8af4174326a509156ed9d8bc6928ae577f2c07\": container with ID starting with 8fc5da2b3ee14168817ed4521d8af4174326a509156ed9d8bc6928ae577f2c07 not found: ID does not exist"
Jul 29 14:59:44.627440 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:44.627418    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b"]
Jul 29 14:59:44.631471 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:44.631452    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-c96fe785-kserve-6b55bdfdc5-2229b"]
Jul 29 14:59:44.811776 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:44.811743    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 14:59:46.278673 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:46.278640    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d996c357-bc21-4b93-8a6f-abe371c6dbeb" path="/var/lib/kubelet/pods/d996c357-bc21-4b93-8a6f-abe371c6dbeb/volumes"
Jul 29 14:59:53.904773 ip-10-0-142-130 kubenswrapper[2578]: I0729 14:59:53.904739    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:00:05.713392 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:00:05.713353    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:00:14.633286 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:00:14.633251    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:00:23.807600 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:00:23.807565    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:00:34.024626 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:00:34.024584    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:00:42.410555 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:00:42.410522    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:00:51.508186 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:00:51.508098    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:00:57.404734 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:00:57.404696    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:01:06.514798 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:01:06.514747    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:01:15.605089 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:01:15.605056    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:01:24.412287 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:01:24.412251    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:01:33.705598 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:01:33.705566    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:01:45.709338 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:01:45.709302    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:01:53.448087 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:01:53.448048    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:02:03.317877 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:03.317841    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:02:15.105671 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:15.105638    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:02:25.710620 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:25.710547    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:02:39.518652 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:39.518614    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:02:48.805689 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:48.805653    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:02:58.501664 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:58.501626    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:02:59.064733 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:59.064698    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5"]
Jul 29 15:02:59.065075 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:59.065062    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05a564fd-6b16-47bc-ac5a-cdb7f6b28e90" containerName="main"
Jul 29 15:02:59.065122 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:59.065076    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="05a564fd-6b16-47bc-ac5a-cdb7f6b28e90" containerName="main"
Jul 29 15:02:59.065122 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:59.065091    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d996c357-bc21-4b93-8a6f-abe371c6dbeb" containerName="main"
Jul 29 15:02:59.065122 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:59.065096    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d996c357-bc21-4b93-8a6f-abe371c6dbeb" containerName="main"
Jul 29 15:02:59.065217 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:59.065159    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="05a564fd-6b16-47bc-ac5a-cdb7f6b28e90" containerName="main"
Jul 29 15:02:59.065217 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:59.065170    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d996c357-bc21-4b93-8a6f-abe371c6dbeb" containerName="main"
Jul 29 15:02:59.068357 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:59.068339    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5"
Jul 29 15:02:59.072343 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:59.072321    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-59092fc4-openshift-default-dockercfg-clk7r\""
Jul 29 15:02:59.098672 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:59.098641    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5"]
Jul 29 15:02:59.257679 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:59.257634    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gp6f\" (UniqueName: \"kubernetes.io/projected/04910a8b-7d83-44f7-a040-99442a6b9127-kube-api-access-9gp6f\") pod \"e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5\" (UID: \"04910a8b-7d83-44f7-a040-99442a6b9127\") " pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5"
Jul 29 15:02:59.257679 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:59.257684    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04910a8b-7d83-44f7-a040-99442a6b9127-istio-data\") pod \"e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5\" (UID: \"04910a8b-7d83-44f7-a040-99442a6b9127\") " pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5"
Jul 29 15:02:59.257939 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:59.257733    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04910a8b-7d83-44f7-a040-99442a6b9127-istio-token\") pod \"e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5\" (UID: \"04910a8b-7d83-44f7-a040-99442a6b9127\") " pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5"
Jul 29 15:02:59.257939 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:59.257779    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04910a8b-7d83-44f7-a040-99442a6b9127-istio-envoy\") pod \"e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5\" (UID: \"04910a8b-7d83-44f7-a040-99442a6b9127\") " pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5"
Jul 29 15:02:59.257939 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:59.257817    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04910a8b-7d83-44f7-a040-99442a6b9127-workload-certs\") pod \"e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5\" (UID: \"04910a8b-7d83-44f7-a040-99442a6b9127\") " pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5"
Jul 29 15:02:59.257939 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:59.257837    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04910a8b-7d83-44f7-a040-99442a6b9127-istio-podinfo\") pod \"e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5\" (UID: \"04910a8b-7d83-44f7-a040-99442a6b9127\") " pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5"
Jul 29 15:02:59.257939 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:59.257858    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04910a8b-7d83-44f7-a040-99442a6b9127-workload-socket\") pod \"e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5\" (UID: \"04910a8b-7d83-44f7-a040-99442a6b9127\") " pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5"
Jul 29 15:02:59.258121 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:59.257938    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04910a8b-7d83-44f7-a040-99442a6b9127-credential-socket\") pod \"e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5\" (UID: \"04910a8b-7d83-44f7-a040-99442a6b9127\") " pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5"
Jul 29 15:02:59.258121 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:59.257973    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04910a8b-7d83-44f7-a040-99442a6b9127-istiod-ca-cert\") pod \"e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5\" (UID: \"04910a8b-7d83-44f7-a040-99442a6b9127\") " pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5"
Jul 29 15:02:59.359154 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:59.359061    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gp6f\" (UniqueName: \"kubernetes.io/projected/04910a8b-7d83-44f7-a040-99442a6b9127-kube-api-access-9gp6f\") pod \"e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5\" (UID: \"04910a8b-7d83-44f7-a040-99442a6b9127\") " pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5"
Jul 29 15:02:59.359154 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:59.359100    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04910a8b-7d83-44f7-a040-99442a6b9127-istio-data\") pod \"e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5\" (UID: \"04910a8b-7d83-44f7-a040-99442a6b9127\") " pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5"
Jul 29 15:02:59.359154 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:59.359127    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04910a8b-7d83-44f7-a040-99442a6b9127-istio-token\") pod \"e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5\" (UID: \"04910a8b-7d83-44f7-a040-99442a6b9127\") " pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5"
Jul 29 15:02:59.359154 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:59.359152    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04910a8b-7d83-44f7-a040-99442a6b9127-istio-envoy\") pod \"e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5\" (UID: \"04910a8b-7d83-44f7-a040-99442a6b9127\") " pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5"
Jul 29 15:02:59.359525 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:59.359204    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04910a8b-7d83-44f7-a040-99442a6b9127-workload-certs\") pod \"e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5\" (UID: \"04910a8b-7d83-44f7-a040-99442a6b9127\") " pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5"
Jul 29 15:02:59.359525 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:59.359226    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04910a8b-7d83-44f7-a040-99442a6b9127-istio-podinfo\") pod \"e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5\" (UID: \"04910a8b-7d83-44f7-a040-99442a6b9127\") " pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5"
Jul 29 15:02:59.359525 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:59.359277    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04910a8b-7d83-44f7-a040-99442a6b9127-workload-socket\") pod \"e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5\" (UID: \"04910a8b-7d83-44f7-a040-99442a6b9127\") " pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5"
Jul 29 15:02:59.359525 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:59.359391    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04910a8b-7d83-44f7-a040-99442a6b9127-credential-socket\") pod \"e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5\" (UID: \"04910a8b-7d83-44f7-a040-99442a6b9127\") " pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5"
Jul 29 15:02:59.359525 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:59.359458    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04910a8b-7d83-44f7-a040-99442a6b9127-istiod-ca-cert\") pod \"e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5\" (UID: \"04910a8b-7d83-44f7-a040-99442a6b9127\") " pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5"
Jul 29 15:02:59.359754 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:59.359546    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04910a8b-7d83-44f7-a040-99442a6b9127-istio-data\") pod \"e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5\" (UID: \"04910a8b-7d83-44f7-a040-99442a6b9127\") " pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5"
Jul 29 15:02:59.359754 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:59.359583    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04910a8b-7d83-44f7-a040-99442a6b9127-workload-socket\") pod \"e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5\" (UID: \"04910a8b-7d83-44f7-a040-99442a6b9127\") " pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5"
Jul 29 15:02:59.359754 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:59.359634    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04910a8b-7d83-44f7-a040-99442a6b9127-workload-certs\") pod \"e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5\" (UID: \"04910a8b-7d83-44f7-a040-99442a6b9127\") " pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5"
Jul 29 15:02:59.359875 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:59.359825    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04910a8b-7d83-44f7-a040-99442a6b9127-credential-socket\") pod \"e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5\" (UID: \"04910a8b-7d83-44f7-a040-99442a6b9127\") " pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5"
Jul 29 15:02:59.360116 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:59.360098    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04910a8b-7d83-44f7-a040-99442a6b9127-istiod-ca-cert\") pod \"e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5\" (UID: \"04910a8b-7d83-44f7-a040-99442a6b9127\") " pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5"
Jul 29 15:02:59.361548 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:59.361528    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04910a8b-7d83-44f7-a040-99442a6b9127-istio-envoy\") pod \"e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5\" (UID: \"04910a8b-7d83-44f7-a040-99442a6b9127\") " pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5"
Jul 29 15:02:59.361812 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:59.361794    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04910a8b-7d83-44f7-a040-99442a6b9127-istio-podinfo\") pod \"e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5\" (UID: \"04910a8b-7d83-44f7-a040-99442a6b9127\") " pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5"
Jul 29 15:02:59.367509 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:59.367485    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04910a8b-7d83-44f7-a040-99442a6b9127-istio-token\") pod \"e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5\" (UID: \"04910a8b-7d83-44f7-a040-99442a6b9127\") " pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5"
Jul 29 15:02:59.367694 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:59.367674    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gp6f\" (UniqueName: \"kubernetes.io/projected/04910a8b-7d83-44f7-a040-99442a6b9127-kube-api-access-9gp6f\") pod \"e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5\" (UID: \"04910a8b-7d83-44f7-a040-99442a6b9127\") " pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5"
Jul 29 15:02:59.378533 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:59.378515    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5"
Jul 29 15:02:59.519282 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:59.515057    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5"]
Jul 29 15:02:59.522697 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:59.522656    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 15:02:59.522808 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:59.522736    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 15:02:59.522808 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:02:59.522770    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 15:03:00.495095 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:00.495050    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5" event={"ID":"04910a8b-7d83-44f7-a040-99442a6b9127","Type":"ContainerStarted","Data":"6680cbcda7893f0aabf82fe0686a29fdb8627f78ab2229c789304865ba076f05"}
Jul 29 15:03:00.495292 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:00.495113    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5" event={"ID":"04910a8b-7d83-44f7-a040-99442a6b9127","Type":"ContainerStarted","Data":"cff0a88decaf1e718d3077a4b6c03f94d1757d641e5afd3ce211793f2edbe27a"}
Jul 29 15:03:00.517503 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:00.517449    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5" podStartSLOduration=1.517433338 podStartE2EDuration="1.517433338s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:02:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:03:00.515370346 +0000 UTC m=+1652.817836957" watchObservedRunningTime="2026-07-29 15:03:00.517433338 +0000 UTC m=+1652.819899945"
Jul 29 15:03:01.378761 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:01.378722    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5"
Jul 29 15:03:01.383653 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:01.383627    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5"
Jul 29 15:03:01.500930 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:01.500897    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5"
Jul 29 15:03:01.501821 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:01.501803    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5"
Jul 29 15:03:09.305027 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:09.304932    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:03:17.448676 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:17.448531    2578 patch_prober.go:28] interesting pod/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": read tcp 10.134.0.2:34726->10.134.0.32:15021: read: connection reset by peer" start-of-body=
Jul 29 15:03:17.448676 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:17.448604    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5" podUID="04910a8b-7d83-44f7-a040-99442a6b9127" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": read tcp 10.134.0.2:34726->10.134.0.32:15021: read: connection reset by peer"
Jul 29 15:03:17.588864 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:17.588822    2578 generic.go:356] "Generic (PLEG): container finished" podID="04910a8b-7d83-44f7-a040-99442a6b9127" containerID="6680cbcda7893f0aabf82fe0686a29fdb8627f78ab2229c789304865ba076f05" exitCode=0
Jul 29 15:03:17.589054 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:17.588894    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5" event={"ID":"04910a8b-7d83-44f7-a040-99442a6b9127","Type":"ContainerDied","Data":"6680cbcda7893f0aabf82fe0686a29fdb8627f78ab2229c789304865ba076f05"}
Jul 29 15:03:17.589348 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:17.589333    2578 scope.go:117] "RemoveContainer" containerID="6680cbcda7893f0aabf82fe0686a29fdb8627f78ab2229c789304865ba076f05"
Jul 29 15:03:17.590394 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:17.590365    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 15:03:17.590523 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:17.590450    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 15:03:17.590523 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:17.590498    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 15:03:18.595386 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:18.595351    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5" event={"ID":"04910a8b-7d83-44f7-a040-99442a6b9127","Type":"ContainerStarted","Data":"7c26658f4c345d6c2f565454fec796d4b2b87b5f836f35e4d7bf1ef7f3ccdd8f"}
Jul 29 15:03:19.379521 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:19.379474    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5"
Jul 29 15:03:19.379770 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:19.379743    2578 patch_prober.go:28] interesting pod/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 29 15:03:19.379853 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:19.379805    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5" podUID="04910a8b-7d83-44f7-a040-99442a6b9127" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 29 15:03:20.379298 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:20.379259    2578 patch_prober.go:28] interesting pod/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 29 15:03:20.379769 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:20.379321    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5" podUID="04910a8b-7d83-44f7-a040-99442a6b9127" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 29 15:03:21.379448 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:21.379412    2578 patch_prober.go:28] interesting pod/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 29 15:03:21.379827 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:21.379470    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5" podUID="04910a8b-7d83-44f7-a040-99442a6b9127" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 29 15:03:22.379757 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:22.379717    2578 patch_prober.go:28] interesting pod/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 29 15:03:22.380120 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:22.379796    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5" podUID="04910a8b-7d83-44f7-a040-99442a6b9127" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 29 15:03:23.382882 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:23.382848    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5"
Jul 29 15:03:23.383349 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:23.383105    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5"
Jul 29 15:03:23.383900 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:23.383879    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5"
Jul 29 15:03:42.954963 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:42.954930    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5"]
Jul 29 15:03:42.955393 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:42.955127    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5" podUID="04910a8b-7d83-44f7-a040-99442a6b9127" containerName="istio-proxy" containerID="cri-o://7c26658f4c345d6c2f565454fec796d4b2b87b5f836f35e4d7bf1ef7f3ccdd8f" gracePeriod=30
Jul 29 15:03:44.044406 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:44.044366    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp"]
Jul 29 15:03:44.047940 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:44.047919    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp"
Jul 29 15:03:44.051852 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:44.051828    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-079ae78c-gw-openshift-default-dockercfg-c49cg\""
Jul 29 15:03:44.069801 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:44.069776    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp"]
Jul 29 15:03:44.178017 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:44.177983    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6434ab8-44ff-451e-80af-4063f087a6dd-credential-socket\") pod \"e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp\" (UID: \"a6434ab8-44ff-451e-80af-4063f087a6dd\") " pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp"
Jul 29 15:03:44.178198 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:44.178038    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6434ab8-44ff-451e-80af-4063f087a6dd-istio-token\") pod \"e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp\" (UID: \"a6434ab8-44ff-451e-80af-4063f087a6dd\") " pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp"
Jul 29 15:03:44.178198 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:44.178066    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbqbl\" (UniqueName: \"kubernetes.io/projected/a6434ab8-44ff-451e-80af-4063f087a6dd-kube-api-access-cbqbl\") pod \"e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp\" (UID: \"a6434ab8-44ff-451e-80af-4063f087a6dd\") " pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp"
Jul 29 15:03:44.178198 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:44.178111    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6434ab8-44ff-451e-80af-4063f087a6dd-workload-certs\") pod \"e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp\" (UID: \"a6434ab8-44ff-451e-80af-4063f087a6dd\") " pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp"
Jul 29 15:03:44.178198 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:44.178161    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6434ab8-44ff-451e-80af-4063f087a6dd-istio-envoy\") pod \"e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp\" (UID: \"a6434ab8-44ff-451e-80af-4063f087a6dd\") " pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp"
Jul 29 15:03:44.178198 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:44.178180    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6434ab8-44ff-451e-80af-4063f087a6dd-istiod-ca-cert\") pod \"e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp\" (UID: \"a6434ab8-44ff-451e-80af-4063f087a6dd\") " pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp"
Jul 29 15:03:44.178465 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:44.178214    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6434ab8-44ff-451e-80af-4063f087a6dd-istio-podinfo\") pod \"e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp\" (UID: \"a6434ab8-44ff-451e-80af-4063f087a6dd\") " pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp"
Jul 29 15:03:44.178465 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:44.178280    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6434ab8-44ff-451e-80af-4063f087a6dd-istio-data\") pod \"e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp\" (UID: \"a6434ab8-44ff-451e-80af-4063f087a6dd\") " pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp"
Jul 29 15:03:44.178465 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:44.178336    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6434ab8-44ff-451e-80af-4063f087a6dd-workload-socket\") pod \"e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp\" (UID: \"a6434ab8-44ff-451e-80af-4063f087a6dd\") " pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp"
Jul 29 15:03:44.279669 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:44.279636    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6434ab8-44ff-451e-80af-4063f087a6dd-workload-certs\") pod \"e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp\" (UID: \"a6434ab8-44ff-451e-80af-4063f087a6dd\") " pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp"
Jul 29 15:03:44.279844 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:44.279790    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6434ab8-44ff-451e-80af-4063f087a6dd-istio-envoy\") pod \"e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp\" (UID: \"a6434ab8-44ff-451e-80af-4063f087a6dd\") " pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp"
Jul 29 15:03:44.279844 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:44.279825    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6434ab8-44ff-451e-80af-4063f087a6dd-istiod-ca-cert\") pod \"e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp\" (UID: \"a6434ab8-44ff-451e-80af-4063f087a6dd\") " pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp"
Jul 29 15:03:44.279953 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:44.279855    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6434ab8-44ff-451e-80af-4063f087a6dd-istio-podinfo\") pod \"e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp\" (UID: \"a6434ab8-44ff-451e-80af-4063f087a6dd\") " pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp"
Jul 29 15:03:44.279953 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:44.279883    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6434ab8-44ff-451e-80af-4063f087a6dd-istio-data\") pod \"e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp\" (UID: \"a6434ab8-44ff-451e-80af-4063f087a6dd\") " pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp"
Jul 29 15:03:44.279953 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:44.279923    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6434ab8-44ff-451e-80af-4063f087a6dd-workload-socket\") pod \"e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp\" (UID: \"a6434ab8-44ff-451e-80af-4063f087a6dd\") " pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp"
Jul 29 15:03:44.279953 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:44.279948    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6434ab8-44ff-451e-80af-4063f087a6dd-credential-socket\") pod \"e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp\" (UID: \"a6434ab8-44ff-451e-80af-4063f087a6dd\") " pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp"
Jul 29 15:03:44.280155 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:44.280010    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6434ab8-44ff-451e-80af-4063f087a6dd-istio-token\") pod \"e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp\" (UID: \"a6434ab8-44ff-451e-80af-4063f087a6dd\") " pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp"
Jul 29 15:03:44.280155 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:44.280043    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbqbl\" (UniqueName: \"kubernetes.io/projected/a6434ab8-44ff-451e-80af-4063f087a6dd-kube-api-access-cbqbl\") pod \"e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp\" (UID: \"a6434ab8-44ff-451e-80af-4063f087a6dd\") " pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp"
Jul 29 15:03:44.280155 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:44.280117    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6434ab8-44ff-451e-80af-4063f087a6dd-workload-certs\") pod \"e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp\" (UID: \"a6434ab8-44ff-451e-80af-4063f087a6dd\") " pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp"
Jul 29 15:03:44.280322 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:44.280287    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6434ab8-44ff-451e-80af-4063f087a6dd-workload-socket\") pod \"e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp\" (UID: \"a6434ab8-44ff-451e-80af-4063f087a6dd\") " pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp"
Jul 29 15:03:44.280462 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:44.280439    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6434ab8-44ff-451e-80af-4063f087a6dd-credential-socket\") pod \"e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp\" (UID: \"a6434ab8-44ff-451e-80af-4063f087a6dd\") " pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp"
Jul 29 15:03:44.280531 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:44.280460    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6434ab8-44ff-451e-80af-4063f087a6dd-istio-data\") pod \"e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp\" (UID: \"a6434ab8-44ff-451e-80af-4063f087a6dd\") " pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp"
Jul 29 15:03:44.280660 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:44.280641    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6434ab8-44ff-451e-80af-4063f087a6dd-istiod-ca-cert\") pod \"e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp\" (UID: \"a6434ab8-44ff-451e-80af-4063f087a6dd\") " pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp"
Jul 29 15:03:44.282176 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:44.282147    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6434ab8-44ff-451e-80af-4063f087a6dd-istio-envoy\") pod \"e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp\" (UID: \"a6434ab8-44ff-451e-80af-4063f087a6dd\") " pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp"
Jul 29 15:03:44.282312 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:44.282295    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6434ab8-44ff-451e-80af-4063f087a6dd-istio-podinfo\") pod \"e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp\" (UID: \"a6434ab8-44ff-451e-80af-4063f087a6dd\") " pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp"
Jul 29 15:03:44.290781 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:44.290753    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbqbl\" (UniqueName: \"kubernetes.io/projected/a6434ab8-44ff-451e-80af-4063f087a6dd-kube-api-access-cbqbl\") pod \"e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp\" (UID: \"a6434ab8-44ff-451e-80af-4063f087a6dd\") " pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp"
Jul 29 15:03:44.290871 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:44.290849    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6434ab8-44ff-451e-80af-4063f087a6dd-istio-token\") pod \"e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp\" (UID: \"a6434ab8-44ff-451e-80af-4063f087a6dd\") " pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp"
Jul 29 15:03:44.357907 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:44.357842    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp"
Jul 29 15:03:44.522969 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:44.522942    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp"]
Jul 29 15:03:44.525306 ip-10-0-142-130 kubenswrapper[2578]: W0729 15:03:44.525279    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6434ab8_44ff_451e_80af_4063f087a6dd.slice/crio-21f917ed8ec1e4f60dcc1de14e6a5464f4d142c66a2750adbcbd4962fa15ea78 WatchSource:0}: Error finding container 21f917ed8ec1e4f60dcc1de14e6a5464f4d142c66a2750adbcbd4962fa15ea78: Status 404 returned error can't find the container with id 21f917ed8ec1e4f60dcc1de14e6a5464f4d142c66a2750adbcbd4962fa15ea78
Jul 29 15:03:44.527318 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:44.527291    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 15:03:44.527386 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:44.527351    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 15:03:44.527386 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:44.527377    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 15:03:44.717680 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:44.717593    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp" event={"ID":"a6434ab8-44ff-451e-80af-4063f087a6dd","Type":"ContainerStarted","Data":"24cbb81a0750f76ffde9d5efe305b830ffff5daca55b6c39379719d0208efe4c"}
Jul 29 15:03:44.717680 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:44.717656    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp" event={"ID":"a6434ab8-44ff-451e-80af-4063f087a6dd","Type":"ContainerStarted","Data":"21f917ed8ec1e4f60dcc1de14e6a5464f4d142c66a2750adbcbd4962fa15ea78"}
Jul 29 15:03:44.763530 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:44.763479    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp" podStartSLOduration=0.763460344 podStartE2EDuration="763.460344ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:03:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:03:44.758512393 +0000 UTC m=+1697.060979005" watchObservedRunningTime="2026-07-29 15:03:44.763460344 +0000 UTC m=+1697.065926952"
Jul 29 15:03:45.358405 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:45.358368    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp"
Jul 29 15:03:45.363299 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:45.363271    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp"
Jul 29 15:03:45.722352 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:45.722266    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp"
Jul 29 15:03:45.723167 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:45.723149    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp"
Jul 29 15:03:46.536002 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:46.535967    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:03:48.205453 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:48.205431    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5"
Jul 29 15:03:48.215432 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:48.215384    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04910a8b-7d83-44f7-a040-99442a6b9127-istio-token\") pod \"04910a8b-7d83-44f7-a040-99442a6b9127\" (UID: \"04910a8b-7d83-44f7-a040-99442a6b9127\") "
Jul 29 15:03:48.215514 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:48.215433    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04910a8b-7d83-44f7-a040-99442a6b9127-istio-envoy\") pod \"04910a8b-7d83-44f7-a040-99442a6b9127\" (UID: \"04910a8b-7d83-44f7-a040-99442a6b9127\") "
Jul 29 15:03:48.215514 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:48.215452    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04910a8b-7d83-44f7-a040-99442a6b9127-credential-socket\") pod \"04910a8b-7d83-44f7-a040-99442a6b9127\" (UID: \"04910a8b-7d83-44f7-a040-99442a6b9127\") "
Jul 29 15:03:48.215514 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:48.215499    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04910a8b-7d83-44f7-a040-99442a6b9127-workload-certs\") pod \"04910a8b-7d83-44f7-a040-99442a6b9127\" (UID: \"04910a8b-7d83-44f7-a040-99442a6b9127\") "
Jul 29 15:03:48.215622 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:48.215515    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04910a8b-7d83-44f7-a040-99442a6b9127-istiod-ca-cert\") pod \"04910a8b-7d83-44f7-a040-99442a6b9127\" (UID: \"04910a8b-7d83-44f7-a040-99442a6b9127\") "
Jul 29 15:03:48.215622 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:48.215531    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04910a8b-7d83-44f7-a040-99442a6b9127-workload-socket\") pod \"04910a8b-7d83-44f7-a040-99442a6b9127\" (UID: \"04910a8b-7d83-44f7-a040-99442a6b9127\") "
Jul 29 15:03:48.215622 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:48.215554    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04910a8b-7d83-44f7-a040-99442a6b9127-istio-podinfo\") pod \"04910a8b-7d83-44f7-a040-99442a6b9127\" (UID: \"04910a8b-7d83-44f7-a040-99442a6b9127\") "
Jul 29 15:03:48.215622 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:48.215581    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04910a8b-7d83-44f7-a040-99442a6b9127-istio-data\") pod \"04910a8b-7d83-44f7-a040-99442a6b9127\" (UID: \"04910a8b-7d83-44f7-a040-99442a6b9127\") "
Jul 29 15:03:48.215622 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:48.215618    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9gp6f\" (UniqueName: \"kubernetes.io/projected/04910a8b-7d83-44f7-a040-99442a6b9127-kube-api-access-9gp6f\") pod \"04910a8b-7d83-44f7-a040-99442a6b9127\" (UID: \"04910a8b-7d83-44f7-a040-99442a6b9127\") "
Jul 29 15:03:48.215868 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:48.215790    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04910a8b-7d83-44f7-a040-99442a6b9127-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "04910a8b-7d83-44f7-a040-99442a6b9127" (UID: "04910a8b-7d83-44f7-a040-99442a6b9127"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:03:48.215868 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:48.215808    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04910a8b-7d83-44f7-a040-99442a6b9127-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "04910a8b-7d83-44f7-a040-99442a6b9127" (UID: "04910a8b-7d83-44f7-a040-99442a6b9127"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:03:48.215974 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:48.215935    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04910a8b-7d83-44f7-a040-99442a6b9127-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "04910a8b-7d83-44f7-a040-99442a6b9127" (UID: "04910a8b-7d83-44f7-a040-99442a6b9127"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 15:03:48.216030 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:48.215986    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04910a8b-7d83-44f7-a040-99442a6b9127-workload-certs\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:03:48.216030 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:48.216017    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04910a8b-7d83-44f7-a040-99442a6b9127-workload-socket\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:03:48.216126 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:48.216084    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04910a8b-7d83-44f7-a040-99442a6b9127-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "04910a8b-7d83-44f7-a040-99442a6b9127" (UID: "04910a8b-7d83-44f7-a040-99442a6b9127"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:03:48.216536 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:48.216515    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04910a8b-7d83-44f7-a040-99442a6b9127-istio-data" (OuterVolumeSpecName: "istio-data") pod "04910a8b-7d83-44f7-a040-99442a6b9127" (UID: "04910a8b-7d83-44f7-a040-99442a6b9127"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:03:48.217881 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:48.217853    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04910a8b-7d83-44f7-a040-99442a6b9127-kube-api-access-9gp6f" (OuterVolumeSpecName: "kube-api-access-9gp6f") pod "04910a8b-7d83-44f7-a040-99442a6b9127" (UID: "04910a8b-7d83-44f7-a040-99442a6b9127"). InnerVolumeSpecName "kube-api-access-9gp6f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 15:03:48.217968 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:48.217886    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/04910a8b-7d83-44f7-a040-99442a6b9127-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "04910a8b-7d83-44f7-a040-99442a6b9127" (UID: "04910a8b-7d83-44f7-a040-99442a6b9127"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 15:03:48.218011 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:48.217972    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04910a8b-7d83-44f7-a040-99442a6b9127-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "04910a8b-7d83-44f7-a040-99442a6b9127" (UID: "04910a8b-7d83-44f7-a040-99442a6b9127"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:03:48.218011 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:48.217978    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04910a8b-7d83-44f7-a040-99442a6b9127-istio-token" (OuterVolumeSpecName: "istio-token") pod "04910a8b-7d83-44f7-a040-99442a6b9127" (UID: "04910a8b-7d83-44f7-a040-99442a6b9127"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 15:03:48.317316 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:48.317277    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04910a8b-7d83-44f7-a040-99442a6b9127-istio-envoy\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:03:48.317316 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:48.317310    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04910a8b-7d83-44f7-a040-99442a6b9127-credential-socket\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:03:48.317316 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:48.317320    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04910a8b-7d83-44f7-a040-99442a6b9127-istiod-ca-cert\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:03:48.317534 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:48.317330    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04910a8b-7d83-44f7-a040-99442a6b9127-istio-podinfo\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:03:48.317534 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:48.317338    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04910a8b-7d83-44f7-a040-99442a6b9127-istio-data\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:03:48.317534 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:48.317371    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9gp6f\" (UniqueName: \"kubernetes.io/projected/04910a8b-7d83-44f7-a040-99442a6b9127-kube-api-access-9gp6f\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:03:48.317534 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:48.317379    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04910a8b-7d83-44f7-a040-99442a6b9127-istio-token\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:03:48.737372 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:48.737340    2578 generic.go:356] "Generic (PLEG): container finished" podID="04910a8b-7d83-44f7-a040-99442a6b9127" containerID="7c26658f4c345d6c2f565454fec796d4b2b87b5f836f35e4d7bf1ef7f3ccdd8f" exitCode=0
Jul 29 15:03:48.737532 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:48.737397    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5"
Jul 29 15:03:48.737532 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:48.737408    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5" event={"ID":"04910a8b-7d83-44f7-a040-99442a6b9127","Type":"ContainerDied","Data":"7c26658f4c345d6c2f565454fec796d4b2b87b5f836f35e4d7bf1ef7f3ccdd8f"}
Jul 29 15:03:48.737532 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:48.737450    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5" event={"ID":"04910a8b-7d83-44f7-a040-99442a6b9127","Type":"ContainerDied","Data":"cff0a88decaf1e718d3077a4b6c03f94d1757d641e5afd3ce211793f2edbe27a"}
Jul 29 15:03:48.737532 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:48.737471    2578 scope.go:117] "RemoveContainer" containerID="7c26658f4c345d6c2f565454fec796d4b2b87b5f836f35e4d7bf1ef7f3ccdd8f"
Jul 29 15:03:48.746074 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:48.746049    2578 scope.go:117] "RemoveContainer" containerID="6680cbcda7893f0aabf82fe0686a29fdb8627f78ab2229c789304865ba076f05"
Jul 29 15:03:48.754312 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:48.754294    2578 scope.go:117] "RemoveContainer" containerID="7c26658f4c345d6c2f565454fec796d4b2b87b5f836f35e4d7bf1ef7f3ccdd8f"
Jul 29 15:03:48.754561 ip-10-0-142-130 kubenswrapper[2578]: E0729 15:03:48.754539    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c26658f4c345d6c2f565454fec796d4b2b87b5f836f35e4d7bf1ef7f3ccdd8f\": container with ID starting with 7c26658f4c345d6c2f565454fec796d4b2b87b5f836f35e4d7bf1ef7f3ccdd8f not found: ID does not exist" containerID="7c26658f4c345d6c2f565454fec796d4b2b87b5f836f35e4d7bf1ef7f3ccdd8f"
Jul 29 15:03:48.754612 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:48.754569    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c26658f4c345d6c2f565454fec796d4b2b87b5f836f35e4d7bf1ef7f3ccdd8f"} err="failed to get container status \"7c26658f4c345d6c2f565454fec796d4b2b87b5f836f35e4d7bf1ef7f3ccdd8f\": rpc error: code = NotFound desc = could not find container \"7c26658f4c345d6c2f565454fec796d4b2b87b5f836f35e4d7bf1ef7f3ccdd8f\": container with ID starting with 7c26658f4c345d6c2f565454fec796d4b2b87b5f836f35e4d7bf1ef7f3ccdd8f not found: ID does not exist"
Jul 29 15:03:48.754612 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:48.754588    2578 scope.go:117] "RemoveContainer" containerID="6680cbcda7893f0aabf82fe0686a29fdb8627f78ab2229c789304865ba076f05"
Jul 29 15:03:48.754789 ip-10-0-142-130 kubenswrapper[2578]: E0729 15:03:48.754770    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6680cbcda7893f0aabf82fe0686a29fdb8627f78ab2229c789304865ba076f05\": container with ID starting with 6680cbcda7893f0aabf82fe0686a29fdb8627f78ab2229c789304865ba076f05 not found: ID does not exist" containerID="6680cbcda7893f0aabf82fe0686a29fdb8627f78ab2229c789304865ba076f05"
Jul 29 15:03:48.754830 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:48.754796    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6680cbcda7893f0aabf82fe0686a29fdb8627f78ab2229c789304865ba076f05"} err="failed to get container status \"6680cbcda7893f0aabf82fe0686a29fdb8627f78ab2229c789304865ba076f05\": rpc error: code = NotFound desc = could not find container \"6680cbcda7893f0aabf82fe0686a29fdb8627f78ab2229c789304865ba076f05\": container with ID starting with 6680cbcda7893f0aabf82fe0686a29fdb8627f78ab2229c789304865ba076f05 not found: ID does not exist"
Jul 29 15:03:48.759098 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:48.759076    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5"]
Jul 29 15:03:48.763928 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:48.763907    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-59092fc4-openshift-default-6f8949766d-dr4m5"]
Jul 29 15:03:50.278091 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:50.278017    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04910a8b-7d83-44f7-a040-99442a6b9127" path="/var/lib/kubelet/pods/04910a8b-7d83-44f7-a040-99442a6b9127/volumes"
Jul 29 15:03:57.739777 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:03:57.739730    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:04:01.270018 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:01.268589    2578 patch_prober.go:28] interesting pod/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": read tcp 10.134.0.2:37162->10.134.0.33:15021: read: connection reset by peer" start-of-body=
Jul 29 15:04:01.270018 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:01.268663    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp" podUID="a6434ab8-44ff-451e-80af-4063f087a6dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": read tcp 10.134.0.2:37162->10.134.0.33:15021: read: connection reset by peer"
Jul 29 15:04:01.801649 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:01.801617    2578 generic.go:356] "Generic (PLEG): container finished" podID="a6434ab8-44ff-451e-80af-4063f087a6dd" containerID="24cbb81a0750f76ffde9d5efe305b830ffff5daca55b6c39379719d0208efe4c" exitCode=0
Jul 29 15:04:01.801825 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:01.801687    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp" event={"ID":"a6434ab8-44ff-451e-80af-4063f087a6dd","Type":"ContainerDied","Data":"24cbb81a0750f76ffde9d5efe305b830ffff5daca55b6c39379719d0208efe4c"}
Jul 29 15:04:01.802083 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:01.802069    2578 scope.go:117] "RemoveContainer" containerID="24cbb81a0750f76ffde9d5efe305b830ffff5daca55b6c39379719d0208efe4c"
Jul 29 15:04:01.803113 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:01.803088    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 15:04:01.803167 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:01.803152    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 15:04:01.803201 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:01.803184    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 15:04:02.809190 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:02.809153    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp" event={"ID":"a6434ab8-44ff-451e-80af-4063f087a6dd","Type":"ContainerStarted","Data":"1af92bd71b4ee5212dae17fbf9ce8f459a1e793f18a9bdc264518bc01d26fc7b"}
Jul 29 15:04:03.358961 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:03.358916    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp"
Jul 29 15:04:03.359203 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:03.359179    2578 patch_prober.go:28] interesting pod/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Jul 29 15:04:03.359307 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:03.359253    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp" podUID="a6434ab8-44ff-451e-80af-4063f087a6dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Jul 29 15:04:04.358723 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:04.358689    2578 patch_prober.go:28] interesting pod/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Jul 29 15:04:04.359123 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:04.358745    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp" podUID="a6434ab8-44ff-451e-80af-4063f087a6dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Jul 29 15:04:05.358934 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:05.358893    2578 patch_prober.go:28] interesting pod/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Jul 29 15:04:05.359353 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:05.358954    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp" podUID="a6434ab8-44ff-451e-80af-4063f087a6dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Jul 29 15:04:06.358510 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:06.358470    2578 patch_prober.go:28] interesting pod/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Jul 29 15:04:06.358687 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:06.358530    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp" podUID="a6434ab8-44ff-451e-80af-4063f087a6dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Jul 29 15:04:07.362517 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:07.362481    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp"
Jul 29 15:04:07.362981 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:07.362869    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp"
Jul 29 15:04:07.363611 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:07.363594    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp"
Jul 29 15:04:17.542574 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:17.541476    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp"]
Jul 29 15:04:17.542574 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:17.541878    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp" podUID="a6434ab8-44ff-451e-80af-4063f087a6dd" containerName="istio-proxy" containerID="cri-o://1af92bd71b4ee5212dae17fbf9ce8f459a1e793f18a9bdc264518bc01d26fc7b" gracePeriod=30
Jul 29 15:04:18.324292 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:18.324228    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz"]
Jul 29 15:04:18.324686 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:18.324668    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04910a8b-7d83-44f7-a040-99442a6b9127" containerName="istio-proxy"
Jul 29 15:04:18.324771 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:18.324690    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="04910a8b-7d83-44f7-a040-99442a6b9127" containerName="istio-proxy"
Jul 29 15:04:18.324771 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:18.324704    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04910a8b-7d83-44f7-a040-99442a6b9127" containerName="istio-proxy"
Jul 29 15:04:18.324771 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:18.324712    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="04910a8b-7d83-44f7-a040-99442a6b9127" containerName="istio-proxy"
Jul 29 15:04:18.324922 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:18.324791    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="04910a8b-7d83-44f7-a040-99442a6b9127" containerName="istio-proxy"
Jul 29 15:04:18.324922 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:18.324806    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="04910a8b-7d83-44f7-a040-99442a6b9127" containerName="istio-proxy"
Jul 29 15:04:18.328324 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:18.328303    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz"
Jul 29 15:04:18.330987 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:18.330969    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-43963a57-openshift-default-dockercfg-q9n8q\""
Jul 29 15:04:18.345447 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:18.345421    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz"]
Jul 29 15:04:18.396647 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:18.396610    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f19688df-ab8e-4cc4-a292-07386c52b614-istio-token\") pod \"e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz\" (UID: \"f19688df-ab8e-4cc4-a292-07386c52b614\") " pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz"
Jul 29 15:04:18.396647 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:18.396649    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f19688df-ab8e-4cc4-a292-07386c52b614-istio-data\") pod \"e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz\" (UID: \"f19688df-ab8e-4cc4-a292-07386c52b614\") " pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz"
Jul 29 15:04:18.396863 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:18.396675    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f19688df-ab8e-4cc4-a292-07386c52b614-istiod-ca-cert\") pod \"e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz\" (UID: \"f19688df-ab8e-4cc4-a292-07386c52b614\") " pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz"
Jul 29 15:04:18.396863 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:18.396738    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f19688df-ab8e-4cc4-a292-07386c52b614-istio-envoy\") pod \"e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz\" (UID: \"f19688df-ab8e-4cc4-a292-07386c52b614\") " pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz"
Jul 29 15:04:18.396863 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:18.396829    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f19688df-ab8e-4cc4-a292-07386c52b614-credential-socket\") pod \"e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz\" (UID: \"f19688df-ab8e-4cc4-a292-07386c52b614\") " pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz"
Jul 29 15:04:18.396863 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:18.396862    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f19688df-ab8e-4cc4-a292-07386c52b614-istio-podinfo\") pod \"e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz\" (UID: \"f19688df-ab8e-4cc4-a292-07386c52b614\") " pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz"
Jul 29 15:04:18.397014 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:18.396886    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f19688df-ab8e-4cc4-a292-07386c52b614-workload-socket\") pod \"e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz\" (UID: \"f19688df-ab8e-4cc4-a292-07386c52b614\") " pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz"
Jul 29 15:04:18.397014 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:18.396909    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f19688df-ab8e-4cc4-a292-07386c52b614-workload-certs\") pod \"e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz\" (UID: \"f19688df-ab8e-4cc4-a292-07386c52b614\") " pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz"
Jul 29 15:04:18.397014 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:18.396945    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khhxf\" (UniqueName: \"kubernetes.io/projected/f19688df-ab8e-4cc4-a292-07386c52b614-kube-api-access-khhxf\") pod \"e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz\" (UID: \"f19688df-ab8e-4cc4-a292-07386c52b614\") " pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz"
Jul 29 15:04:18.498488 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:18.498447    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f19688df-ab8e-4cc4-a292-07386c52b614-istio-token\") pod \"e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz\" (UID: \"f19688df-ab8e-4cc4-a292-07386c52b614\") " pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz"
Jul 29 15:04:18.498488 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:18.498490    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f19688df-ab8e-4cc4-a292-07386c52b614-istio-data\") pod \"e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz\" (UID: \"f19688df-ab8e-4cc4-a292-07386c52b614\") " pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz"
Jul 29 15:04:18.498752 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:18.498516    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f19688df-ab8e-4cc4-a292-07386c52b614-istiod-ca-cert\") pod \"e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz\" (UID: \"f19688df-ab8e-4cc4-a292-07386c52b614\") " pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz"
Jul 29 15:04:18.498752 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:18.498540    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f19688df-ab8e-4cc4-a292-07386c52b614-istio-envoy\") pod \"e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz\" (UID: \"f19688df-ab8e-4cc4-a292-07386c52b614\") " pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz"
Jul 29 15:04:18.498752 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:18.498619    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f19688df-ab8e-4cc4-a292-07386c52b614-credential-socket\") pod \"e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz\" (UID: \"f19688df-ab8e-4cc4-a292-07386c52b614\") " pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz"
Jul 29 15:04:18.498752 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:18.498658    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f19688df-ab8e-4cc4-a292-07386c52b614-istio-podinfo\") pod \"e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz\" (UID: \"f19688df-ab8e-4cc4-a292-07386c52b614\") " pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz"
Jul 29 15:04:18.498752 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:18.498691    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f19688df-ab8e-4cc4-a292-07386c52b614-workload-socket\") pod \"e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz\" (UID: \"f19688df-ab8e-4cc4-a292-07386c52b614\") " pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz"
Jul 29 15:04:18.498752 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:18.498716    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f19688df-ab8e-4cc4-a292-07386c52b614-workload-certs\") pod \"e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz\" (UID: \"f19688df-ab8e-4cc4-a292-07386c52b614\") " pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz"
Jul 29 15:04:18.498752 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:18.498743    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khhxf\" (UniqueName: \"kubernetes.io/projected/f19688df-ab8e-4cc4-a292-07386c52b614-kube-api-access-khhxf\") pod \"e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz\" (UID: \"f19688df-ab8e-4cc4-a292-07386c52b614\") " pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz"
Jul 29 15:04:18.499112 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:18.498991    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f19688df-ab8e-4cc4-a292-07386c52b614-istio-data\") pod \"e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz\" (UID: \"f19688df-ab8e-4cc4-a292-07386c52b614\") " pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz"
Jul 29 15:04:18.499631 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:18.499601    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f19688df-ab8e-4cc4-a292-07386c52b614-workload-certs\") pod \"e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz\" (UID: \"f19688df-ab8e-4cc4-a292-07386c52b614\") " pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz"
Jul 29 15:04:18.499631 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:18.499617    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f19688df-ab8e-4cc4-a292-07386c52b614-istiod-ca-cert\") pod \"e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz\" (UID: \"f19688df-ab8e-4cc4-a292-07386c52b614\") " pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz"
Jul 29 15:04:18.499829 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:18.499808    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f19688df-ab8e-4cc4-a292-07386c52b614-workload-socket\") pod \"e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz\" (UID: \"f19688df-ab8e-4cc4-a292-07386c52b614\") " pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz"
Jul 29 15:04:18.500057 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:18.500039    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f19688df-ab8e-4cc4-a292-07386c52b614-credential-socket\") pod \"e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz\" (UID: \"f19688df-ab8e-4cc4-a292-07386c52b614\") " pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz"
Jul 29 15:04:18.501378 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:18.501355    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f19688df-ab8e-4cc4-a292-07386c52b614-istio-podinfo\") pod \"e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz\" (UID: \"f19688df-ab8e-4cc4-a292-07386c52b614\") " pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz"
Jul 29 15:04:18.501468 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:18.501415    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f19688df-ab8e-4cc4-a292-07386c52b614-istio-envoy\") pod \"e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz\" (UID: \"f19688df-ab8e-4cc4-a292-07386c52b614\") " pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz"
Jul 29 15:04:18.507640 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:18.507618    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f19688df-ab8e-4cc4-a292-07386c52b614-istio-token\") pod \"e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz\" (UID: \"f19688df-ab8e-4cc4-a292-07386c52b614\") " pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz"
Jul 29 15:04:18.507640 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:18.507628    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khhxf\" (UniqueName: \"kubernetes.io/projected/f19688df-ab8e-4cc4-a292-07386c52b614-kube-api-access-khhxf\") pod \"e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz\" (UID: \"f19688df-ab8e-4cc4-a292-07386c52b614\") " pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz"
Jul 29 15:04:18.638362 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:18.638270    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz"
Jul 29 15:04:18.773905 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:18.773879    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz"]
Jul 29 15:04:18.775748 ip-10-0-142-130 kubenswrapper[2578]: W0729 15:04:18.775720    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf19688df_ab8e_4cc4_a292_07386c52b614.slice/crio-322184b24103a6f72db0d8ce7a1f53784d0605db101f903f2211ffcf9d2680b6 WatchSource:0}: Error finding container 322184b24103a6f72db0d8ce7a1f53784d0605db101f903f2211ffcf9d2680b6: Status 404 returned error can't find the container with id 322184b24103a6f72db0d8ce7a1f53784d0605db101f903f2211ffcf9d2680b6
Jul 29 15:04:18.777729 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:18.777697    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 15:04:18.777823 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:18.777765    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 15:04:18.777823 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:18.777794    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 15:04:18.885958 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:18.885899    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz" event={"ID":"f19688df-ab8e-4cc4-a292-07386c52b614","Type":"ContainerStarted","Data":"d4da7c82e7de474ef9a827c7c9be07a9de199728c7eb6009cfd3d05d548ff5ff"}
Jul 29 15:04:18.886162 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:18.885991    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz" event={"ID":"f19688df-ab8e-4cc4-a292-07386c52b614","Type":"ContainerStarted","Data":"322184b24103a6f72db0d8ce7a1f53784d0605db101f903f2211ffcf9d2680b6"}
Jul 29 15:04:18.907985 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:18.907875    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz" podStartSLOduration=0.90785815 podStartE2EDuration="907.85815ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:04:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:04:18.905949325 +0000 UTC m=+1731.208415934" watchObservedRunningTime="2026-07-29 15:04:18.90785815 +0000 UTC m=+1731.210324758"
Jul 29 15:04:19.639474 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:19.639434    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz"
Jul 29 15:04:19.644383 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:19.644357    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz"
Jul 29 15:04:19.891707 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:19.891595    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz"
Jul 29 15:04:19.892681 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:19.892661    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz"
Jul 29 15:04:21.549796 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:21.549752    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:04:22.366072 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:22.366031    2578 patch_prober.go:28] interesting pod/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 15:04:22.366387 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:22.366355    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp" podUID="a6434ab8-44ff-451e-80af-4063f087a6dd" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 15:04:22.809105 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:22.809082    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp"
Jul 29 15:04:22.907558 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:22.907522    2578 generic.go:356] "Generic (PLEG): container finished" podID="a6434ab8-44ff-451e-80af-4063f087a6dd" containerID="1af92bd71b4ee5212dae17fbf9ce8f459a1e793f18a9bdc264518bc01d26fc7b" exitCode=0
Jul 29 15:04:22.907727 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:22.907566    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp"
Jul 29 15:04:22.907727 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:22.907575    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp" event={"ID":"a6434ab8-44ff-451e-80af-4063f087a6dd","Type":"ContainerDied","Data":"1af92bd71b4ee5212dae17fbf9ce8f459a1e793f18a9bdc264518bc01d26fc7b"}
Jul 29 15:04:22.907727 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:22.907652    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp" event={"ID":"a6434ab8-44ff-451e-80af-4063f087a6dd","Type":"ContainerDied","Data":"21f917ed8ec1e4f60dcc1de14e6a5464f4d142c66a2750adbcbd4962fa15ea78"}
Jul 29 15:04:22.907727 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:22.907679    2578 scope.go:117] "RemoveContainer" containerID="1af92bd71b4ee5212dae17fbf9ce8f459a1e793f18a9bdc264518bc01d26fc7b"
Jul 29 15:04:22.915823 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:22.915805    2578 scope.go:117] "RemoveContainer" containerID="24cbb81a0750f76ffde9d5efe305b830ffff5daca55b6c39379719d0208efe4c"
Jul 29 15:04:22.923782 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:22.923767    2578 scope.go:117] "RemoveContainer" containerID="1af92bd71b4ee5212dae17fbf9ce8f459a1e793f18a9bdc264518bc01d26fc7b"
Jul 29 15:04:22.924008 ip-10-0-142-130 kubenswrapper[2578]: E0729 15:04:22.923988    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1af92bd71b4ee5212dae17fbf9ce8f459a1e793f18a9bdc264518bc01d26fc7b\": container with ID starting with 1af92bd71b4ee5212dae17fbf9ce8f459a1e793f18a9bdc264518bc01d26fc7b not found: ID does not exist" containerID="1af92bd71b4ee5212dae17fbf9ce8f459a1e793f18a9bdc264518bc01d26fc7b"
Jul 29 15:04:22.924066 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:22.924015    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1af92bd71b4ee5212dae17fbf9ce8f459a1e793f18a9bdc264518bc01d26fc7b"} err="failed to get container status \"1af92bd71b4ee5212dae17fbf9ce8f459a1e793f18a9bdc264518bc01d26fc7b\": rpc error: code = NotFound desc = could not find container \"1af92bd71b4ee5212dae17fbf9ce8f459a1e793f18a9bdc264518bc01d26fc7b\": container with ID starting with 1af92bd71b4ee5212dae17fbf9ce8f459a1e793f18a9bdc264518bc01d26fc7b not found: ID does not exist"
Jul 29 15:04:22.924066 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:22.924031    2578 scope.go:117] "RemoveContainer" containerID="24cbb81a0750f76ffde9d5efe305b830ffff5daca55b6c39379719d0208efe4c"
Jul 29 15:04:22.924282 ip-10-0-142-130 kubenswrapper[2578]: E0729 15:04:22.924266    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24cbb81a0750f76ffde9d5efe305b830ffff5daca55b6c39379719d0208efe4c\": container with ID starting with 24cbb81a0750f76ffde9d5efe305b830ffff5daca55b6c39379719d0208efe4c not found: ID does not exist" containerID="24cbb81a0750f76ffde9d5efe305b830ffff5daca55b6c39379719d0208efe4c"
Jul 29 15:04:22.924330 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:22.924286    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24cbb81a0750f76ffde9d5efe305b830ffff5daca55b6c39379719d0208efe4c"} err="failed to get container status \"24cbb81a0750f76ffde9d5efe305b830ffff5daca55b6c39379719d0208efe4c\": rpc error: code = NotFound desc = could not find container \"24cbb81a0750f76ffde9d5efe305b830ffff5daca55b6c39379719d0208efe4c\": container with ID starting with 24cbb81a0750f76ffde9d5efe305b830ffff5daca55b6c39379719d0208efe4c not found: ID does not exist"
Jul 29 15:04:22.940607 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:22.940587    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6434ab8-44ff-451e-80af-4063f087a6dd-istiod-ca-cert\") pod \"a6434ab8-44ff-451e-80af-4063f087a6dd\" (UID: \"a6434ab8-44ff-451e-80af-4063f087a6dd\") "
Jul 29 15:04:22.940687 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:22.940622    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbqbl\" (UniqueName: \"kubernetes.io/projected/a6434ab8-44ff-451e-80af-4063f087a6dd-kube-api-access-cbqbl\") pod \"a6434ab8-44ff-451e-80af-4063f087a6dd\" (UID: \"a6434ab8-44ff-451e-80af-4063f087a6dd\") "
Jul 29 15:04:22.940687 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:22.940641    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6434ab8-44ff-451e-80af-4063f087a6dd-istio-podinfo\") pod \"a6434ab8-44ff-451e-80af-4063f087a6dd\" (UID: \"a6434ab8-44ff-451e-80af-4063f087a6dd\") "
Jul 29 15:04:22.940687 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:22.940671    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6434ab8-44ff-451e-80af-4063f087a6dd-workload-socket\") pod \"a6434ab8-44ff-451e-80af-4063f087a6dd\" (UID: \"a6434ab8-44ff-451e-80af-4063f087a6dd\") "
Jul 29 15:04:22.940822 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:22.940706    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6434ab8-44ff-451e-80af-4063f087a6dd-workload-certs\") pod \"a6434ab8-44ff-451e-80af-4063f087a6dd\" (UID: \"a6434ab8-44ff-451e-80af-4063f087a6dd\") "
Jul 29 15:04:22.940822 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:22.940728    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6434ab8-44ff-451e-80af-4063f087a6dd-istio-data\") pod \"a6434ab8-44ff-451e-80af-4063f087a6dd\" (UID: \"a6434ab8-44ff-451e-80af-4063f087a6dd\") "
Jul 29 15:04:22.940822 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:22.940747    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6434ab8-44ff-451e-80af-4063f087a6dd-istio-envoy\") pod \"a6434ab8-44ff-451e-80af-4063f087a6dd\" (UID: \"a6434ab8-44ff-451e-80af-4063f087a6dd\") "
Jul 29 15:04:22.940822 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:22.940770    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6434ab8-44ff-451e-80af-4063f087a6dd-credential-socket\") pod \"a6434ab8-44ff-451e-80af-4063f087a6dd\" (UID: \"a6434ab8-44ff-451e-80af-4063f087a6dd\") "
Jul 29 15:04:22.941020 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:22.940826    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6434ab8-44ff-451e-80af-4063f087a6dd-istio-token\") pod \"a6434ab8-44ff-451e-80af-4063f087a6dd\" (UID: \"a6434ab8-44ff-451e-80af-4063f087a6dd\") "
Jul 29 15:04:22.941077 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:22.941040    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6434ab8-44ff-451e-80af-4063f087a6dd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a6434ab8-44ff-451e-80af-4063f087a6dd" (UID: "a6434ab8-44ff-451e-80af-4063f087a6dd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 15:04:22.941151 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:22.941123    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6434ab8-44ff-451e-80af-4063f087a6dd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a6434ab8-44ff-451e-80af-4063f087a6dd" (UID: "a6434ab8-44ff-451e-80af-4063f087a6dd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:04:22.941218 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:22.941200    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6434ab8-44ff-451e-80af-4063f087a6dd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a6434ab8-44ff-451e-80af-4063f087a6dd" (UID: "a6434ab8-44ff-451e-80af-4063f087a6dd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:04:22.941287 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:22.941215    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6434ab8-44ff-451e-80af-4063f087a6dd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a6434ab8-44ff-451e-80af-4063f087a6dd" (UID: "a6434ab8-44ff-451e-80af-4063f087a6dd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:04:22.941727 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:22.941694    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6434ab8-44ff-451e-80af-4063f087a6dd-istio-data" (OuterVolumeSpecName: "istio-data") pod "a6434ab8-44ff-451e-80af-4063f087a6dd" (UID: "a6434ab8-44ff-451e-80af-4063f087a6dd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:04:22.942858 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:22.942828    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6434ab8-44ff-451e-80af-4063f087a6dd-kube-api-access-cbqbl" (OuterVolumeSpecName: "kube-api-access-cbqbl") pod "a6434ab8-44ff-451e-80af-4063f087a6dd" (UID: "a6434ab8-44ff-451e-80af-4063f087a6dd"). InnerVolumeSpecName "kube-api-access-cbqbl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 15:04:22.942858 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:22.942831    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a6434ab8-44ff-451e-80af-4063f087a6dd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a6434ab8-44ff-451e-80af-4063f087a6dd" (UID: "a6434ab8-44ff-451e-80af-4063f087a6dd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 15:04:22.943000 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:22.942921    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6434ab8-44ff-451e-80af-4063f087a6dd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a6434ab8-44ff-451e-80af-4063f087a6dd" (UID: "a6434ab8-44ff-451e-80af-4063f087a6dd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:04:22.943000 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:22.942962    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6434ab8-44ff-451e-80af-4063f087a6dd-istio-token" (OuterVolumeSpecName: "istio-token") pod "a6434ab8-44ff-451e-80af-4063f087a6dd" (UID: "a6434ab8-44ff-451e-80af-4063f087a6dd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 15:04:23.041849 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:23.041818    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6434ab8-44ff-451e-80af-4063f087a6dd-istio-envoy\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:04:23.041849 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:23.041843    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6434ab8-44ff-451e-80af-4063f087a6dd-credential-socket\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:04:23.041849 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:23.041853    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6434ab8-44ff-451e-80af-4063f087a6dd-istio-token\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:04:23.042043 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:23.041861    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6434ab8-44ff-451e-80af-4063f087a6dd-istiod-ca-cert\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:04:23.042043 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:23.041870    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbqbl\" (UniqueName: \"kubernetes.io/projected/a6434ab8-44ff-451e-80af-4063f087a6dd-kube-api-access-cbqbl\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:04:23.042043 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:23.041879    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6434ab8-44ff-451e-80af-4063f087a6dd-istio-podinfo\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:04:23.042043 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:23.041887    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6434ab8-44ff-451e-80af-4063f087a6dd-workload-socket\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:04:23.042043 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:23.041895    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6434ab8-44ff-451e-80af-4063f087a6dd-workload-certs\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:04:23.042043 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:23.041903    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6434ab8-44ff-451e-80af-4063f087a6dd-istio-data\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:04:23.230438 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:23.230407    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp"]
Jul 29 15:04:23.235752 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:23.235726    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-079ae78c-gw-openshift-default-854bc48c7b-wvwzp"]
Jul 29 15:04:24.278311 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:24.278270    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6434ab8-44ff-451e-80af-4063f087a6dd" path="/var/lib/kubelet/pods/a6434ab8-44ff-451e-80af-4063f087a6dd/volumes"
Jul 29 15:04:32.030770 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:32.030727    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:04:35.892767 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:35.892717    2578 patch_prober.go:28] interesting pod/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 29 15:04:35.893179 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:35.892805    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz" podUID="f19688df-ab8e-4cc4-a292-07386c52b614" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 29 15:04:36.977909 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:36.977820    2578 generic.go:356] "Generic (PLEG): container finished" podID="f19688df-ab8e-4cc4-a292-07386c52b614" containerID="d4da7c82e7de474ef9a827c7c9be07a9de199728c7eb6009cfd3d05d548ff5ff" exitCode=0
Jul 29 15:04:36.977909 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:36.977865    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz" event={"ID":"f19688df-ab8e-4cc4-a292-07386c52b614","Type":"ContainerDied","Data":"d4da7c82e7de474ef9a827c7c9be07a9de199728c7eb6009cfd3d05d548ff5ff"}
Jul 29 15:04:36.978444 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:36.978224    2578 scope.go:117] "RemoveContainer" containerID="d4da7c82e7de474ef9a827c7c9be07a9de199728c7eb6009cfd3d05d548ff5ff"
Jul 29 15:04:36.979295 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:36.979265    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 15:04:36.979408 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:36.979349    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 15:04:36.979479 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:36.979406    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 15:04:37.984616 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:37.984581    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz" event={"ID":"f19688df-ab8e-4cc4-a292-07386c52b614","Type":"ContainerStarted","Data":"fd4d5a8655f2d3511af43ceef15d3ce6e1833c1181b8ccf21fba61d85baed51f"}
Jul 29 15:04:38.638778 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:38.638734    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz"
Jul 29 15:04:38.638997 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:38.638871    2578 patch_prober.go:28] interesting pod/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 29 15:04:38.638997 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:38.638914    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz" podUID="f19688df-ab8e-4cc4-a292-07386c52b614" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 29 15:04:39.639528 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:39.639486    2578 patch_prober.go:28] interesting pod/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 29 15:04:39.640118 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:39.640086    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz" podUID="f19688df-ab8e-4cc4-a292-07386c52b614" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 29 15:04:40.639722 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:40.639673    2578 patch_prober.go:28] interesting pod/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 29 15:04:40.640228 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:40.639745    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz" podUID="f19688df-ab8e-4cc4-a292-07386c52b614" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 29 15:04:41.638924 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:41.638875    2578 patch_prober.go:28] interesting pod/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 29 15:04:41.639141 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:41.638947    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz" podUID="f19688df-ab8e-4cc4-a292-07386c52b614" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 29 15:04:42.642525 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:42.642496    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz"
Jul 29 15:04:42.642913 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:42.642862    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz"
Jul 29 15:04:42.643600 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:42.643581    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz"
Jul 29 15:04:52.714594 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:52.714556    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz"]
Jul 29 15:04:52.715018 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:52.714798    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz" podUID="f19688df-ab8e-4cc4-a292-07386c52b614" containerName="istio-proxy" containerID="cri-o://fd4d5a8655f2d3511af43ceef15d3ce6e1833c1181b8ccf21fba61d85baed51f" gracePeriod=30
Jul 29 15:04:55.418343 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:55.418312    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:04:57.645212 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:57.645177    2578 patch_prober.go:28] interesting pod/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 15:04:57.645612 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:57.645260    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz" podUID="f19688df-ab8e-4cc4-a292-07386c52b614" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 15:04:57.971090 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:57.971064    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz"
Jul 29 15:04:58.073401 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:58.073360    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f19688df-ab8e-4cc4-a292-07386c52b614-istio-envoy\") pod \"f19688df-ab8e-4cc4-a292-07386c52b614\" (UID: \"f19688df-ab8e-4cc4-a292-07386c52b614\") "
Jul 29 15:04:58.073604 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:58.073412    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f19688df-ab8e-4cc4-a292-07386c52b614-credential-socket\") pod \"f19688df-ab8e-4cc4-a292-07386c52b614\" (UID: \"f19688df-ab8e-4cc4-a292-07386c52b614\") "
Jul 29 15:04:58.073604 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:58.073440    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f19688df-ab8e-4cc4-a292-07386c52b614-workload-certs\") pod \"f19688df-ab8e-4cc4-a292-07386c52b614\" (UID: \"f19688df-ab8e-4cc4-a292-07386c52b614\") "
Jul 29 15:04:58.073604 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:58.073471    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f19688df-ab8e-4cc4-a292-07386c52b614-istio-data\") pod \"f19688df-ab8e-4cc4-a292-07386c52b614\" (UID: \"f19688df-ab8e-4cc4-a292-07386c52b614\") "
Jul 29 15:04:58.073604 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:58.073506    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f19688df-ab8e-4cc4-a292-07386c52b614-workload-socket\") pod \"f19688df-ab8e-4cc4-a292-07386c52b614\" (UID: \"f19688df-ab8e-4cc4-a292-07386c52b614\") "
Jul 29 15:04:58.073604 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:58.073564    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khhxf\" (UniqueName: \"kubernetes.io/projected/f19688df-ab8e-4cc4-a292-07386c52b614-kube-api-access-khhxf\") pod \"f19688df-ab8e-4cc4-a292-07386c52b614\" (UID: \"f19688df-ab8e-4cc4-a292-07386c52b614\") "
Jul 29 15:04:58.073604 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:58.073607    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f19688df-ab8e-4cc4-a292-07386c52b614-istiod-ca-cert\") pod \"f19688df-ab8e-4cc4-a292-07386c52b614\" (UID: \"f19688df-ab8e-4cc4-a292-07386c52b614\") "
Jul 29 15:04:58.073931 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:58.073680    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f19688df-ab8e-4cc4-a292-07386c52b614-istio-podinfo\") pod \"f19688df-ab8e-4cc4-a292-07386c52b614\" (UID: \"f19688df-ab8e-4cc4-a292-07386c52b614\") "
Jul 29 15:04:58.073931 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:58.073706    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f19688df-ab8e-4cc4-a292-07386c52b614-istio-token\") pod \"f19688df-ab8e-4cc4-a292-07386c52b614\" (UID: \"f19688df-ab8e-4cc4-a292-07386c52b614\") "
Jul 29 15:04:58.073931 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:58.073759    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f19688df-ab8e-4cc4-a292-07386c52b614-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f19688df-ab8e-4cc4-a292-07386c52b614" (UID: "f19688df-ab8e-4cc4-a292-07386c52b614"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:04:58.074088 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:58.073968    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f19688df-ab8e-4cc4-a292-07386c52b614-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f19688df-ab8e-4cc4-a292-07386c52b614" (UID: "f19688df-ab8e-4cc4-a292-07386c52b614"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:04:58.074088 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:58.073997    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f19688df-ab8e-4cc4-a292-07386c52b614-workload-certs\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:04:58.074088 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:58.074056    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f19688df-ab8e-4cc4-a292-07386c52b614-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f19688df-ab8e-4cc4-a292-07386c52b614" (UID: "f19688df-ab8e-4cc4-a292-07386c52b614"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 15:04:58.074230 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:58.074126    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f19688df-ab8e-4cc4-a292-07386c52b614-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f19688df-ab8e-4cc4-a292-07386c52b614" (UID: "f19688df-ab8e-4cc4-a292-07386c52b614"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:04:58.074974 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:58.074941    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f19688df-ab8e-4cc4-a292-07386c52b614-istio-data" (OuterVolumeSpecName: "istio-data") pod "f19688df-ab8e-4cc4-a292-07386c52b614" (UID: "f19688df-ab8e-4cc4-a292-07386c52b614"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:04:58.075860 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:58.075822    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f19688df-ab8e-4cc4-a292-07386c52b614-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f19688df-ab8e-4cc4-a292-07386c52b614" (UID: "f19688df-ab8e-4cc4-a292-07386c52b614"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:04:58.076012 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:58.075987    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f19688df-ab8e-4cc4-a292-07386c52b614-istio-token" (OuterVolumeSpecName: "istio-token") pod "f19688df-ab8e-4cc4-a292-07386c52b614" (UID: "f19688df-ab8e-4cc4-a292-07386c52b614"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 15:04:58.076112 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:58.076005    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f19688df-ab8e-4cc4-a292-07386c52b614-kube-api-access-khhxf" (OuterVolumeSpecName: "kube-api-access-khhxf") pod "f19688df-ab8e-4cc4-a292-07386c52b614" (UID: "f19688df-ab8e-4cc4-a292-07386c52b614"). InnerVolumeSpecName "kube-api-access-khhxf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 15:04:58.076178 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:58.076159    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f19688df-ab8e-4cc4-a292-07386c52b614-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f19688df-ab8e-4cc4-a292-07386c52b614" (UID: "f19688df-ab8e-4cc4-a292-07386c52b614"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 15:04:58.081247 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:58.081208    2578 generic.go:356] "Generic (PLEG): container finished" podID="f19688df-ab8e-4cc4-a292-07386c52b614" containerID="fd4d5a8655f2d3511af43ceef15d3ce6e1833c1181b8ccf21fba61d85baed51f" exitCode=0
Jul 29 15:04:58.081367 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:58.081276    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz"
Jul 29 15:04:58.081367 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:58.081267    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz" event={"ID":"f19688df-ab8e-4cc4-a292-07386c52b614","Type":"ContainerDied","Data":"fd4d5a8655f2d3511af43ceef15d3ce6e1833c1181b8ccf21fba61d85baed51f"}
Jul 29 15:04:58.081461 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:58.081406    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz" event={"ID":"f19688df-ab8e-4cc4-a292-07386c52b614","Type":"ContainerDied","Data":"322184b24103a6f72db0d8ce7a1f53784d0605db101f903f2211ffcf9d2680b6"}
Jul 29 15:04:58.081461 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:58.081438    2578 scope.go:117] "RemoveContainer" containerID="fd4d5a8655f2d3511af43ceef15d3ce6e1833c1181b8ccf21fba61d85baed51f"
Jul 29 15:04:58.096661 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:58.096639    2578 scope.go:117] "RemoveContainer" containerID="d4da7c82e7de474ef9a827c7c9be07a9de199728c7eb6009cfd3d05d548ff5ff"
Jul 29 15:04:58.104428 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:58.104402    2578 scope.go:117] "RemoveContainer" containerID="fd4d5a8655f2d3511af43ceef15d3ce6e1833c1181b8ccf21fba61d85baed51f"
Jul 29 15:04:58.104709 ip-10-0-142-130 kubenswrapper[2578]: E0729 15:04:58.104692    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd4d5a8655f2d3511af43ceef15d3ce6e1833c1181b8ccf21fba61d85baed51f\": container with ID starting with fd4d5a8655f2d3511af43ceef15d3ce6e1833c1181b8ccf21fba61d85baed51f not found: ID does not exist" containerID="fd4d5a8655f2d3511af43ceef15d3ce6e1833c1181b8ccf21fba61d85baed51f"
Jul 29 15:04:58.104753 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:58.104717    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd4d5a8655f2d3511af43ceef15d3ce6e1833c1181b8ccf21fba61d85baed51f"} err="failed to get container status \"fd4d5a8655f2d3511af43ceef15d3ce6e1833c1181b8ccf21fba61d85baed51f\": rpc error: code = NotFound desc = could not find container \"fd4d5a8655f2d3511af43ceef15d3ce6e1833c1181b8ccf21fba61d85baed51f\": container with ID starting with fd4d5a8655f2d3511af43ceef15d3ce6e1833c1181b8ccf21fba61d85baed51f not found: ID does not exist"
Jul 29 15:04:58.104753 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:58.104735    2578 scope.go:117] "RemoveContainer" containerID="d4da7c82e7de474ef9a827c7c9be07a9de199728c7eb6009cfd3d05d548ff5ff"
Jul 29 15:04:58.104961 ip-10-0-142-130 kubenswrapper[2578]: E0729 15:04:58.104945    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4da7c82e7de474ef9a827c7c9be07a9de199728c7eb6009cfd3d05d548ff5ff\": container with ID starting with d4da7c82e7de474ef9a827c7c9be07a9de199728c7eb6009cfd3d05d548ff5ff not found: ID does not exist" containerID="d4da7c82e7de474ef9a827c7c9be07a9de199728c7eb6009cfd3d05d548ff5ff"
Jul 29 15:04:58.105002 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:58.104967    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4da7c82e7de474ef9a827c7c9be07a9de199728c7eb6009cfd3d05d548ff5ff"} err="failed to get container status \"d4da7c82e7de474ef9a827c7c9be07a9de199728c7eb6009cfd3d05d548ff5ff\": rpc error: code = NotFound desc = could not find container \"d4da7c82e7de474ef9a827c7c9be07a9de199728c7eb6009cfd3d05d548ff5ff\": container with ID starting with d4da7c82e7de474ef9a827c7c9be07a9de199728c7eb6009cfd3d05d548ff5ff not found: ID does not exist"
Jul 29 15:04:58.116779 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:58.116753    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz"]
Jul 29 15:04:58.123079 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:58.123058    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-43963a57-openshift-default-7cb5cddb64-7vgwz"]
Jul 29 15:04:58.174645 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:58.174613    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f19688df-ab8e-4cc4-a292-07386c52b614-istio-podinfo\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:04:58.174645 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:58.174640    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f19688df-ab8e-4cc4-a292-07386c52b614-istio-token\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:04:58.174645 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:58.174652    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f19688df-ab8e-4cc4-a292-07386c52b614-istio-envoy\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:04:58.174879 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:58.174662    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f19688df-ab8e-4cc4-a292-07386c52b614-credential-socket\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:04:58.174879 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:58.174670    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f19688df-ab8e-4cc4-a292-07386c52b614-istio-data\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:04:58.174879 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:58.174681    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f19688df-ab8e-4cc4-a292-07386c52b614-workload-socket\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:04:58.174879 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:58.174690    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khhxf\" (UniqueName: \"kubernetes.io/projected/f19688df-ab8e-4cc4-a292-07386c52b614-kube-api-access-khhxf\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:04:58.174879 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:58.174699    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f19688df-ab8e-4cc4-a292-07386c52b614-istiod-ca-cert\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:04:58.278277 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:04:58.278232    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f19688df-ab8e-4cc4-a292-07386c52b614" path="/var/lib/kubelet/pods/f19688df-ab8e-4cc4-a292-07386c52b614/volumes"
Jul 29 15:05:08.805115 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:05:08.805080    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:05:34.797738 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:05:34.797699    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:06:57.216382 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:06:57.216295    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:07:08.907415 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:07:08.907367    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:07:19.006689 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:07:19.006647    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:07:29.910120 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:07:29.910085    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:08:10.715066 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:08:10.715022    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:08:43.744437 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:08:43.744403    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:09:42.114206 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:42.114168    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-a385d8ab/e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj"]
Jul 29 15:09:42.116469 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:42.114731    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f19688df-ab8e-4cc4-a292-07386c52b614" containerName="istio-proxy"
Jul 29 15:09:42.116469 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:42.114751    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f19688df-ab8e-4cc4-a292-07386c52b614" containerName="istio-proxy"
Jul 29 15:09:42.116469 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:42.114774    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6434ab8-44ff-451e-80af-4063f087a6dd" containerName="istio-proxy"
Jul 29 15:09:42.116469 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:42.114783    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6434ab8-44ff-451e-80af-4063f087a6dd" containerName="istio-proxy"
Jul 29 15:09:42.116469 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:42.114802    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f19688df-ab8e-4cc4-a292-07386c52b614" containerName="istio-proxy"
Jul 29 15:09:42.116469 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:42.114812    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f19688df-ab8e-4cc4-a292-07386c52b614" containerName="istio-proxy"
Jul 29 15:09:42.116469 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:42.114824    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6434ab8-44ff-451e-80af-4063f087a6dd" containerName="istio-proxy"
Jul 29 15:09:42.116469 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:42.114833    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6434ab8-44ff-451e-80af-4063f087a6dd" containerName="istio-proxy"
Jul 29 15:09:42.116469 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:42.114955    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6434ab8-44ff-451e-80af-4063f087a6dd" containerName="istio-proxy"
Jul 29 15:09:42.116469 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:42.114971    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f19688df-ab8e-4cc4-a292-07386c52b614" containerName="istio-proxy"
Jul 29 15:09:42.116469 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:42.114985    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f19688df-ab8e-4cc4-a292-07386c52b614" containerName="istio-proxy"
Jul 29 15:09:42.118011 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:42.117989    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a385d8ab/e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj"
Jul 29 15:09:42.122043 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:42.122024    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-a385d8ab\"/\"openshift-service-ca.crt\""
Jul 29 15:09:42.122189 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:42.122065    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-a385d8ab\"/\"e2e-lifecycle-model-a385d8ab-kserve-self-signed-certs\""
Jul 29 15:09:42.122341 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:42.122072    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-a385d8ab\"/\"kube-root-ca.crt\""
Jul 29 15:09:42.122428 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:42.122146    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-a385d8ab\"/\"default-dockercfg-jzxrr\""
Jul 29 15:09:42.127790 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:42.127766    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-a385d8ab/e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj"]
Jul 29 15:09:42.205601 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:42.205574    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0397fed-a483-4d6e-be55-74648c10369a-tls-certs\") pod \"e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj\" (UID: \"c0397fed-a483-4d6e-be55-74648c10369a\") " pod="ai-tenant-e2e-mt-a385d8ab/e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj"
Jul 29 15:09:42.205731 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:42.205626    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0397fed-a483-4d6e-be55-74648c10369a-dshm\") pod \"e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj\" (UID: \"c0397fed-a483-4d6e-be55-74648c10369a\") " pod="ai-tenant-e2e-mt-a385d8ab/e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj"
Jul 29 15:09:42.205731 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:42.205650    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kvpz\" (UniqueName: \"kubernetes.io/projected/c0397fed-a483-4d6e-be55-74648c10369a-kube-api-access-2kvpz\") pod \"e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj\" (UID: \"c0397fed-a483-4d6e-be55-74648c10369a\") " pod="ai-tenant-e2e-mt-a385d8ab/e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj"
Jul 29 15:09:42.205731 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:42.205695    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0397fed-a483-4d6e-be55-74648c10369a-model-cache\") pod \"e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj\" (UID: \"c0397fed-a483-4d6e-be55-74648c10369a\") " pod="ai-tenant-e2e-mt-a385d8ab/e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj"
Jul 29 15:09:42.205870 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:42.205764    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0397fed-a483-4d6e-be55-74648c10369a-home\") pod \"e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj\" (UID: \"c0397fed-a483-4d6e-be55-74648c10369a\") " pod="ai-tenant-e2e-mt-a385d8ab/e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj"
Jul 29 15:09:42.205870 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:42.205787    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0397fed-a483-4d6e-be55-74648c10369a-tmp-dir\") pod \"e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj\" (UID: \"c0397fed-a483-4d6e-be55-74648c10369a\") " pod="ai-tenant-e2e-mt-a385d8ab/e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj"
Jul 29 15:09:42.306615 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:42.306588    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0397fed-a483-4d6e-be55-74648c10369a-home\") pod \"e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj\" (UID: \"c0397fed-a483-4d6e-be55-74648c10369a\") " pod="ai-tenant-e2e-mt-a385d8ab/e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj"
Jul 29 15:09:42.306762 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:42.306621    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0397fed-a483-4d6e-be55-74648c10369a-tmp-dir\") pod \"e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj\" (UID: \"c0397fed-a483-4d6e-be55-74648c10369a\") " pod="ai-tenant-e2e-mt-a385d8ab/e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj"
Jul 29 15:09:42.306762 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:42.306663    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0397fed-a483-4d6e-be55-74648c10369a-tls-certs\") pod \"e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj\" (UID: \"c0397fed-a483-4d6e-be55-74648c10369a\") " pod="ai-tenant-e2e-mt-a385d8ab/e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj"
Jul 29 15:09:42.306762 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:42.306711    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0397fed-a483-4d6e-be55-74648c10369a-dshm\") pod \"e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj\" (UID: \"c0397fed-a483-4d6e-be55-74648c10369a\") " pod="ai-tenant-e2e-mt-a385d8ab/e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj"
Jul 29 15:09:42.306762 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:42.306736    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kvpz\" (UniqueName: \"kubernetes.io/projected/c0397fed-a483-4d6e-be55-74648c10369a-kube-api-access-2kvpz\") pod \"e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj\" (UID: \"c0397fed-a483-4d6e-be55-74648c10369a\") " pod="ai-tenant-e2e-mt-a385d8ab/e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj"
Jul 29 15:09:42.306762 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:42.306762    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0397fed-a483-4d6e-be55-74648c10369a-model-cache\") pod \"e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj\" (UID: \"c0397fed-a483-4d6e-be55-74648c10369a\") " pod="ai-tenant-e2e-mt-a385d8ab/e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj"
Jul 29 15:09:42.307064 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:42.307044    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0397fed-a483-4d6e-be55-74648c10369a-home\") pod \"e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj\" (UID: \"c0397fed-a483-4d6e-be55-74648c10369a\") " pod="ai-tenant-e2e-mt-a385d8ab/e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj"
Jul 29 15:09:42.307120 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:42.307065    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0397fed-a483-4d6e-be55-74648c10369a-tmp-dir\") pod \"e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj\" (UID: \"c0397fed-a483-4d6e-be55-74648c10369a\") " pod="ai-tenant-e2e-mt-a385d8ab/e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj"
Jul 29 15:09:42.307120 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:42.307095    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0397fed-a483-4d6e-be55-74648c10369a-model-cache\") pod \"e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj\" (UID: \"c0397fed-a483-4d6e-be55-74648c10369a\") " pod="ai-tenant-e2e-mt-a385d8ab/e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj"
Jul 29 15:09:42.308922 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:42.308890    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0397fed-a483-4d6e-be55-74648c10369a-dshm\") pod \"e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj\" (UID: \"c0397fed-a483-4d6e-be55-74648c10369a\") " pod="ai-tenant-e2e-mt-a385d8ab/e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj"
Jul 29 15:09:42.309120 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:42.309099    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0397fed-a483-4d6e-be55-74648c10369a-tls-certs\") pod \"e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj\" (UID: \"c0397fed-a483-4d6e-be55-74648c10369a\") " pod="ai-tenant-e2e-mt-a385d8ab/e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj"
Jul 29 15:09:42.316076 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:42.316050    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kvpz\" (UniqueName: \"kubernetes.io/projected/c0397fed-a483-4d6e-be55-74648c10369a-kube-api-access-2kvpz\") pod \"e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj\" (UID: \"c0397fed-a483-4d6e-be55-74648c10369a\") " pod="ai-tenant-e2e-mt-a385d8ab/e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj"
Jul 29 15:09:42.429365 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:42.429294    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a385d8ab/e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj"
Jul 29 15:09:42.554799 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:42.554771    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-a385d8ab/e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj"]
Jul 29 15:09:42.556977 ip-10-0-142-130 kubenswrapper[2578]: W0729 15:09:42.556954    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc0397fed_a483_4d6e_be55_74648c10369a.slice/crio-76d16d088cd7ac48b9108c96c3f357d5231403a1ffffc7c5bb6d9dc67894848c WatchSource:0}: Error finding container 76d16d088cd7ac48b9108c96c3f357d5231403a1ffffc7c5bb6d9dc67894848c: Status 404 returned error can't find the container with id 76d16d088cd7ac48b9108c96c3f357d5231403a1ffffc7c5bb6d9dc67894848c
Jul 29 15:09:43.391931 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:43.391895    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a385d8ab/e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj" event={"ID":"c0397fed-a483-4d6e-be55-74648c10369a","Type":"ContainerStarted","Data":"3e9243ef8c0db33dc0daa193ef3f08fb78c89563b2c4758c905809a23c7a5422"}
Jul 29 15:09:43.391931 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:43.391933    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a385d8ab/e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj" event={"ID":"c0397fed-a483-4d6e-be55-74648c10369a","Type":"ContainerStarted","Data":"76d16d088cd7ac48b9108c96c3f357d5231403a1ffffc7c5bb6d9dc67894848c"}
Jul 29 15:09:43.409973 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:43.409923    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-a385d8ab/e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj" podStartSLOduration=1.409904864 podStartE2EDuration="1.409904864s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:09:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:09:43.408793979 +0000 UTC m=+2055.711260587" watchObservedRunningTime="2026-07-29 15:09:43.409904864 +0000 UTC m=+2055.712371472"
Jul 29 15:09:45.501792 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:45.501751    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:09:52.429481 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:52.429394    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-a385d8ab/e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj"
Jul 29 15:09:52.429481 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:52.429447    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-a385d8ab/e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj"
Jul 29 15:09:52.441836 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:52.441797    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-a385d8ab/e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj"
Jul 29 15:09:52.452953 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:52.452933    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-a385d8ab/e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj"
Jul 29 15:09:58.181323 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:09:58.181266    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:10:16.307252 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:10:16.307212    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:10:25.906157 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:10:25.906118    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:10:26.556835 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:10:26.556792    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-a385d8ab/e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj"]
Jul 29 15:10:41.576209 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:10:41.576162    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-a385d8ab/e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj" podUID="c0397fed-a483-4d6e-be55-74648c10369a" containerName="main" containerID="cri-o://3e9243ef8c0db33dc0daa193ef3f08fb78c89563b2c4758c905809a23c7a5422" gracePeriod=45
Jul 29 15:10:41.832994 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:10:41.832931    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a385d8ab/e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj"
Jul 29 15:10:41.937627 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:10:41.937592    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0397fed-a483-4d6e-be55-74648c10369a-model-cache\") pod \"c0397fed-a483-4d6e-be55-74648c10369a\" (UID: \"c0397fed-a483-4d6e-be55-74648c10369a\") "
Jul 29 15:10:41.937840 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:10:41.937673    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0397fed-a483-4d6e-be55-74648c10369a-home\") pod \"c0397fed-a483-4d6e-be55-74648c10369a\" (UID: \"c0397fed-a483-4d6e-be55-74648c10369a\") "
Jul 29 15:10:41.937840 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:10:41.937705    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0397fed-a483-4d6e-be55-74648c10369a-dshm\") pod \"c0397fed-a483-4d6e-be55-74648c10369a\" (UID: \"c0397fed-a483-4d6e-be55-74648c10369a\") "
Jul 29 15:10:41.937840 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:10:41.937736    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kvpz\" (UniqueName: \"kubernetes.io/projected/c0397fed-a483-4d6e-be55-74648c10369a-kube-api-access-2kvpz\") pod \"c0397fed-a483-4d6e-be55-74648c10369a\" (UID: \"c0397fed-a483-4d6e-be55-74648c10369a\") "
Jul 29 15:10:41.937840 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:10:41.937770    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0397fed-a483-4d6e-be55-74648c10369a-tmp-dir\") pod \"c0397fed-a483-4d6e-be55-74648c10369a\" (UID: \"c0397fed-a483-4d6e-be55-74648c10369a\") "
Jul 29 15:10:41.937840 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:10:41.937830    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0397fed-a483-4d6e-be55-74648c10369a-tls-certs\") pod \"c0397fed-a483-4d6e-be55-74648c10369a\" (UID: \"c0397fed-a483-4d6e-be55-74648c10369a\") "
Jul 29 15:10:41.938104 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:10:41.937934    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0397fed-a483-4d6e-be55-74648c10369a-model-cache" (OuterVolumeSpecName: "model-cache") pod "c0397fed-a483-4d6e-be55-74648c10369a" (UID: "c0397fed-a483-4d6e-be55-74648c10369a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:10:41.938104 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:10:41.937981    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0397fed-a483-4d6e-be55-74648c10369a-home" (OuterVolumeSpecName: "home") pod "c0397fed-a483-4d6e-be55-74648c10369a" (UID: "c0397fed-a483-4d6e-be55-74648c10369a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:10:41.938222 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:10:41.938186    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0397fed-a483-4d6e-be55-74648c10369a-model-cache\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:10:41.938222 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:10:41.938201    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0397fed-a483-4d6e-be55-74648c10369a-home\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:10:41.938393 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:10:41.938342    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0397fed-a483-4d6e-be55-74648c10369a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c0397fed-a483-4d6e-be55-74648c10369a" (UID: "c0397fed-a483-4d6e-be55-74648c10369a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:10:41.940131 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:10:41.940103    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0397fed-a483-4d6e-be55-74648c10369a-dshm" (OuterVolumeSpecName: "dshm") pod "c0397fed-a483-4d6e-be55-74648c10369a" (UID: "c0397fed-a483-4d6e-be55-74648c10369a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:10:41.940459 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:10:41.940432    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0397fed-a483-4d6e-be55-74648c10369a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c0397fed-a483-4d6e-be55-74648c10369a" (UID: "c0397fed-a483-4d6e-be55-74648c10369a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 15:10:41.940558 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:10:41.940480    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0397fed-a483-4d6e-be55-74648c10369a-kube-api-access-2kvpz" (OuterVolumeSpecName: "kube-api-access-2kvpz") pod "c0397fed-a483-4d6e-be55-74648c10369a" (UID: "c0397fed-a483-4d6e-be55-74648c10369a"). InnerVolumeSpecName "kube-api-access-2kvpz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 15:10:42.039641 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:10:42.039608    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0397fed-a483-4d6e-be55-74648c10369a-dshm\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:10:42.039641 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:10:42.039637    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kvpz\" (UniqueName: \"kubernetes.io/projected/c0397fed-a483-4d6e-be55-74648c10369a-kube-api-access-2kvpz\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:10:42.039641 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:10:42.039650    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0397fed-a483-4d6e-be55-74648c10369a-tmp-dir\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:10:42.039886 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:10:42.039660    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0397fed-a483-4d6e-be55-74648c10369a-tls-certs\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:10:42.663665 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:10:42.663576    2578 generic.go:356] "Generic (PLEG): container finished" podID="c0397fed-a483-4d6e-be55-74648c10369a" containerID="3e9243ef8c0db33dc0daa193ef3f08fb78c89563b2c4758c905809a23c7a5422" exitCode=0
Jul 29 15:10:42.663665 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:10:42.663622    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a385d8ab/e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj"
Jul 29 15:10:42.664130 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:10:42.663663    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a385d8ab/e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj" event={"ID":"c0397fed-a483-4d6e-be55-74648c10369a","Type":"ContainerDied","Data":"3e9243ef8c0db33dc0daa193ef3f08fb78c89563b2c4758c905809a23c7a5422"}
Jul 29 15:10:42.664130 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:10:42.663711    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a385d8ab/e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj" event={"ID":"c0397fed-a483-4d6e-be55-74648c10369a","Type":"ContainerDied","Data":"76d16d088cd7ac48b9108c96c3f357d5231403a1ffffc7c5bb6d9dc67894848c"}
Jul 29 15:10:42.664130 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:10:42.663736    2578 scope.go:117] "RemoveContainer" containerID="3e9243ef8c0db33dc0daa193ef3f08fb78c89563b2c4758c905809a23c7a5422"
Jul 29 15:10:42.672281 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:10:42.672258    2578 scope.go:117] "RemoveContainer" containerID="3e9243ef8c0db33dc0daa193ef3f08fb78c89563b2c4758c905809a23c7a5422"
Jul 29 15:10:42.672540 ip-10-0-142-130 kubenswrapper[2578]: E0729 15:10:42.672517    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e9243ef8c0db33dc0daa193ef3f08fb78c89563b2c4758c905809a23c7a5422\": container with ID starting with 3e9243ef8c0db33dc0daa193ef3f08fb78c89563b2c4758c905809a23c7a5422 not found: ID does not exist" containerID="3e9243ef8c0db33dc0daa193ef3f08fb78c89563b2c4758c905809a23c7a5422"
Jul 29 15:10:42.672594 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:10:42.672552    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e9243ef8c0db33dc0daa193ef3f08fb78c89563b2c4758c905809a23c7a5422"} err="failed to get container status \"3e9243ef8c0db33dc0daa193ef3f08fb78c89563b2c4758c905809a23c7a5422\": rpc error: code = NotFound desc = could not find container \"3e9243ef8c0db33dc0daa193ef3f08fb78c89563b2c4758c905809a23c7a5422\": container with ID starting with 3e9243ef8c0db33dc0daa193ef3f08fb78c89563b2c4758c905809a23c7a5422 not found: ID does not exist"
Jul 29 15:10:42.680564 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:10:42.680539    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-a385d8ab/e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj"]
Jul 29 15:10:42.686861 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:10:42.686839    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-a385d8ab/e2e-lifecycle-model-a385d8ab-kserve-64db89f6c5-ffncj"]
Jul 29 15:10:44.278052 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:10:44.278016    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0397fed-a483-4d6e-be55-74648c10369a" path="/var/lib/kubelet/pods/c0397fed-a483-4d6e-be55-74648c10369a/volumes"
Jul 29 15:11:19.711263 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:11:19.710427    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:11:29.210507 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:11:29.210469    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:12:21.011706 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:12:21.011669    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:12:51.904914 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:12:51.904831    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:13:15.214363 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:15.214332    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-5ef0d2/test-model-5ef0d2-kserve-5db89685b9-qrgr4"]
Jul 29 15:13:15.214864 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:15.214666    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0397fed-a483-4d6e-be55-74648c10369a" containerName="main"
Jul 29 15:13:15.214864 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:15.214676    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0397fed-a483-4d6e-be55-74648c10369a" containerName="main"
Jul 29 15:13:15.214864 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:15.214744    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6434ab8-44ff-451e-80af-4063f087a6dd" containerName="istio-proxy"
Jul 29 15:13:15.214864 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:15.214752    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0397fed-a483-4d6e-be55-74648c10369a" containerName="main"
Jul 29 15:13:15.217667 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:15.217651    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-5ef0d2/test-model-5ef0d2-kserve-5db89685b9-qrgr4"
Jul 29 15:13:15.220620 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:15.220596    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-5ef0d2\"/\"test-model-5ef0d2-kserve-self-signed-certs\""
Jul 29 15:13:15.221965 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:15.221945    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-5ef0d2\"/\"openshift-service-ca.crt\""
Jul 29 15:13:15.222110 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:15.222090    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-5ef0d2\"/\"default-dockercfg-tt428\""
Jul 29 15:13:15.222160 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:15.222139    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-5ef0d2\"/\"kube-root-ca.crt\""
Jul 29 15:13:15.229886 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:15.229863    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-5ef0d2/test-model-5ef0d2-kserve-5db89685b9-qrgr4"]
Jul 29 15:13:15.315939 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:15.315916    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26e3bcf3-20c2-4c31-8417-b3278658b4e3-home\") pod \"test-model-5ef0d2-kserve-5db89685b9-qrgr4\" (UID: \"26e3bcf3-20c2-4c31-8417-b3278658b4e3\") " pod="ai-tenant-e2e-inf-a-5ef0d2/test-model-5ef0d2-kserve-5db89685b9-qrgr4"
Jul 29 15:13:15.316052 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:15.315959    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26e3bcf3-20c2-4c31-8417-b3278658b4e3-tls-certs\") pod \"test-model-5ef0d2-kserve-5db89685b9-qrgr4\" (UID: \"26e3bcf3-20c2-4c31-8417-b3278658b4e3\") " pod="ai-tenant-e2e-inf-a-5ef0d2/test-model-5ef0d2-kserve-5db89685b9-qrgr4"
Jul 29 15:13:15.316052 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:15.315986    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm22p\" (UniqueName: \"kubernetes.io/projected/26e3bcf3-20c2-4c31-8417-b3278658b4e3-kube-api-access-qm22p\") pod \"test-model-5ef0d2-kserve-5db89685b9-qrgr4\" (UID: \"26e3bcf3-20c2-4c31-8417-b3278658b4e3\") " pod="ai-tenant-e2e-inf-a-5ef0d2/test-model-5ef0d2-kserve-5db89685b9-qrgr4"
Jul 29 15:13:15.316136 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:15.316064    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26e3bcf3-20c2-4c31-8417-b3278658b4e3-model-cache\") pod \"test-model-5ef0d2-kserve-5db89685b9-qrgr4\" (UID: \"26e3bcf3-20c2-4c31-8417-b3278658b4e3\") " pod="ai-tenant-e2e-inf-a-5ef0d2/test-model-5ef0d2-kserve-5db89685b9-qrgr4"
Jul 29 15:13:15.316136 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:15.316093    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26e3bcf3-20c2-4c31-8417-b3278658b4e3-dshm\") pod \"test-model-5ef0d2-kserve-5db89685b9-qrgr4\" (UID: \"26e3bcf3-20c2-4c31-8417-b3278658b4e3\") " pod="ai-tenant-e2e-inf-a-5ef0d2/test-model-5ef0d2-kserve-5db89685b9-qrgr4"
Jul 29 15:13:15.316136 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:15.316110    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26e3bcf3-20c2-4c31-8417-b3278658b4e3-tmp-dir\") pod \"test-model-5ef0d2-kserve-5db89685b9-qrgr4\" (UID: \"26e3bcf3-20c2-4c31-8417-b3278658b4e3\") " pod="ai-tenant-e2e-inf-a-5ef0d2/test-model-5ef0d2-kserve-5db89685b9-qrgr4"
Jul 29 15:13:15.417042 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:15.417007    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26e3bcf3-20c2-4c31-8417-b3278658b4e3-model-cache\") pod \"test-model-5ef0d2-kserve-5db89685b9-qrgr4\" (UID: \"26e3bcf3-20c2-4c31-8417-b3278658b4e3\") " pod="ai-tenant-e2e-inf-a-5ef0d2/test-model-5ef0d2-kserve-5db89685b9-qrgr4"
Jul 29 15:13:15.417042 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:15.417044    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26e3bcf3-20c2-4c31-8417-b3278658b4e3-dshm\") pod \"test-model-5ef0d2-kserve-5db89685b9-qrgr4\" (UID: \"26e3bcf3-20c2-4c31-8417-b3278658b4e3\") " pod="ai-tenant-e2e-inf-a-5ef0d2/test-model-5ef0d2-kserve-5db89685b9-qrgr4"
Jul 29 15:13:15.417255 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:15.417069    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26e3bcf3-20c2-4c31-8417-b3278658b4e3-tmp-dir\") pod \"test-model-5ef0d2-kserve-5db89685b9-qrgr4\" (UID: \"26e3bcf3-20c2-4c31-8417-b3278658b4e3\") " pod="ai-tenant-e2e-inf-a-5ef0d2/test-model-5ef0d2-kserve-5db89685b9-qrgr4"
Jul 29 15:13:15.417255 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:15.417154    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26e3bcf3-20c2-4c31-8417-b3278658b4e3-home\") pod \"test-model-5ef0d2-kserve-5db89685b9-qrgr4\" (UID: \"26e3bcf3-20c2-4c31-8417-b3278658b4e3\") " pod="ai-tenant-e2e-inf-a-5ef0d2/test-model-5ef0d2-kserve-5db89685b9-qrgr4"
Jul 29 15:13:15.417255 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:15.417201    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26e3bcf3-20c2-4c31-8417-b3278658b4e3-tls-certs\") pod \"test-model-5ef0d2-kserve-5db89685b9-qrgr4\" (UID: \"26e3bcf3-20c2-4c31-8417-b3278658b4e3\") " pod="ai-tenant-e2e-inf-a-5ef0d2/test-model-5ef0d2-kserve-5db89685b9-qrgr4"
Jul 29 15:13:15.417255 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:15.417227    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm22p\" (UniqueName: \"kubernetes.io/projected/26e3bcf3-20c2-4c31-8417-b3278658b4e3-kube-api-access-qm22p\") pod \"test-model-5ef0d2-kserve-5db89685b9-qrgr4\" (UID: \"26e3bcf3-20c2-4c31-8417-b3278658b4e3\") " pod="ai-tenant-e2e-inf-a-5ef0d2/test-model-5ef0d2-kserve-5db89685b9-qrgr4"
Jul 29 15:13:15.417532 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:15.417512    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26e3bcf3-20c2-4c31-8417-b3278658b4e3-model-cache\") pod \"test-model-5ef0d2-kserve-5db89685b9-qrgr4\" (UID: \"26e3bcf3-20c2-4c31-8417-b3278658b4e3\") " pod="ai-tenant-e2e-inf-a-5ef0d2/test-model-5ef0d2-kserve-5db89685b9-qrgr4"
Jul 29 15:13:15.417852 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:15.417833    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26e3bcf3-20c2-4c31-8417-b3278658b4e3-home\") pod \"test-model-5ef0d2-kserve-5db89685b9-qrgr4\" (UID: \"26e3bcf3-20c2-4c31-8417-b3278658b4e3\") " pod="ai-tenant-e2e-inf-a-5ef0d2/test-model-5ef0d2-kserve-5db89685b9-qrgr4"
Jul 29 15:13:15.417933 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:15.417882    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26e3bcf3-20c2-4c31-8417-b3278658b4e3-tmp-dir\") pod \"test-model-5ef0d2-kserve-5db89685b9-qrgr4\" (UID: \"26e3bcf3-20c2-4c31-8417-b3278658b4e3\") " pod="ai-tenant-e2e-inf-a-5ef0d2/test-model-5ef0d2-kserve-5db89685b9-qrgr4"
Jul 29 15:13:15.419152 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:15.419134    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26e3bcf3-20c2-4c31-8417-b3278658b4e3-dshm\") pod \"test-model-5ef0d2-kserve-5db89685b9-qrgr4\" (UID: \"26e3bcf3-20c2-4c31-8417-b3278658b4e3\") " pod="ai-tenant-e2e-inf-a-5ef0d2/test-model-5ef0d2-kserve-5db89685b9-qrgr4"
Jul 29 15:13:15.419619 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:15.419600    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26e3bcf3-20c2-4c31-8417-b3278658b4e3-tls-certs\") pod \"test-model-5ef0d2-kserve-5db89685b9-qrgr4\" (UID: \"26e3bcf3-20c2-4c31-8417-b3278658b4e3\") " pod="ai-tenant-e2e-inf-a-5ef0d2/test-model-5ef0d2-kserve-5db89685b9-qrgr4"
Jul 29 15:13:15.424937 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:15.424916    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm22p\" (UniqueName: \"kubernetes.io/projected/26e3bcf3-20c2-4c31-8417-b3278658b4e3-kube-api-access-qm22p\") pod \"test-model-5ef0d2-kserve-5db89685b9-qrgr4\" (UID: \"26e3bcf3-20c2-4c31-8417-b3278658b4e3\") " pod="ai-tenant-e2e-inf-a-5ef0d2/test-model-5ef0d2-kserve-5db89685b9-qrgr4"
Jul 29 15:13:15.526762 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:15.526731    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-5ef0d2/test-model-5ef0d2-kserve-5db89685b9-qrgr4"
Jul 29 15:13:15.657947 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:15.657919    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-5ef0d2/test-model-5ef0d2-kserve-5db89685b9-qrgr4"]
Jul 29 15:13:15.660460 ip-10-0-142-130 kubenswrapper[2578]: W0729 15:13:15.660428    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26e3bcf3_20c2_4c31_8417_b3278658b4e3.slice/crio-d39df7594f6d227659c938e31006b64419dcff8c684cd896a91ae3af34a59837 WatchSource:0}: Error finding container d39df7594f6d227659c938e31006b64419dcff8c684cd896a91ae3af34a59837: Status 404 returned error can't find the container with id d39df7594f6d227659c938e31006b64419dcff8c684cd896a91ae3af34a59837
Jul 29 15:13:16.363121 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:16.363089    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-5ef0d2/test-model-5ef0d2-kserve-5db89685b9-qrgr4" event={"ID":"26e3bcf3-20c2-4c31-8417-b3278658b4e3","Type":"ContainerStarted","Data":"3a41e1894c383c9a0299a1e67d5731b629d485c6911d906c77eff1abc684b690"}
Jul 29 15:13:16.363121 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:16.363127    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-5ef0d2/test-model-5ef0d2-kserve-5db89685b9-qrgr4" event={"ID":"26e3bcf3-20c2-4c31-8417-b3278658b4e3","Type":"ContainerStarted","Data":"d39df7594f6d227659c938e31006b64419dcff8c684cd896a91ae3af34a59837"}
Jul 29 15:13:16.385278 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:16.385215    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-5ef0d2/test-model-5ef0d2-kserve-5db89685b9-qrgr4" podStartSLOduration=1.38520025 podStartE2EDuration="1.38520025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:13:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:13:16.384259498 +0000 UTC m=+2268.686726105" watchObservedRunningTime="2026-07-29 15:13:16.38520025 +0000 UTC m=+2268.687666858"
Jul 29 15:13:18.510872 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:18.510836    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:13:25.527311 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:25.527277    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-5ef0d2/test-model-5ef0d2-kserve-5db89685b9-qrgr4"
Jul 29 15:13:25.527802 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:25.527490    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-5ef0d2/test-model-5ef0d2-kserve-5db89685b9-qrgr4"
Jul 29 15:13:25.539401 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:25.539375    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-5ef0d2/test-model-5ef0d2-kserve-5db89685b9-qrgr4"
Jul 29 15:13:26.421391 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:26.421356    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-5ef0d2/test-model-5ef0d2-kserve-5db89685b9-qrgr4"
Jul 29 15:13:30.604757 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:30.604724    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:13:56.858837 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:56.858803    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-80fc9d/test-model-80fc9d-kserve-8b59c458f-zm2bj"]
Jul 29 15:13:56.862397 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:56.862377    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-80fc9d/test-model-80fc9d-kserve-8b59c458f-zm2bj"
Jul 29 15:13:56.866194 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:56.866171    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-80fc9d\"/\"test-model-80fc9d-kserve-self-signed-certs\""
Jul 29 15:13:56.867249 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:56.867214    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-80fc9d\"/\"kube-root-ca.crt\""
Jul 29 15:13:56.867572 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:56.867555    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-80fc9d\"/\"default-dockercfg-8hdjc\""
Jul 29 15:13:56.867623 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:56.867573    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-80fc9d\"/\"openshift-service-ca.crt\""
Jul 29 15:13:56.877611 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:56.877586    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-80fc9d/test-model-80fc9d-kserve-8b59c458f-zm2bj"]
Jul 29 15:13:56.962301 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:56.962272    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2a74c6f-262e-4110-8b88-f290656cc020-home\") pod \"test-model-80fc9d-kserve-8b59c458f-zm2bj\" (UID: \"b2a74c6f-262e-4110-8b88-f290656cc020\") " pod="ai-tenant-e2e-inf-b-80fc9d/test-model-80fc9d-kserve-8b59c458f-zm2bj"
Jul 29 15:13:56.962470 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:56.962314    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2a74c6f-262e-4110-8b88-f290656cc020-dshm\") pod \"test-model-80fc9d-kserve-8b59c458f-zm2bj\" (UID: \"b2a74c6f-262e-4110-8b88-f290656cc020\") " pod="ai-tenant-e2e-inf-b-80fc9d/test-model-80fc9d-kserve-8b59c458f-zm2bj"
Jul 29 15:13:56.962470 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:56.962372    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l92w\" (UniqueName: \"kubernetes.io/projected/b2a74c6f-262e-4110-8b88-f290656cc020-kube-api-access-8l92w\") pod \"test-model-80fc9d-kserve-8b59c458f-zm2bj\" (UID: \"b2a74c6f-262e-4110-8b88-f290656cc020\") " pod="ai-tenant-e2e-inf-b-80fc9d/test-model-80fc9d-kserve-8b59c458f-zm2bj"
Jul 29 15:13:56.962470 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:56.962410    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2a74c6f-262e-4110-8b88-f290656cc020-tls-certs\") pod \"test-model-80fc9d-kserve-8b59c458f-zm2bj\" (UID: \"b2a74c6f-262e-4110-8b88-f290656cc020\") " pod="ai-tenant-e2e-inf-b-80fc9d/test-model-80fc9d-kserve-8b59c458f-zm2bj"
Jul 29 15:13:56.962470 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:56.962428    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2a74c6f-262e-4110-8b88-f290656cc020-model-cache\") pod \"test-model-80fc9d-kserve-8b59c458f-zm2bj\" (UID: \"b2a74c6f-262e-4110-8b88-f290656cc020\") " pod="ai-tenant-e2e-inf-b-80fc9d/test-model-80fc9d-kserve-8b59c458f-zm2bj"
Jul 29 15:13:56.962470 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:56.962443    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2a74c6f-262e-4110-8b88-f290656cc020-tmp-dir\") pod \"test-model-80fc9d-kserve-8b59c458f-zm2bj\" (UID: \"b2a74c6f-262e-4110-8b88-f290656cc020\") " pod="ai-tenant-e2e-inf-b-80fc9d/test-model-80fc9d-kserve-8b59c458f-zm2bj"
Jul 29 15:13:57.063684 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:57.063648    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8l92w\" (UniqueName: \"kubernetes.io/projected/b2a74c6f-262e-4110-8b88-f290656cc020-kube-api-access-8l92w\") pod \"test-model-80fc9d-kserve-8b59c458f-zm2bj\" (UID: \"b2a74c6f-262e-4110-8b88-f290656cc020\") " pod="ai-tenant-e2e-inf-b-80fc9d/test-model-80fc9d-kserve-8b59c458f-zm2bj"
Jul 29 15:13:57.063897 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:57.063694    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2a74c6f-262e-4110-8b88-f290656cc020-tls-certs\") pod \"test-model-80fc9d-kserve-8b59c458f-zm2bj\" (UID: \"b2a74c6f-262e-4110-8b88-f290656cc020\") " pod="ai-tenant-e2e-inf-b-80fc9d/test-model-80fc9d-kserve-8b59c458f-zm2bj"
Jul 29 15:13:57.063897 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:57.063715    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2a74c6f-262e-4110-8b88-f290656cc020-model-cache\") pod \"test-model-80fc9d-kserve-8b59c458f-zm2bj\" (UID: \"b2a74c6f-262e-4110-8b88-f290656cc020\") " pod="ai-tenant-e2e-inf-b-80fc9d/test-model-80fc9d-kserve-8b59c458f-zm2bj"
Jul 29 15:13:57.063897 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:57.063731    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2a74c6f-262e-4110-8b88-f290656cc020-tmp-dir\") pod \"test-model-80fc9d-kserve-8b59c458f-zm2bj\" (UID: \"b2a74c6f-262e-4110-8b88-f290656cc020\") " pod="ai-tenant-e2e-inf-b-80fc9d/test-model-80fc9d-kserve-8b59c458f-zm2bj"
Jul 29 15:13:57.063897 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:57.063771    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2a74c6f-262e-4110-8b88-f290656cc020-home\") pod \"test-model-80fc9d-kserve-8b59c458f-zm2bj\" (UID: \"b2a74c6f-262e-4110-8b88-f290656cc020\") " pod="ai-tenant-e2e-inf-b-80fc9d/test-model-80fc9d-kserve-8b59c458f-zm2bj"
Jul 29 15:13:57.063897 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:57.063797    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2a74c6f-262e-4110-8b88-f290656cc020-dshm\") pod \"test-model-80fc9d-kserve-8b59c458f-zm2bj\" (UID: \"b2a74c6f-262e-4110-8b88-f290656cc020\") " pod="ai-tenant-e2e-inf-b-80fc9d/test-model-80fc9d-kserve-8b59c458f-zm2bj"
Jul 29 15:13:57.064174 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:57.064117    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2a74c6f-262e-4110-8b88-f290656cc020-model-cache\") pod \"test-model-80fc9d-kserve-8b59c458f-zm2bj\" (UID: \"b2a74c6f-262e-4110-8b88-f290656cc020\") " pod="ai-tenant-e2e-inf-b-80fc9d/test-model-80fc9d-kserve-8b59c458f-zm2bj"
Jul 29 15:13:57.064217 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:57.064203    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2a74c6f-262e-4110-8b88-f290656cc020-tmp-dir\") pod \"test-model-80fc9d-kserve-8b59c458f-zm2bj\" (UID: \"b2a74c6f-262e-4110-8b88-f290656cc020\") " pod="ai-tenant-e2e-inf-b-80fc9d/test-model-80fc9d-kserve-8b59c458f-zm2bj"
Jul 29 15:13:57.064312 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:57.064293    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2a74c6f-262e-4110-8b88-f290656cc020-home\") pod \"test-model-80fc9d-kserve-8b59c458f-zm2bj\" (UID: \"b2a74c6f-262e-4110-8b88-f290656cc020\") " pod="ai-tenant-e2e-inf-b-80fc9d/test-model-80fc9d-kserve-8b59c458f-zm2bj"
Jul 29 15:13:57.065978 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:57.065957    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2a74c6f-262e-4110-8b88-f290656cc020-dshm\") pod \"test-model-80fc9d-kserve-8b59c458f-zm2bj\" (UID: \"b2a74c6f-262e-4110-8b88-f290656cc020\") " pod="ai-tenant-e2e-inf-b-80fc9d/test-model-80fc9d-kserve-8b59c458f-zm2bj"
Jul 29 15:13:57.066404 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:57.066384    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2a74c6f-262e-4110-8b88-f290656cc020-tls-certs\") pod \"test-model-80fc9d-kserve-8b59c458f-zm2bj\" (UID: \"b2a74c6f-262e-4110-8b88-f290656cc020\") " pod="ai-tenant-e2e-inf-b-80fc9d/test-model-80fc9d-kserve-8b59c458f-zm2bj"
Jul 29 15:13:57.074377 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:57.074355    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l92w\" (UniqueName: \"kubernetes.io/projected/b2a74c6f-262e-4110-8b88-f290656cc020-kube-api-access-8l92w\") pod \"test-model-80fc9d-kserve-8b59c458f-zm2bj\" (UID: \"b2a74c6f-262e-4110-8b88-f290656cc020\") " pod="ai-tenant-e2e-inf-b-80fc9d/test-model-80fc9d-kserve-8b59c458f-zm2bj"
Jul 29 15:13:57.171926 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:57.171842    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-80fc9d/test-model-80fc9d-kserve-8b59c458f-zm2bj"
Jul 29 15:13:57.311995 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:57.311970    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-80fc9d/test-model-80fc9d-kserve-8b59c458f-zm2bj"]
Jul 29 15:13:57.314505 ip-10-0-142-130 kubenswrapper[2578]: W0729 15:13:57.314465    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb2a74c6f_262e_4110_8b88_f290656cc020.slice/crio-921f7ce11ebf1e68cd79b580452abd50be37e58f985935b1334eebc3a5cb00df WatchSource:0}: Error finding container 921f7ce11ebf1e68cd79b580452abd50be37e58f985935b1334eebc3a5cb00df: Status 404 returned error can't find the container with id 921f7ce11ebf1e68cd79b580452abd50be37e58f985935b1334eebc3a5cb00df
Jul 29 15:13:57.560329 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:57.560277    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-80fc9d/test-model-80fc9d-kserve-8b59c458f-zm2bj" event={"ID":"b2a74c6f-262e-4110-8b88-f290656cc020","Type":"ContainerStarted","Data":"1a879257dde77c808d00ff9bdb129103a59bf3dc64aab1b0bf5787a2f6f61b7f"}
Jul 29 15:13:57.560329 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:57.560334    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-80fc9d/test-model-80fc9d-kserve-8b59c458f-zm2bj" event={"ID":"b2a74c6f-262e-4110-8b88-f290656cc020","Type":"ContainerStarted","Data":"921f7ce11ebf1e68cd79b580452abd50be37e58f985935b1334eebc3a5cb00df"}
Jul 29 15:13:57.590195 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:13:57.590143    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-80fc9d/test-model-80fc9d-kserve-8b59c458f-zm2bj" podStartSLOduration=1.590127695 podStartE2EDuration="1.590127695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:13:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:13:57.589619506 +0000 UTC m=+2309.892086114" watchObservedRunningTime="2026-07-29 15:13:57.590127695 +0000 UTC m=+2309.892594303"
Jul 29 15:14:01.508166 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:01.508128    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:14:07.172899 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:07.172850    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-80fc9d/test-model-80fc9d-kserve-8b59c458f-zm2bj"
Jul 29 15:14:07.173313 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:07.173103    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-80fc9d/test-model-80fc9d-kserve-8b59c458f-zm2bj"
Jul 29 15:14:07.190572 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:07.190520    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-80fc9d/test-model-80fc9d-kserve-8b59c458f-zm2bj"
Jul 29 15:14:07.621498 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:07.621468    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-80fc9d/test-model-80fc9d-kserve-8b59c458f-zm2bj"
Jul 29 15:14:14.808814 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:14.808771    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:14:39.438253 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:39.438201    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-5ef0d2/test-model-5ef0d2-kserve-5db89685b9-qrgr4"]
Jul 29 15:14:40.356245 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:40.356200    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-80fc9d/test-model-80fc9d-kserve-8b59c458f-zm2bj"]
Jul 29 15:14:44.503187 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:44.503151    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:14:54.457471 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:54.457406    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-5ef0d2/test-model-5ef0d2-kserve-5db89685b9-qrgr4" podUID="26e3bcf3-20c2-4c31-8417-b3278658b4e3" containerName="main" containerID="cri-o://3a41e1894c383c9a0299a1e67d5731b629d485c6911d906c77eff1abc684b690" gracePeriod=45
Jul 29 15:14:54.501157 ip-10-0-142-130 kubenswrapper[2578]: E0729 15:14:54.501126    2578 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26e3bcf3_20c2_4c31_8417_b3278658b4e3.slice/crio-conmon-3a41e1894c383c9a0299a1e67d5731b629d485c6911d906c77eff1abc684b690.scope\": RecentStats: unable to find data in memory cache]"
Jul 29 15:14:54.706708 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:54.706683    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-5ef0d2/test-model-5ef0d2-kserve-5db89685b9-qrgr4"
Jul 29 15:14:54.718756 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:54.718693    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qm22p\" (UniqueName: \"kubernetes.io/projected/26e3bcf3-20c2-4c31-8417-b3278658b4e3-kube-api-access-qm22p\") pod \"26e3bcf3-20c2-4c31-8417-b3278658b4e3\" (UID: \"26e3bcf3-20c2-4c31-8417-b3278658b4e3\") "
Jul 29 15:14:54.718756 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:54.718725    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26e3bcf3-20c2-4c31-8417-b3278658b4e3-tmp-dir\") pod \"26e3bcf3-20c2-4c31-8417-b3278658b4e3\" (UID: \"26e3bcf3-20c2-4c31-8417-b3278658b4e3\") "
Jul 29 15:14:54.718948 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:54.718794    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26e3bcf3-20c2-4c31-8417-b3278658b4e3-dshm\") pod \"26e3bcf3-20c2-4c31-8417-b3278658b4e3\" (UID: \"26e3bcf3-20c2-4c31-8417-b3278658b4e3\") "
Jul 29 15:14:54.718948 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:54.718834    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26e3bcf3-20c2-4c31-8417-b3278658b4e3-model-cache\") pod \"26e3bcf3-20c2-4c31-8417-b3278658b4e3\" (UID: \"26e3bcf3-20c2-4c31-8417-b3278658b4e3\") "
Jul 29 15:14:54.718948 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:54.718854    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26e3bcf3-20c2-4c31-8417-b3278658b4e3-tls-certs\") pod \"26e3bcf3-20c2-4c31-8417-b3278658b4e3\" (UID: \"26e3bcf3-20c2-4c31-8417-b3278658b4e3\") "
Jul 29 15:14:54.718948 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:54.718888    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26e3bcf3-20c2-4c31-8417-b3278658b4e3-home\") pod \"26e3bcf3-20c2-4c31-8417-b3278658b4e3\" (UID: \"26e3bcf3-20c2-4c31-8417-b3278658b4e3\") "
Jul 29 15:14:54.719155 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:54.719069    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26e3bcf3-20c2-4c31-8417-b3278658b4e3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "26e3bcf3-20c2-4c31-8417-b3278658b4e3" (UID: "26e3bcf3-20c2-4c31-8417-b3278658b4e3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:14:54.719155 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:54.719082    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26e3bcf3-20c2-4c31-8417-b3278658b4e3-model-cache" (OuterVolumeSpecName: "model-cache") pod "26e3bcf3-20c2-4c31-8417-b3278658b4e3" (UID: "26e3bcf3-20c2-4c31-8417-b3278658b4e3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:14:54.719266 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:54.719156    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26e3bcf3-20c2-4c31-8417-b3278658b4e3-home" (OuterVolumeSpecName: "home") pod "26e3bcf3-20c2-4c31-8417-b3278658b4e3" (UID: "26e3bcf3-20c2-4c31-8417-b3278658b4e3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:14:54.719266 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:54.719205    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26e3bcf3-20c2-4c31-8417-b3278658b4e3-model-cache\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:14:54.719266 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:54.719220    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26e3bcf3-20c2-4c31-8417-b3278658b4e3-tmp-dir\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:14:54.721338 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:54.721305    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26e3bcf3-20c2-4c31-8417-b3278658b4e3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "26e3bcf3-20c2-4c31-8417-b3278658b4e3" (UID: "26e3bcf3-20c2-4c31-8417-b3278658b4e3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 15:14:54.721458 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:54.721445    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26e3bcf3-20c2-4c31-8417-b3278658b4e3-dshm" (OuterVolumeSpecName: "dshm") pod "26e3bcf3-20c2-4c31-8417-b3278658b4e3" (UID: "26e3bcf3-20c2-4c31-8417-b3278658b4e3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:14:54.721515 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:54.721460    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26e3bcf3-20c2-4c31-8417-b3278658b4e3-kube-api-access-qm22p" (OuterVolumeSpecName: "kube-api-access-qm22p") pod "26e3bcf3-20c2-4c31-8417-b3278658b4e3" (UID: "26e3bcf3-20c2-4c31-8417-b3278658b4e3"). InnerVolumeSpecName "kube-api-access-qm22p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 15:14:54.815049 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:54.815016    2578 generic.go:356] "Generic (PLEG): container finished" podID="26e3bcf3-20c2-4c31-8417-b3278658b4e3" containerID="3a41e1894c383c9a0299a1e67d5731b629d485c6911d906c77eff1abc684b690" exitCode=0
Jul 29 15:14:54.815259 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:54.815059    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-5ef0d2/test-model-5ef0d2-kserve-5db89685b9-qrgr4"
Jul 29 15:14:54.815259 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:54.815101    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-5ef0d2/test-model-5ef0d2-kserve-5db89685b9-qrgr4" event={"ID":"26e3bcf3-20c2-4c31-8417-b3278658b4e3","Type":"ContainerDied","Data":"3a41e1894c383c9a0299a1e67d5731b629d485c6911d906c77eff1abc684b690"}
Jul 29 15:14:54.815259 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:54.815148    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-5ef0d2/test-model-5ef0d2-kserve-5db89685b9-qrgr4" event={"ID":"26e3bcf3-20c2-4c31-8417-b3278658b4e3","Type":"ContainerDied","Data":"d39df7594f6d227659c938e31006b64419dcff8c684cd896a91ae3af34a59837"}
Jul 29 15:14:54.815259 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:54.815170    2578 scope.go:117] "RemoveContainer" containerID="3a41e1894c383c9a0299a1e67d5731b629d485c6911d906c77eff1abc684b690"
Jul 29 15:14:54.819931 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:54.819913    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26e3bcf3-20c2-4c31-8417-b3278658b4e3-tls-certs\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:14:54.819931 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:54.819931    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26e3bcf3-20c2-4c31-8417-b3278658b4e3-home\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:14:54.820054 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:54.819941    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qm22p\" (UniqueName: \"kubernetes.io/projected/26e3bcf3-20c2-4c31-8417-b3278658b4e3-kube-api-access-qm22p\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:14:54.820054 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:54.819950    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26e3bcf3-20c2-4c31-8417-b3278658b4e3-dshm\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:14:54.824893 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:54.824878    2578 scope.go:117] "RemoveContainer" containerID="3a41e1894c383c9a0299a1e67d5731b629d485c6911d906c77eff1abc684b690"
Jul 29 15:14:54.825122 ip-10-0-142-130 kubenswrapper[2578]: E0729 15:14:54.825101    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a41e1894c383c9a0299a1e67d5731b629d485c6911d906c77eff1abc684b690\": container with ID starting with 3a41e1894c383c9a0299a1e67d5731b629d485c6911d906c77eff1abc684b690 not found: ID does not exist" containerID="3a41e1894c383c9a0299a1e67d5731b629d485c6911d906c77eff1abc684b690"
Jul 29 15:14:54.825218 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:54.825127    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a41e1894c383c9a0299a1e67d5731b629d485c6911d906c77eff1abc684b690"} err="failed to get container status \"3a41e1894c383c9a0299a1e67d5731b629d485c6911d906c77eff1abc684b690\": rpc error: code = NotFound desc = could not find container \"3a41e1894c383c9a0299a1e67d5731b629d485c6911d906c77eff1abc684b690\": container with ID starting with 3a41e1894c383c9a0299a1e67d5731b629d485c6911d906c77eff1abc684b690 not found: ID does not exist"
Jul 29 15:14:54.837211 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:54.837190    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-5ef0d2/test-model-5ef0d2-kserve-5db89685b9-qrgr4"]
Jul 29 15:14:54.843195 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:54.843176    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-5ef0d2/test-model-5ef0d2-kserve-5db89685b9-qrgr4"]
Jul 29 15:14:55.376151 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:55.376092    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-80fc9d/test-model-80fc9d-kserve-8b59c458f-zm2bj" podUID="b2a74c6f-262e-4110-8b88-f290656cc020" containerName="main" containerID="cri-o://1a879257dde77c808d00ff9bdb129103a59bf3dc64aab1b0bf5787a2f6f61b7f" gracePeriod=45
Jul 29 15:14:55.619733 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:55.619710    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-80fc9d/test-model-80fc9d-kserve-8b59c458f-zm2bj"
Jul 29 15:14:55.727138 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:55.727050    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2a74c6f-262e-4110-8b88-f290656cc020-dshm\") pod \"b2a74c6f-262e-4110-8b88-f290656cc020\" (UID: \"b2a74c6f-262e-4110-8b88-f290656cc020\") "
Jul 29 15:14:55.727138 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:55.727089    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8l92w\" (UniqueName: \"kubernetes.io/projected/b2a74c6f-262e-4110-8b88-f290656cc020-kube-api-access-8l92w\") pod \"b2a74c6f-262e-4110-8b88-f290656cc020\" (UID: \"b2a74c6f-262e-4110-8b88-f290656cc020\") "
Jul 29 15:14:55.727138 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:55.727105    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2a74c6f-262e-4110-8b88-f290656cc020-tmp-dir\") pod \"b2a74c6f-262e-4110-8b88-f290656cc020\" (UID: \"b2a74c6f-262e-4110-8b88-f290656cc020\") "
Jul 29 15:14:55.727433 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:55.727142    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2a74c6f-262e-4110-8b88-f290656cc020-home\") pod \"b2a74c6f-262e-4110-8b88-f290656cc020\" (UID: \"b2a74c6f-262e-4110-8b88-f290656cc020\") "
Jul 29 15:14:55.727433 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:55.727174    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2a74c6f-262e-4110-8b88-f290656cc020-model-cache\") pod \"b2a74c6f-262e-4110-8b88-f290656cc020\" (UID: \"b2a74c6f-262e-4110-8b88-f290656cc020\") "
Jul 29 15:14:55.727433 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:55.727288    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2a74c6f-262e-4110-8b88-f290656cc020-tls-certs\") pod \"b2a74c6f-262e-4110-8b88-f290656cc020\" (UID: \"b2a74c6f-262e-4110-8b88-f290656cc020\") "
Jul 29 15:14:55.727595 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:55.727470    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2a74c6f-262e-4110-8b88-f290656cc020-home" (OuterVolumeSpecName: "home") pod "b2a74c6f-262e-4110-8b88-f290656cc020" (UID: "b2a74c6f-262e-4110-8b88-f290656cc020"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:14:55.727595 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:55.727478    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2a74c6f-262e-4110-8b88-f290656cc020-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b2a74c6f-262e-4110-8b88-f290656cc020" (UID: "b2a74c6f-262e-4110-8b88-f290656cc020"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:14:55.727595 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:55.727570    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2a74c6f-262e-4110-8b88-f290656cc020-model-cache" (OuterVolumeSpecName: "model-cache") pod "b2a74c6f-262e-4110-8b88-f290656cc020" (UID: "b2a74c6f-262e-4110-8b88-f290656cc020"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:14:55.727703 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:55.727629    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2a74c6f-262e-4110-8b88-f290656cc020-tmp-dir\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:14:55.727703 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:55.727645    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2a74c6f-262e-4110-8b88-f290656cc020-home\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:14:55.729473 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:55.729452    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2a74c6f-262e-4110-8b88-f290656cc020-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b2a74c6f-262e-4110-8b88-f290656cc020" (UID: "b2a74c6f-262e-4110-8b88-f290656cc020"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 15:14:55.729728 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:55.729707    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2a74c6f-262e-4110-8b88-f290656cc020-dshm" (OuterVolumeSpecName: "dshm") pod "b2a74c6f-262e-4110-8b88-f290656cc020" (UID: "b2a74c6f-262e-4110-8b88-f290656cc020"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:14:55.729771 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:55.729708    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2a74c6f-262e-4110-8b88-f290656cc020-kube-api-access-8l92w" (OuterVolumeSpecName: "kube-api-access-8l92w") pod "b2a74c6f-262e-4110-8b88-f290656cc020" (UID: "b2a74c6f-262e-4110-8b88-f290656cc020"). InnerVolumeSpecName "kube-api-access-8l92w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 15:14:55.822001 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:55.821961    2578 generic.go:356] "Generic (PLEG): container finished" podID="b2a74c6f-262e-4110-8b88-f290656cc020" containerID="1a879257dde77c808d00ff9bdb129103a59bf3dc64aab1b0bf5787a2f6f61b7f" exitCode=0
Jul 29 15:14:55.822001 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:55.822003    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-80fc9d/test-model-80fc9d-kserve-8b59c458f-zm2bj"
Jul 29 15:14:55.822222 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:55.822052    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-80fc9d/test-model-80fc9d-kserve-8b59c458f-zm2bj" event={"ID":"b2a74c6f-262e-4110-8b88-f290656cc020","Type":"ContainerDied","Data":"1a879257dde77c808d00ff9bdb129103a59bf3dc64aab1b0bf5787a2f6f61b7f"}
Jul 29 15:14:55.822222 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:55.822090    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-80fc9d/test-model-80fc9d-kserve-8b59c458f-zm2bj" event={"ID":"b2a74c6f-262e-4110-8b88-f290656cc020","Type":"ContainerDied","Data":"921f7ce11ebf1e68cd79b580452abd50be37e58f985935b1334eebc3a5cb00df"}
Jul 29 15:14:55.822222 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:55.822107    2578 scope.go:117] "RemoveContainer" containerID="1a879257dde77c808d00ff9bdb129103a59bf3dc64aab1b0bf5787a2f6f61b7f"
Jul 29 15:14:55.828169 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:55.828141    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2a74c6f-262e-4110-8b88-f290656cc020-dshm\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:14:55.828169 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:55.828164    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8l92w\" (UniqueName: \"kubernetes.io/projected/b2a74c6f-262e-4110-8b88-f290656cc020-kube-api-access-8l92w\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:14:55.828374 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:55.828175    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2a74c6f-262e-4110-8b88-f290656cc020-model-cache\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:14:55.828374 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:55.828184    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2a74c6f-262e-4110-8b88-f290656cc020-tls-certs\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:14:55.831513 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:55.831496    2578 scope.go:117] "RemoveContainer" containerID="1a879257dde77c808d00ff9bdb129103a59bf3dc64aab1b0bf5787a2f6f61b7f"
Jul 29 15:14:55.831746 ip-10-0-142-130 kubenswrapper[2578]: E0729 15:14:55.831727    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a879257dde77c808d00ff9bdb129103a59bf3dc64aab1b0bf5787a2f6f61b7f\": container with ID starting with 1a879257dde77c808d00ff9bdb129103a59bf3dc64aab1b0bf5787a2f6f61b7f not found: ID does not exist" containerID="1a879257dde77c808d00ff9bdb129103a59bf3dc64aab1b0bf5787a2f6f61b7f"
Jul 29 15:14:55.831799 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:55.831753    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a879257dde77c808d00ff9bdb129103a59bf3dc64aab1b0bf5787a2f6f61b7f"} err="failed to get container status \"1a879257dde77c808d00ff9bdb129103a59bf3dc64aab1b0bf5787a2f6f61b7f\": rpc error: code = NotFound desc = could not find container \"1a879257dde77c808d00ff9bdb129103a59bf3dc64aab1b0bf5787a2f6f61b7f\": container with ID starting with 1a879257dde77c808d00ff9bdb129103a59bf3dc64aab1b0bf5787a2f6f61b7f not found: ID does not exist"
Jul 29 15:14:55.851994 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:55.851971    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-80fc9d/test-model-80fc9d-kserve-8b59c458f-zm2bj"]
Jul 29 15:14:55.856551 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:55.856530    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-80fc9d/test-model-80fc9d-kserve-8b59c458f-zm2bj"]
Jul 29 15:14:56.278054 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:56.278018    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26e3bcf3-20c2-4c31-8417-b3278658b4e3" path="/var/lib/kubelet/pods/26e3bcf3-20c2-4c31-8417-b3278658b4e3/volumes"
Jul 29 15:14:56.278480 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:14:56.278464    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2a74c6f-262e-4110-8b88-f290656cc020" path="/var/lib/kubelet/pods/b2a74c6f-262e-4110-8b88-f290656cc020/volumes"
Jul 29 15:15:01.001820 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:15:01.001775    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:15:12.309649 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:15:12.309612    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:15:24.204854 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:15:24.204819    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:15:56.214046 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:15:56.213961    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:16:39.506032 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:16:39.505997    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:16:59.909417 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:16:59.909382    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:17:02.862879 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:02.862842    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm"]
Jul 29 15:17:02.863437 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:02.863415    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2a74c6f-262e-4110-8b88-f290656cc020" containerName="main"
Jul 29 15:17:02.863509 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:02.863441    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2a74c6f-262e-4110-8b88-f290656cc020" containerName="main"
Jul 29 15:17:02.863509 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:02.863477    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26e3bcf3-20c2-4c31-8417-b3278658b4e3" containerName="main"
Jul 29 15:17:02.863509 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:02.863488    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="26e3bcf3-20c2-4c31-8417-b3278658b4e3" containerName="main"
Jul 29 15:17:02.863618 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:02.863564    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="26e3bcf3-20c2-4c31-8417-b3278658b4e3" containerName="main"
Jul 29 15:17:02.863618 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:02.863579    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2a74c6f-262e-4110-8b88-f290656cc020" containerName="main"
Jul 29 15:17:02.866855 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:02.866833    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm"
Jul 29 15:17:02.869455 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:02.869437    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-c73214-openshift-default-dockercfg-gm7xq\""
Jul 29 15:17:02.880333 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:02.880307    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm"]
Jul 29 15:17:02.968390 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:02.968360    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5473b65c-746a-4f25-8572-3d1aa2db9c71-istio-token\") pod \"e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm\" (UID: \"5473b65c-746a-4f25-8572-3d1aa2db9c71\") " pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm"
Jul 29 15:17:02.968390 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:02.968394    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5473b65c-746a-4f25-8572-3d1aa2db9c71-workload-socket\") pod \"e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm\" (UID: \"5473b65c-746a-4f25-8572-3d1aa2db9c71\") " pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm"
Jul 29 15:17:02.968655 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:02.968412    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5473b65c-746a-4f25-8572-3d1aa2db9c71-istiod-ca-cert\") pod \"e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm\" (UID: \"5473b65c-746a-4f25-8572-3d1aa2db9c71\") " pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm"
Jul 29 15:17:02.968655 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:02.968517    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5473b65c-746a-4f25-8572-3d1aa2db9c71-credential-socket\") pod \"e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm\" (UID: \"5473b65c-746a-4f25-8572-3d1aa2db9c71\") " pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm"
Jul 29 15:17:02.968655 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:02.968551    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5473b65c-746a-4f25-8572-3d1aa2db9c71-workload-certs\") pod \"e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm\" (UID: \"5473b65c-746a-4f25-8572-3d1aa2db9c71\") " pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm"
Jul 29 15:17:02.968655 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:02.968567    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5473b65c-746a-4f25-8572-3d1aa2db9c71-istio-envoy\") pod \"e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm\" (UID: \"5473b65c-746a-4f25-8572-3d1aa2db9c71\") " pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm"
Jul 29 15:17:02.968655 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:02.968583    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5473b65c-746a-4f25-8572-3d1aa2db9c71-istio-data\") pod \"e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm\" (UID: \"5473b65c-746a-4f25-8572-3d1aa2db9c71\") " pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm"
Jul 29 15:17:02.968655 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:02.968598    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5473b65c-746a-4f25-8572-3d1aa2db9c71-istio-podinfo\") pod \"e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm\" (UID: \"5473b65c-746a-4f25-8572-3d1aa2db9c71\") " pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm"
Jul 29 15:17:02.968655 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:02.968620    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pw4l5\" (UniqueName: \"kubernetes.io/projected/5473b65c-746a-4f25-8572-3d1aa2db9c71-kube-api-access-pw4l5\") pod \"e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm\" (UID: \"5473b65c-746a-4f25-8572-3d1aa2db9c71\") " pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm"
Jul 29 15:17:03.069077 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:03.069045    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5473b65c-746a-4f25-8572-3d1aa2db9c71-istio-token\") pod \"e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm\" (UID: \"5473b65c-746a-4f25-8572-3d1aa2db9c71\") " pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm"
Jul 29 15:17:03.069077 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:03.069082    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5473b65c-746a-4f25-8572-3d1aa2db9c71-workload-socket\") pod \"e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm\" (UID: \"5473b65c-746a-4f25-8572-3d1aa2db9c71\") " pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm"
Jul 29 15:17:03.069354 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:03.069103    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5473b65c-746a-4f25-8572-3d1aa2db9c71-istiod-ca-cert\") pod \"e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm\" (UID: \"5473b65c-746a-4f25-8572-3d1aa2db9c71\") " pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm"
Jul 29 15:17:03.069354 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:03.069180    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5473b65c-746a-4f25-8572-3d1aa2db9c71-credential-socket\") pod \"e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm\" (UID: \"5473b65c-746a-4f25-8572-3d1aa2db9c71\") " pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm"
Jul 29 15:17:03.069354 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:03.069205    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5473b65c-746a-4f25-8572-3d1aa2db9c71-workload-certs\") pod \"e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm\" (UID: \"5473b65c-746a-4f25-8572-3d1aa2db9c71\") " pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm"
Jul 29 15:17:03.069354 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:03.069225    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5473b65c-746a-4f25-8572-3d1aa2db9c71-istio-envoy\") pod \"e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm\" (UID: \"5473b65c-746a-4f25-8572-3d1aa2db9c71\") " pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm"
Jul 29 15:17:03.069354 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:03.069264    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5473b65c-746a-4f25-8572-3d1aa2db9c71-istio-data\") pod \"e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm\" (UID: \"5473b65c-746a-4f25-8572-3d1aa2db9c71\") " pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm"
Jul 29 15:17:03.069354 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:03.069286    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5473b65c-746a-4f25-8572-3d1aa2db9c71-istio-podinfo\") pod \"e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm\" (UID: \"5473b65c-746a-4f25-8572-3d1aa2db9c71\") " pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm"
Jul 29 15:17:03.069354 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:03.069309    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pw4l5\" (UniqueName: \"kubernetes.io/projected/5473b65c-746a-4f25-8572-3d1aa2db9c71-kube-api-access-pw4l5\") pod \"e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm\" (UID: \"5473b65c-746a-4f25-8572-3d1aa2db9c71\") " pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm"
Jul 29 15:17:03.069724 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:03.069488    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5473b65c-746a-4f25-8572-3d1aa2db9c71-workload-socket\") pod \"e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm\" (UID: \"5473b65c-746a-4f25-8572-3d1aa2db9c71\") " pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm"
Jul 29 15:17:03.069724 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:03.069523    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5473b65c-746a-4f25-8572-3d1aa2db9c71-credential-socket\") pod \"e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm\" (UID: \"5473b65c-746a-4f25-8572-3d1aa2db9c71\") " pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm"
Jul 29 15:17:03.069724 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:03.069633    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5473b65c-746a-4f25-8572-3d1aa2db9c71-istio-data\") pod \"e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm\" (UID: \"5473b65c-746a-4f25-8572-3d1aa2db9c71\") " pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm"
Jul 29 15:17:03.069724 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:03.069697    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5473b65c-746a-4f25-8572-3d1aa2db9c71-workload-certs\") pod \"e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm\" (UID: \"5473b65c-746a-4f25-8572-3d1aa2db9c71\") " pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm"
Jul 29 15:17:03.069968 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:03.069949    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5473b65c-746a-4f25-8572-3d1aa2db9c71-istiod-ca-cert\") pod \"e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm\" (UID: \"5473b65c-746a-4f25-8572-3d1aa2db9c71\") " pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm"
Jul 29 15:17:03.071544 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:03.071522    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5473b65c-746a-4f25-8572-3d1aa2db9c71-istio-envoy\") pod \"e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm\" (UID: \"5473b65c-746a-4f25-8572-3d1aa2db9c71\") " pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm"
Jul 29 15:17:03.071735 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:03.071717    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5473b65c-746a-4f25-8572-3d1aa2db9c71-istio-podinfo\") pod \"e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm\" (UID: \"5473b65c-746a-4f25-8572-3d1aa2db9c71\") " pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm"
Jul 29 15:17:03.077853 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:03.077828    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5473b65c-746a-4f25-8572-3d1aa2db9c71-istio-token\") pod \"e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm\" (UID: \"5473b65c-746a-4f25-8572-3d1aa2db9c71\") " pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm"
Jul 29 15:17:03.077958 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:03.077939    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pw4l5\" (UniqueName: \"kubernetes.io/projected/5473b65c-746a-4f25-8572-3d1aa2db9c71-kube-api-access-pw4l5\") pod \"e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm\" (UID: \"5473b65c-746a-4f25-8572-3d1aa2db9c71\") " pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm"
Jul 29 15:17:03.177092 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:03.177019    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm"
Jul 29 15:17:03.309692 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:03.309668    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm"]
Jul 29 15:17:03.311790 ip-10-0-142-130 kubenswrapper[2578]: W0729 15:17:03.311762    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5473b65c_746a_4f25_8572_3d1aa2db9c71.slice/crio-26f2b184e2f29bbd5aa20a13b678cd4d7c0a86990bf57480f9a4b0dfd44f5859 WatchSource:0}: Error finding container 26f2b184e2f29bbd5aa20a13b678cd4d7c0a86990bf57480f9a4b0dfd44f5859: Status 404 returned error can't find the container with id 26f2b184e2f29bbd5aa20a13b678cd4d7c0a86990bf57480f9a4b0dfd44f5859
Jul 29 15:17:03.314335 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:03.314298    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 15:17:03.314453 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:03.314377    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 15:17:03.314453 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:03.314423    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 15:17:03.394059 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:03.394027    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm" event={"ID":"5473b65c-746a-4f25-8572-3d1aa2db9c71","Type":"ContainerStarted","Data":"4ff99cf55f9c8b431f65bac2a675dea33861cd669168be4ce35f5cf4f7718003"}
Jul 29 15:17:03.394374 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:03.394090    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm" event={"ID":"5473b65c-746a-4f25-8572-3d1aa2db9c71","Type":"ContainerStarted","Data":"26f2b184e2f29bbd5aa20a13b678cd4d7c0a86990bf57480f9a4b0dfd44f5859"}
Jul 29 15:17:03.416515 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:03.416457    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm" podStartSLOduration=1.416435724 podStartE2EDuration="1.416435724s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:17:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:17:03.415822263 +0000 UTC m=+2495.718288872" watchObservedRunningTime="2026-07-29 15:17:03.416435724 +0000 UTC m=+2495.718902333"
Jul 29 15:17:04.177483 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:04.177448    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm"
Jul 29 15:17:04.182663 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:04.182634    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm"
Jul 29 15:17:04.398882 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:04.398854    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm"
Jul 29 15:17:04.399985 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:04.399957    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm"
Jul 29 15:17:11.407739 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:11.407706    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:17:19.400739 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:19.400705    2578 patch_prober.go:28] interesting pod/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 29 15:17:19.401075 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:19.400773    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm" podUID="5473b65c-746a-4f25-8572-3d1aa2db9c71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 29 15:17:19.474981 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:19.474950    2578 generic.go:356] "Generic (PLEG): container finished" podID="5473b65c-746a-4f25-8572-3d1aa2db9c71" containerID="4ff99cf55f9c8b431f65bac2a675dea33861cd669168be4ce35f5cf4f7718003" exitCode=0
Jul 29 15:17:19.475100 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:19.474984    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm" event={"ID":"5473b65c-746a-4f25-8572-3d1aa2db9c71","Type":"ContainerDied","Data":"4ff99cf55f9c8b431f65bac2a675dea33861cd669168be4ce35f5cf4f7718003"}
Jul 29 15:17:19.475439 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:19.475423    2578 scope.go:117] "RemoveContainer" containerID="4ff99cf55f9c8b431f65bac2a675dea33861cd669168be4ce35f5cf4f7718003"
Jul 29 15:17:19.476398 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:19.476365    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 15:17:19.476531 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:19.476452    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 15:17:19.476531 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:19.476501    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 15:17:20.481438 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:20.481361    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm" event={"ID":"5473b65c-746a-4f25-8572-3d1aa2db9c71","Type":"ContainerStarted","Data":"10d189f679ad68f7857094f31c8bbbf3c9cd7e65f134de9ba8bff91b7b1d92cc"}
Jul 29 15:17:21.177422 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:21.177380    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm"
Jul 29 15:17:21.177679 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:21.177653    2578 patch_prober.go:28] interesting pod/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 29 15:17:21.177773 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:21.177728    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm" podUID="5473b65c-746a-4f25-8572-3d1aa2db9c71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 29 15:17:22.177744 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:22.177711    2578 patch_prober.go:28] interesting pod/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 29 15:17:22.178119 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:22.177761    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm" podUID="5473b65c-746a-4f25-8572-3d1aa2db9c71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 29 15:17:23.178076 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:23.178035    2578 patch_prober.go:28] interesting pod/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 29 15:17:23.178517 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:23.178094    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm" podUID="5473b65c-746a-4f25-8572-3d1aa2db9c71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 29 15:17:24.177621 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:24.177578    2578 patch_prober.go:28] interesting pod/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 29 15:17:24.177789 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:24.177635    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm" podUID="5473b65c-746a-4f25-8572-3d1aa2db9c71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 29 15:17:25.181398 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:25.181365    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm"
Jul 29 15:17:25.181826 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:25.181704    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm"
Jul 29 15:17:25.182551 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:25.182533    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm"
Jul 29 15:17:42.310016 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:17:42.309978    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:18:26.835904 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:18:26.835873    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-c73214/auth-test-model-c73214-kserve-579f6cf96c-sjx47"]
Jul 29 15:18:26.839386 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:18:26.839370    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c73214/auth-test-model-c73214-kserve-579f6cf96c-sjx47"
Jul 29 15:18:26.843162 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:18:26.843136    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-c73214\"/\"kube-root-ca.crt\""
Jul 29 15:18:26.843739 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:18:26.843723    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-c73214\"/\"default-dockercfg-bjdm4\""
Jul 29 15:18:26.844559 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:18:26.844539    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-c73214\"/\"openshift-service-ca.crt\""
Jul 29 15:18:26.844682 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:18:26.844543    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-c73214\"/\"auth-test-model-c73214-kserve-self-signed-certs\""
Jul 29 15:18:26.854626 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:18:26.854595    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c73214/auth-test-model-c73214-kserve-579f6cf96c-sjx47"]
Jul 29 15:18:27.000126 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:18:27.000096    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b0a7bd1-b896-41f7-bee8-cf3125370ab8-dshm\") pod \"auth-test-model-c73214-kserve-579f6cf96c-sjx47\" (UID: \"9b0a7bd1-b896-41f7-bee8-cf3125370ab8\") " pod="ai-tenant-e2e-shared-a-c73214/auth-test-model-c73214-kserve-579f6cf96c-sjx47"
Jul 29 15:18:27.000346 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:18:27.000133    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b0a7bd1-b896-41f7-bee8-cf3125370ab8-tmp-dir\") pod \"auth-test-model-c73214-kserve-579f6cf96c-sjx47\" (UID: \"9b0a7bd1-b896-41f7-bee8-cf3125370ab8\") " pod="ai-tenant-e2e-shared-a-c73214/auth-test-model-c73214-kserve-579f6cf96c-sjx47"
Jul 29 15:18:27.000346 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:18:27.000172    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b0a7bd1-b896-41f7-bee8-cf3125370ab8-tls-certs\") pod \"auth-test-model-c73214-kserve-579f6cf96c-sjx47\" (UID: \"9b0a7bd1-b896-41f7-bee8-cf3125370ab8\") " pod="ai-tenant-e2e-shared-a-c73214/auth-test-model-c73214-kserve-579f6cf96c-sjx47"
Jul 29 15:18:27.000346 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:18:27.000313    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b0a7bd1-b896-41f7-bee8-cf3125370ab8-home\") pod \"auth-test-model-c73214-kserve-579f6cf96c-sjx47\" (UID: \"9b0a7bd1-b896-41f7-bee8-cf3125370ab8\") " pod="ai-tenant-e2e-shared-a-c73214/auth-test-model-c73214-kserve-579f6cf96c-sjx47"
Jul 29 15:18:27.000521 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:18:27.000350    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b0a7bd1-b896-41f7-bee8-cf3125370ab8-model-cache\") pod \"auth-test-model-c73214-kserve-579f6cf96c-sjx47\" (UID: \"9b0a7bd1-b896-41f7-bee8-cf3125370ab8\") " pod="ai-tenant-e2e-shared-a-c73214/auth-test-model-c73214-kserve-579f6cf96c-sjx47"
Jul 29 15:18:27.000521 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:18:27.000382    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn7lx\" (UniqueName: \"kubernetes.io/projected/9b0a7bd1-b896-41f7-bee8-cf3125370ab8-kube-api-access-dn7lx\") pod \"auth-test-model-c73214-kserve-579f6cf96c-sjx47\" (UID: \"9b0a7bd1-b896-41f7-bee8-cf3125370ab8\") " pod="ai-tenant-e2e-shared-a-c73214/auth-test-model-c73214-kserve-579f6cf96c-sjx47"
Jul 29 15:18:27.101364 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:18:27.101280    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b0a7bd1-b896-41f7-bee8-cf3125370ab8-dshm\") pod \"auth-test-model-c73214-kserve-579f6cf96c-sjx47\" (UID: \"9b0a7bd1-b896-41f7-bee8-cf3125370ab8\") " pod="ai-tenant-e2e-shared-a-c73214/auth-test-model-c73214-kserve-579f6cf96c-sjx47"
Jul 29 15:18:27.101364 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:18:27.101317    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b0a7bd1-b896-41f7-bee8-cf3125370ab8-tmp-dir\") pod \"auth-test-model-c73214-kserve-579f6cf96c-sjx47\" (UID: \"9b0a7bd1-b896-41f7-bee8-cf3125370ab8\") " pod="ai-tenant-e2e-shared-a-c73214/auth-test-model-c73214-kserve-579f6cf96c-sjx47"
Jul 29 15:18:27.101364 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:18:27.101351    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b0a7bd1-b896-41f7-bee8-cf3125370ab8-tls-certs\") pod \"auth-test-model-c73214-kserve-579f6cf96c-sjx47\" (UID: \"9b0a7bd1-b896-41f7-bee8-cf3125370ab8\") " pod="ai-tenant-e2e-shared-a-c73214/auth-test-model-c73214-kserve-579f6cf96c-sjx47"
Jul 29 15:18:27.101626 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:18:27.101402    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b0a7bd1-b896-41f7-bee8-cf3125370ab8-home\") pod \"auth-test-model-c73214-kserve-579f6cf96c-sjx47\" (UID: \"9b0a7bd1-b896-41f7-bee8-cf3125370ab8\") " pod="ai-tenant-e2e-shared-a-c73214/auth-test-model-c73214-kserve-579f6cf96c-sjx47"
Jul 29 15:18:27.101626 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:18:27.101417    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b0a7bd1-b896-41f7-bee8-cf3125370ab8-model-cache\") pod \"auth-test-model-c73214-kserve-579f6cf96c-sjx47\" (UID: \"9b0a7bd1-b896-41f7-bee8-cf3125370ab8\") " pod="ai-tenant-e2e-shared-a-c73214/auth-test-model-c73214-kserve-579f6cf96c-sjx47"
Jul 29 15:18:27.101626 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:18:27.101441    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn7lx\" (UniqueName: \"kubernetes.io/projected/9b0a7bd1-b896-41f7-bee8-cf3125370ab8-kube-api-access-dn7lx\") pod \"auth-test-model-c73214-kserve-579f6cf96c-sjx47\" (UID: \"9b0a7bd1-b896-41f7-bee8-cf3125370ab8\") " pod="ai-tenant-e2e-shared-a-c73214/auth-test-model-c73214-kserve-579f6cf96c-sjx47"
Jul 29 15:18:27.101862 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:18:27.101702    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b0a7bd1-b896-41f7-bee8-cf3125370ab8-tmp-dir\") pod \"auth-test-model-c73214-kserve-579f6cf96c-sjx47\" (UID: \"9b0a7bd1-b896-41f7-bee8-cf3125370ab8\") " pod="ai-tenant-e2e-shared-a-c73214/auth-test-model-c73214-kserve-579f6cf96c-sjx47"
Jul 29 15:18:27.101862 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:18:27.101756    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b0a7bd1-b896-41f7-bee8-cf3125370ab8-home\") pod \"auth-test-model-c73214-kserve-579f6cf96c-sjx47\" (UID: \"9b0a7bd1-b896-41f7-bee8-cf3125370ab8\") " pod="ai-tenant-e2e-shared-a-c73214/auth-test-model-c73214-kserve-579f6cf96c-sjx47"
Jul 29 15:18:27.101862 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:18:27.101807    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b0a7bd1-b896-41f7-bee8-cf3125370ab8-model-cache\") pod \"auth-test-model-c73214-kserve-579f6cf96c-sjx47\" (UID: \"9b0a7bd1-b896-41f7-bee8-cf3125370ab8\") " pod="ai-tenant-e2e-shared-a-c73214/auth-test-model-c73214-kserve-579f6cf96c-sjx47"
Jul 29 15:18:27.103660 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:18:27.103637    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b0a7bd1-b896-41f7-bee8-cf3125370ab8-dshm\") pod \"auth-test-model-c73214-kserve-579f6cf96c-sjx47\" (UID: \"9b0a7bd1-b896-41f7-bee8-cf3125370ab8\") " pod="ai-tenant-e2e-shared-a-c73214/auth-test-model-c73214-kserve-579f6cf96c-sjx47"
Jul 29 15:18:27.103827 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:18:27.103810    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b0a7bd1-b896-41f7-bee8-cf3125370ab8-tls-certs\") pod \"auth-test-model-c73214-kserve-579f6cf96c-sjx47\" (UID: \"9b0a7bd1-b896-41f7-bee8-cf3125370ab8\") " pod="ai-tenant-e2e-shared-a-c73214/auth-test-model-c73214-kserve-579f6cf96c-sjx47"
Jul 29 15:18:27.110313 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:18:27.110287    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn7lx\" (UniqueName: \"kubernetes.io/projected/9b0a7bd1-b896-41f7-bee8-cf3125370ab8-kube-api-access-dn7lx\") pod \"auth-test-model-c73214-kserve-579f6cf96c-sjx47\" (UID: \"9b0a7bd1-b896-41f7-bee8-cf3125370ab8\") " pod="ai-tenant-e2e-shared-a-c73214/auth-test-model-c73214-kserve-579f6cf96c-sjx47"
Jul 29 15:18:27.149281 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:18:27.149259    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c73214/auth-test-model-c73214-kserve-579f6cf96c-sjx47"
Jul 29 15:18:27.278942 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:18:27.278914    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c73214/auth-test-model-c73214-kserve-579f6cf96c-sjx47"]
Jul 29 15:18:27.280660 ip-10-0-142-130 kubenswrapper[2578]: W0729 15:18:27.280632    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9b0a7bd1_b896_41f7_bee8_cf3125370ab8.slice/crio-ec14b492b582d5954f28705489c95d39aedbee089271ef621d7358326c4cde0b WatchSource:0}: Error finding container ec14b492b582d5954f28705489c95d39aedbee089271ef621d7358326c4cde0b: Status 404 returned error can't find the container with id ec14b492b582d5954f28705489c95d39aedbee089271ef621d7358326c4cde0b
Jul 29 15:18:27.793697 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:18:27.793659    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c73214/auth-test-model-c73214-kserve-579f6cf96c-sjx47" event={"ID":"9b0a7bd1-b896-41f7-bee8-cf3125370ab8","Type":"ContainerStarted","Data":"dd678ad328c8be873aed98ef1bd5bbcfa1990586f604e9a3b85e2eacf6d0c28b"}
Jul 29 15:18:27.793895 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:18:27.793707    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c73214/auth-test-model-c73214-kserve-579f6cf96c-sjx47" event={"ID":"9b0a7bd1-b896-41f7-bee8-cf3125370ab8","Type":"ContainerStarted","Data":"ec14b492b582d5954f28705489c95d39aedbee089271ef621d7358326c4cde0b"}
Jul 29 15:18:27.811611 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:18:27.811557    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-c73214/auth-test-model-c73214-kserve-579f6cf96c-sjx47" podStartSLOduration=1.811543233 podStartE2EDuration="1.811543233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:18:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:18:27.811499303 +0000 UTC m=+2580.113965911" watchObservedRunningTime="2026-07-29 15:18:27.811543233 +0000 UTC m=+2580.114009871"
Jul 29 15:18:30.504117 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:18:30.504083    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:18:37.149702 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:18:37.149664    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-c73214/auth-test-model-c73214-kserve-579f6cf96c-sjx47"
Jul 29 15:18:37.150191 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:18:37.149714    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-c73214/auth-test-model-c73214-kserve-579f6cf96c-sjx47"
Jul 29 15:18:37.161948 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:18:37.161925    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-c73214/auth-test-model-c73214-kserve-579f6cf96c-sjx47"
Jul 29 15:18:37.848896 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:18:37.848866    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-c73214/auth-test-model-c73214-kserve-579f6cf96c-sjx47"
Jul 29 15:19:14.014483 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:19:14.014409    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-93e799/auth-test-model-93e799-kserve-86799bd899-n869l"]
Jul 29 15:19:14.017591 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:19:14.017576    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-93e799/auth-test-model-93e799-kserve-86799bd899-n869l"
Jul 29 15:19:14.021943 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:19:14.021921    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-93e799\"/\"kube-root-ca.crt\""
Jul 29 15:19:14.022075 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:19:14.021984    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-93e799\"/\"auth-test-model-93e799-kserve-self-signed-certs\""
Jul 29 15:19:14.022075 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:19:14.022030    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-93e799\"/\"openshift-service-ca.crt\""
Jul 29 15:19:14.022075 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:19:14.022066    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-93e799\"/\"default-dockercfg-wvpcl\""
Jul 29 15:19:14.027417 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:19:14.027396    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-93e799/auth-test-model-93e799-kserve-86799bd899-n869l"]
Jul 29 15:19:14.100929 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:19:14.100903    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpxdj\" (UniqueName: \"kubernetes.io/projected/c3994b84-f782-40ea-8529-0d190f555495-kube-api-access-mpxdj\") pod \"auth-test-model-93e799-kserve-86799bd899-n869l\" (UID: \"c3994b84-f782-40ea-8529-0d190f555495\") " pod="ai-tenant-e2e-shared-b-93e799/auth-test-model-93e799-kserve-86799bd899-n869l"
Jul 29 15:19:14.101067 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:19:14.100937    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3994b84-f782-40ea-8529-0d190f555495-tls-certs\") pod \"auth-test-model-93e799-kserve-86799bd899-n869l\" (UID: \"c3994b84-f782-40ea-8529-0d190f555495\") " pod="ai-tenant-e2e-shared-b-93e799/auth-test-model-93e799-kserve-86799bd899-n869l"
Jul 29 15:19:14.101067 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:19:14.100962    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3994b84-f782-40ea-8529-0d190f555495-model-cache\") pod \"auth-test-model-93e799-kserve-86799bd899-n869l\" (UID: \"c3994b84-f782-40ea-8529-0d190f555495\") " pod="ai-tenant-e2e-shared-b-93e799/auth-test-model-93e799-kserve-86799bd899-n869l"
Jul 29 15:19:14.101067 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:19:14.101054    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3994b84-f782-40ea-8529-0d190f555495-dshm\") pod \"auth-test-model-93e799-kserve-86799bd899-n869l\" (UID: \"c3994b84-f782-40ea-8529-0d190f555495\") " pod="ai-tenant-e2e-shared-b-93e799/auth-test-model-93e799-kserve-86799bd899-n869l"
Jul 29 15:19:14.101264 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:19:14.101086    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3994b84-f782-40ea-8529-0d190f555495-tmp-dir\") pod \"auth-test-model-93e799-kserve-86799bd899-n869l\" (UID: \"c3994b84-f782-40ea-8529-0d190f555495\") " pod="ai-tenant-e2e-shared-b-93e799/auth-test-model-93e799-kserve-86799bd899-n869l"
Jul 29 15:19:14.101264 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:19:14.101220    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3994b84-f782-40ea-8529-0d190f555495-home\") pod \"auth-test-model-93e799-kserve-86799bd899-n869l\" (UID: \"c3994b84-f782-40ea-8529-0d190f555495\") " pod="ai-tenant-e2e-shared-b-93e799/auth-test-model-93e799-kserve-86799bd899-n869l"
Jul 29 15:19:14.202687 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:19:14.202656    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3994b84-f782-40ea-8529-0d190f555495-model-cache\") pod \"auth-test-model-93e799-kserve-86799bd899-n869l\" (UID: \"c3994b84-f782-40ea-8529-0d190f555495\") " pod="ai-tenant-e2e-shared-b-93e799/auth-test-model-93e799-kserve-86799bd899-n869l"
Jul 29 15:19:14.202831 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:19:14.202707    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3994b84-f782-40ea-8529-0d190f555495-dshm\") pod \"auth-test-model-93e799-kserve-86799bd899-n869l\" (UID: \"c3994b84-f782-40ea-8529-0d190f555495\") " pod="ai-tenant-e2e-shared-b-93e799/auth-test-model-93e799-kserve-86799bd899-n869l"
Jul 29 15:19:14.202831 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:19:14.202728    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3994b84-f782-40ea-8529-0d190f555495-tmp-dir\") pod \"auth-test-model-93e799-kserve-86799bd899-n869l\" (UID: \"c3994b84-f782-40ea-8529-0d190f555495\") " pod="ai-tenant-e2e-shared-b-93e799/auth-test-model-93e799-kserve-86799bd899-n869l"
Jul 29 15:19:14.202941 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:19:14.202895    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3994b84-f782-40ea-8529-0d190f555495-home\") pod \"auth-test-model-93e799-kserve-86799bd899-n869l\" (UID: \"c3994b84-f782-40ea-8529-0d190f555495\") " pod="ai-tenant-e2e-shared-b-93e799/auth-test-model-93e799-kserve-86799bd899-n869l"
Jul 29 15:19:14.203094 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:19:14.202984    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpxdj\" (UniqueName: \"kubernetes.io/projected/c3994b84-f782-40ea-8529-0d190f555495-kube-api-access-mpxdj\") pod \"auth-test-model-93e799-kserve-86799bd899-n869l\" (UID: \"c3994b84-f782-40ea-8529-0d190f555495\") " pod="ai-tenant-e2e-shared-b-93e799/auth-test-model-93e799-kserve-86799bd899-n869l"
Jul 29 15:19:14.203094 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:19:14.203016    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3994b84-f782-40ea-8529-0d190f555495-tls-certs\") pod \"auth-test-model-93e799-kserve-86799bd899-n869l\" (UID: \"c3994b84-f782-40ea-8529-0d190f555495\") " pod="ai-tenant-e2e-shared-b-93e799/auth-test-model-93e799-kserve-86799bd899-n869l"
Jul 29 15:19:14.203391 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:19:14.203345    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3994b84-f782-40ea-8529-0d190f555495-tmp-dir\") pod \"auth-test-model-93e799-kserve-86799bd899-n869l\" (UID: \"c3994b84-f782-40ea-8529-0d190f555495\") " pod="ai-tenant-e2e-shared-b-93e799/auth-test-model-93e799-kserve-86799bd899-n869l"
Jul 29 15:19:14.203520 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:19:14.203498    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3994b84-f782-40ea-8529-0d190f555495-home\") pod \"auth-test-model-93e799-kserve-86799bd899-n869l\" (UID: \"c3994b84-f782-40ea-8529-0d190f555495\") " pod="ai-tenant-e2e-shared-b-93e799/auth-test-model-93e799-kserve-86799bd899-n869l"
Jul 29 15:19:14.203777 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:19:14.203759    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3994b84-f782-40ea-8529-0d190f555495-model-cache\") pod \"auth-test-model-93e799-kserve-86799bd899-n869l\" (UID: \"c3994b84-f782-40ea-8529-0d190f555495\") " pod="ai-tenant-e2e-shared-b-93e799/auth-test-model-93e799-kserve-86799bd899-n869l"
Jul 29 15:19:14.205568 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:19:14.205526    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3994b84-f782-40ea-8529-0d190f555495-dshm\") pod \"auth-test-model-93e799-kserve-86799bd899-n869l\" (UID: \"c3994b84-f782-40ea-8529-0d190f555495\") " pod="ai-tenant-e2e-shared-b-93e799/auth-test-model-93e799-kserve-86799bd899-n869l"
Jul 29 15:19:14.206072 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:19:14.206052    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3994b84-f782-40ea-8529-0d190f555495-tls-certs\") pod \"auth-test-model-93e799-kserve-86799bd899-n869l\" (UID: \"c3994b84-f782-40ea-8529-0d190f555495\") " pod="ai-tenant-e2e-shared-b-93e799/auth-test-model-93e799-kserve-86799bd899-n869l"
Jul 29 15:19:14.215256 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:19:14.214015    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpxdj\" (UniqueName: \"kubernetes.io/projected/c3994b84-f782-40ea-8529-0d190f555495-kube-api-access-mpxdj\") pod \"auth-test-model-93e799-kserve-86799bd899-n869l\" (UID: \"c3994b84-f782-40ea-8529-0d190f555495\") " pod="ai-tenant-e2e-shared-b-93e799/auth-test-model-93e799-kserve-86799bd899-n869l"
Jul 29 15:19:14.327105 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:19:14.327036    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-93e799/auth-test-model-93e799-kserve-86799bd899-n869l"
Jul 29 15:19:14.454549 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:19:14.454524    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-93e799/auth-test-model-93e799-kserve-86799bd899-n869l"]
Jul 29 15:19:14.457311 ip-10-0-142-130 kubenswrapper[2578]: W0729 15:19:14.457285    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc3994b84_f782_40ea_8529_0d190f555495.slice/crio-3db2a4762ab7dc6a6bd192868fc917bee5509ff00bbd10b6ddbdc53d0c1ffbc7 WatchSource:0}: Error finding container 3db2a4762ab7dc6a6bd192868fc917bee5509ff00bbd10b6ddbdc53d0c1ffbc7: Status 404 returned error can't find the container with id 3db2a4762ab7dc6a6bd192868fc917bee5509ff00bbd10b6ddbdc53d0c1ffbc7
Jul 29 15:19:15.007542 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:19:15.007508    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-93e799/auth-test-model-93e799-kserve-86799bd899-n869l" event={"ID":"c3994b84-f782-40ea-8529-0d190f555495","Type":"ContainerStarted","Data":"482995507fce78689e59fb3afe3f82f9f1150b19db19a1c87b3094e2ba6be632"}
Jul 29 15:19:15.007542 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:19:15.007548    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-93e799/auth-test-model-93e799-kserve-86799bd899-n869l" event={"ID":"c3994b84-f782-40ea-8529-0d190f555495","Type":"ContainerStarted","Data":"3db2a4762ab7dc6a6bd192868fc917bee5509ff00bbd10b6ddbdc53d0c1ffbc7"}
Jul 29 15:19:15.027607 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:19:15.027561    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-93e799/auth-test-model-93e799-kserve-86799bd899-n869l" podStartSLOduration=2.027546901 podStartE2EDuration="2.027546901s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:19:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:19:15.02702831 +0000 UTC m=+2627.329494918" watchObservedRunningTime="2026-07-29 15:19:15.027546901 +0000 UTC m=+2627.330013507"
Jul 29 15:19:17.820037 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:19:17.819988    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:19:24.328254 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:19:24.328204    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-93e799/auth-test-model-93e799-kserve-86799bd899-n869l"
Jul 29 15:19:24.328727 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:19:24.328266    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-93e799/auth-test-model-93e799-kserve-86799bd899-n869l"
Jul 29 15:19:24.340494 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:19:24.340469    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-93e799/auth-test-model-93e799-kserve-86799bd899-n869l"
Jul 29 15:19:25.062379 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:19:25.062350    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-93e799/auth-test-model-93e799-kserve-86799bd899-n869l"
Jul 29 15:19:42.308650 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:19:42.308612    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:20:02.712738 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:20:02.712704    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:20:15.911575 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:20:15.911542    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:20:36.810970 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:20:36.810760    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:20:52.724892 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:20:52.724858    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:21:13.806524 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:21:13.806482    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:21:30.607917 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:21:30.607880    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:21:51.402945 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:21:51.402871    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:22:09.301155 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:22:09.301120    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:22:29.816495 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:22:29.816462    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:22:42.902293 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:22:42.902257    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:23:04.114125 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:04.114086    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:23:07.002055 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:07.002020    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c73214/auth-test-model-c73214-kserve-579f6cf96c-sjx47"]
Jul 29 15:23:07.891489 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:07.891459    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-93e799/auth-test-model-93e799-kserve-86799bd899-n869l"]
Jul 29 15:23:19.713348 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:19.713311    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:23:22.020471 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.020374    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-c73214/auth-test-model-c73214-kserve-579f6cf96c-sjx47" podUID="9b0a7bd1-b896-41f7-bee8-cf3125370ab8" containerName="main" containerID="cri-o://dd678ad328c8be873aed98ef1bd5bbcfa1990586f604e9a3b85e2eacf6d0c28b" gracePeriod=45
Jul 29 15:23:22.266986 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.266964    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c73214/auth-test-model-c73214-kserve-579f6cf96c-sjx47"
Jul 29 15:23:22.286704 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.286636    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b0a7bd1-b896-41f7-bee8-cf3125370ab8-dshm\") pod \"9b0a7bd1-b896-41f7-bee8-cf3125370ab8\" (UID: \"9b0a7bd1-b896-41f7-bee8-cf3125370ab8\") "
Jul 29 15:23:22.286704 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.286684    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b0a7bd1-b896-41f7-bee8-cf3125370ab8-tmp-dir\") pod \"9b0a7bd1-b896-41f7-bee8-cf3125370ab8\" (UID: \"9b0a7bd1-b896-41f7-bee8-cf3125370ab8\") "
Jul 29 15:23:22.286878 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.286723    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b0a7bd1-b896-41f7-bee8-cf3125370ab8-tls-certs\") pod \"9b0a7bd1-b896-41f7-bee8-cf3125370ab8\" (UID: \"9b0a7bd1-b896-41f7-bee8-cf3125370ab8\") "
Jul 29 15:23:22.286878 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.286788    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b0a7bd1-b896-41f7-bee8-cf3125370ab8-model-cache\") pod \"9b0a7bd1-b896-41f7-bee8-cf3125370ab8\" (UID: \"9b0a7bd1-b896-41f7-bee8-cf3125370ab8\") "
Jul 29 15:23:22.286878 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.286822    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dn7lx\" (UniqueName: \"kubernetes.io/projected/9b0a7bd1-b896-41f7-bee8-cf3125370ab8-kube-api-access-dn7lx\") pod \"9b0a7bd1-b896-41f7-bee8-cf3125370ab8\" (UID: \"9b0a7bd1-b896-41f7-bee8-cf3125370ab8\") "
Jul 29 15:23:22.286878 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.286857    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b0a7bd1-b896-41f7-bee8-cf3125370ab8-home\") pod \"9b0a7bd1-b896-41f7-bee8-cf3125370ab8\" (UID: \"9b0a7bd1-b896-41f7-bee8-cf3125370ab8\") "
Jul 29 15:23:22.287076 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.286907    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b0a7bd1-b896-41f7-bee8-cf3125370ab8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9b0a7bd1-b896-41f7-bee8-cf3125370ab8" (UID: "9b0a7bd1-b896-41f7-bee8-cf3125370ab8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:23:22.287076 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.286998    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b0a7bd1-b896-41f7-bee8-cf3125370ab8-model-cache" (OuterVolumeSpecName: "model-cache") pod "9b0a7bd1-b896-41f7-bee8-cf3125370ab8" (UID: "9b0a7bd1-b896-41f7-bee8-cf3125370ab8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:23:22.287265 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.287220    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b0a7bd1-b896-41f7-bee8-cf3125370ab8-home" (OuterVolumeSpecName: "home") pod "9b0a7bd1-b896-41f7-bee8-cf3125370ab8" (UID: "9b0a7bd1-b896-41f7-bee8-cf3125370ab8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:23:22.287351 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.287261    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b0a7bd1-b896-41f7-bee8-cf3125370ab8-model-cache\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:23:22.287351 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.287282    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b0a7bd1-b896-41f7-bee8-cf3125370ab8-tmp-dir\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:23:22.289191 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.289164    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b0a7bd1-b896-41f7-bee8-cf3125370ab8-dshm" (OuterVolumeSpecName: "dshm") pod "9b0a7bd1-b896-41f7-bee8-cf3125370ab8" (UID: "9b0a7bd1-b896-41f7-bee8-cf3125370ab8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:23:22.289424 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.289386    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b0a7bd1-b896-41f7-bee8-cf3125370ab8-kube-api-access-dn7lx" (OuterVolumeSpecName: "kube-api-access-dn7lx") pod "9b0a7bd1-b896-41f7-bee8-cf3125370ab8" (UID: "9b0a7bd1-b896-41f7-bee8-cf3125370ab8"). InnerVolumeSpecName "kube-api-access-dn7lx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 15:23:22.289524 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.289477    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b0a7bd1-b896-41f7-bee8-cf3125370ab8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9b0a7bd1-b896-41f7-bee8-cf3125370ab8" (UID: "9b0a7bd1-b896-41f7-bee8-cf3125370ab8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 15:23:22.387686 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.387658    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b0a7bd1-b896-41f7-bee8-cf3125370ab8-home\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:23:22.387686 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.387681    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b0a7bd1-b896-41f7-bee8-cf3125370ab8-dshm\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:23:22.387686 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.387690    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b0a7bd1-b896-41f7-bee8-cf3125370ab8-tls-certs\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:23:22.387883 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.387698    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dn7lx\" (UniqueName: \"kubernetes.io/projected/9b0a7bd1-b896-41f7-bee8-cf3125370ab8-kube-api-access-dn7lx\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:23:22.717772 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.717698    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-c73214/sub-test-model-c73214-kserve-7df548968c-56xpl"]
Jul 29 15:23:22.718068 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.718050    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b0a7bd1-b896-41f7-bee8-cf3125370ab8" containerName="main"
Jul 29 15:23:22.718068 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.718065    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b0a7bd1-b896-41f7-bee8-cf3125370ab8" containerName="main"
Jul 29 15:23:22.718185 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.718132    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b0a7bd1-b896-41f7-bee8-cf3125370ab8" containerName="main"
Jul 29 15:23:22.721200 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.721185    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c73214/sub-test-model-c73214-kserve-7df548968c-56xpl"
Jul 29 15:23:22.723822 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.723804    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-c73214\"/\"sub-test-model-c73214-kserve-self-signed-certs\""
Jul 29 15:23:22.731622 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.731593    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c73214/sub-test-model-c73214-kserve-7df548968c-56xpl"]
Jul 29 15:23:22.791346 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.791318    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4bwq\" (UniqueName: \"kubernetes.io/projected/cb88d232-4934-4085-8fc2-34cfafdfdc0e-kube-api-access-r4bwq\") pod \"sub-test-model-c73214-kserve-7df548968c-56xpl\" (UID: \"cb88d232-4934-4085-8fc2-34cfafdfdc0e\") " pod="ai-tenant-e2e-shared-a-c73214/sub-test-model-c73214-kserve-7df548968c-56xpl"
Jul 29 15:23:22.791464 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.791367    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb88d232-4934-4085-8fc2-34cfafdfdc0e-model-cache\") pod \"sub-test-model-c73214-kserve-7df548968c-56xpl\" (UID: \"cb88d232-4934-4085-8fc2-34cfafdfdc0e\") " pod="ai-tenant-e2e-shared-a-c73214/sub-test-model-c73214-kserve-7df548968c-56xpl"
Jul 29 15:23:22.791464 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.791453    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb88d232-4934-4085-8fc2-34cfafdfdc0e-tls-certs\") pod \"sub-test-model-c73214-kserve-7df548968c-56xpl\" (UID: \"cb88d232-4934-4085-8fc2-34cfafdfdc0e\") " pod="ai-tenant-e2e-shared-a-c73214/sub-test-model-c73214-kserve-7df548968c-56xpl"
Jul 29 15:23:22.791540 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.791490    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb88d232-4934-4085-8fc2-34cfafdfdc0e-dshm\") pod \"sub-test-model-c73214-kserve-7df548968c-56xpl\" (UID: \"cb88d232-4934-4085-8fc2-34cfafdfdc0e\") " pod="ai-tenant-e2e-shared-a-c73214/sub-test-model-c73214-kserve-7df548968c-56xpl"
Jul 29 15:23:22.791540 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.791515    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb88d232-4934-4085-8fc2-34cfafdfdc0e-tmp-dir\") pod \"sub-test-model-c73214-kserve-7df548968c-56xpl\" (UID: \"cb88d232-4934-4085-8fc2-34cfafdfdc0e\") " pod="ai-tenant-e2e-shared-a-c73214/sub-test-model-c73214-kserve-7df548968c-56xpl"
Jul 29 15:23:22.791604 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.791552    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb88d232-4934-4085-8fc2-34cfafdfdc0e-home\") pod \"sub-test-model-c73214-kserve-7df548968c-56xpl\" (UID: \"cb88d232-4934-4085-8fc2-34cfafdfdc0e\") " pod="ai-tenant-e2e-shared-a-c73214/sub-test-model-c73214-kserve-7df548968c-56xpl"
Jul 29 15:23:22.892771 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.892746    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb88d232-4934-4085-8fc2-34cfafdfdc0e-tmp-dir\") pod \"sub-test-model-c73214-kserve-7df548968c-56xpl\" (UID: \"cb88d232-4934-4085-8fc2-34cfafdfdc0e\") " pod="ai-tenant-e2e-shared-a-c73214/sub-test-model-c73214-kserve-7df548968c-56xpl"
Jul 29 15:23:22.892883 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.892773    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb88d232-4934-4085-8fc2-34cfafdfdc0e-home\") pod \"sub-test-model-c73214-kserve-7df548968c-56xpl\" (UID: \"cb88d232-4934-4085-8fc2-34cfafdfdc0e\") " pod="ai-tenant-e2e-shared-a-c73214/sub-test-model-c73214-kserve-7df548968c-56xpl"
Jul 29 15:23:22.892883 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.892802    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4bwq\" (UniqueName: \"kubernetes.io/projected/cb88d232-4934-4085-8fc2-34cfafdfdc0e-kube-api-access-r4bwq\") pod \"sub-test-model-c73214-kserve-7df548968c-56xpl\" (UID: \"cb88d232-4934-4085-8fc2-34cfafdfdc0e\") " pod="ai-tenant-e2e-shared-a-c73214/sub-test-model-c73214-kserve-7df548968c-56xpl"
Jul 29 15:23:22.892974 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.892920    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb88d232-4934-4085-8fc2-34cfafdfdc0e-model-cache\") pod \"sub-test-model-c73214-kserve-7df548968c-56xpl\" (UID: \"cb88d232-4934-4085-8fc2-34cfafdfdc0e\") " pod="ai-tenant-e2e-shared-a-c73214/sub-test-model-c73214-kserve-7df548968c-56xpl"
Jul 29 15:23:22.893026 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.892995    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb88d232-4934-4085-8fc2-34cfafdfdc0e-tls-certs\") pod \"sub-test-model-c73214-kserve-7df548968c-56xpl\" (UID: \"cb88d232-4934-4085-8fc2-34cfafdfdc0e\") " pod="ai-tenant-e2e-shared-a-c73214/sub-test-model-c73214-kserve-7df548968c-56xpl"
Jul 29 15:23:22.893084 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.893040    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb88d232-4934-4085-8fc2-34cfafdfdc0e-dshm\") pod \"sub-test-model-c73214-kserve-7df548968c-56xpl\" (UID: \"cb88d232-4934-4085-8fc2-34cfafdfdc0e\") " pod="ai-tenant-e2e-shared-a-c73214/sub-test-model-c73214-kserve-7df548968c-56xpl"
Jul 29 15:23:22.893148 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.893105    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb88d232-4934-4085-8fc2-34cfafdfdc0e-home\") pod \"sub-test-model-c73214-kserve-7df548968c-56xpl\" (UID: \"cb88d232-4934-4085-8fc2-34cfafdfdc0e\") " pod="ai-tenant-e2e-shared-a-c73214/sub-test-model-c73214-kserve-7df548968c-56xpl"
Jul 29 15:23:22.893202 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.893157    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb88d232-4934-4085-8fc2-34cfafdfdc0e-tmp-dir\") pod \"sub-test-model-c73214-kserve-7df548968c-56xpl\" (UID: \"cb88d232-4934-4085-8fc2-34cfafdfdc0e\") " pod="ai-tenant-e2e-shared-a-c73214/sub-test-model-c73214-kserve-7df548968c-56xpl"
Jul 29 15:23:22.893336 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.893315    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb88d232-4934-4085-8fc2-34cfafdfdc0e-model-cache\") pod \"sub-test-model-c73214-kserve-7df548968c-56xpl\" (UID: \"cb88d232-4934-4085-8fc2-34cfafdfdc0e\") " pod="ai-tenant-e2e-shared-a-c73214/sub-test-model-c73214-kserve-7df548968c-56xpl"
Jul 29 15:23:22.895121 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.895103    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb88d232-4934-4085-8fc2-34cfafdfdc0e-dshm\") pod \"sub-test-model-c73214-kserve-7df548968c-56xpl\" (UID: \"cb88d232-4934-4085-8fc2-34cfafdfdc0e\") " pod="ai-tenant-e2e-shared-a-c73214/sub-test-model-c73214-kserve-7df548968c-56xpl"
Jul 29 15:23:22.895348 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.895326    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb88d232-4934-4085-8fc2-34cfafdfdc0e-tls-certs\") pod \"sub-test-model-c73214-kserve-7df548968c-56xpl\" (UID: \"cb88d232-4934-4085-8fc2-34cfafdfdc0e\") " pod="ai-tenant-e2e-shared-a-c73214/sub-test-model-c73214-kserve-7df548968c-56xpl"
Jul 29 15:23:22.901057 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.901035    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4bwq\" (UniqueName: \"kubernetes.io/projected/cb88d232-4934-4085-8fc2-34cfafdfdc0e-kube-api-access-r4bwq\") pod \"sub-test-model-c73214-kserve-7df548968c-56xpl\" (UID: \"cb88d232-4934-4085-8fc2-34cfafdfdc0e\") " pod="ai-tenant-e2e-shared-a-c73214/sub-test-model-c73214-kserve-7df548968c-56xpl"
Jul 29 15:23:22.910186 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:22.910153    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-93e799/auth-test-model-93e799-kserve-86799bd899-n869l" podUID="c3994b84-f782-40ea-8529-0d190f555495" containerName="main" containerID="cri-o://482995507fce78689e59fb3afe3f82f9f1150b19db19a1c87b3094e2ba6be632" gracePeriod=45
Jul 29 15:23:23.029680 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:23.029650    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c73214/sub-test-model-c73214-kserve-7df548968c-56xpl"
Jul 29 15:23:23.118345 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:23.118221    2578 generic.go:356] "Generic (PLEG): container finished" podID="c3994b84-f782-40ea-8529-0d190f555495" containerID="482995507fce78689e59fb3afe3f82f9f1150b19db19a1c87b3094e2ba6be632" exitCode=0
Jul 29 15:23:23.118345 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:23.118293    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-93e799/auth-test-model-93e799-kserve-86799bd899-n869l" event={"ID":"c3994b84-f782-40ea-8529-0d190f555495","Type":"ContainerDied","Data":"482995507fce78689e59fb3afe3f82f9f1150b19db19a1c87b3094e2ba6be632"}
Jul 29 15:23:23.119924 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:23.119891    2578 generic.go:356] "Generic (PLEG): container finished" podID="9b0a7bd1-b896-41f7-bee8-cf3125370ab8" containerID="dd678ad328c8be873aed98ef1bd5bbcfa1990586f604e9a3b85e2eacf6d0c28b" exitCode=0
Jul 29 15:23:23.120051 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:23.119956    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c73214/auth-test-model-c73214-kserve-579f6cf96c-sjx47"
Jul 29 15:23:23.120051 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:23.119979    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c73214/auth-test-model-c73214-kserve-579f6cf96c-sjx47" event={"ID":"9b0a7bd1-b896-41f7-bee8-cf3125370ab8","Type":"ContainerDied","Data":"dd678ad328c8be873aed98ef1bd5bbcfa1990586f604e9a3b85e2eacf6d0c28b"}
Jul 29 15:23:23.120051 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:23.120007    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c73214/auth-test-model-c73214-kserve-579f6cf96c-sjx47" event={"ID":"9b0a7bd1-b896-41f7-bee8-cf3125370ab8","Type":"ContainerDied","Data":"ec14b492b582d5954f28705489c95d39aedbee089271ef621d7358326c4cde0b"}
Jul 29 15:23:23.120051 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:23.120029    2578 scope.go:117] "RemoveContainer" containerID="dd678ad328c8be873aed98ef1bd5bbcfa1990586f604e9a3b85e2eacf6d0c28b"
Jul 29 15:23:23.131366 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:23.131323    2578 scope.go:117] "RemoveContainer" containerID="dd678ad328c8be873aed98ef1bd5bbcfa1990586f604e9a3b85e2eacf6d0c28b"
Jul 29 15:23:23.131646 ip-10-0-142-130 kubenswrapper[2578]: E0729 15:23:23.131627    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd678ad328c8be873aed98ef1bd5bbcfa1990586f604e9a3b85e2eacf6d0c28b\": container with ID starting with dd678ad328c8be873aed98ef1bd5bbcfa1990586f604e9a3b85e2eacf6d0c28b not found: ID does not exist" containerID="dd678ad328c8be873aed98ef1bd5bbcfa1990586f604e9a3b85e2eacf6d0c28b"
Jul 29 15:23:23.131709 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:23.131655    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd678ad328c8be873aed98ef1bd5bbcfa1990586f604e9a3b85e2eacf6d0c28b"} err="failed to get container status \"dd678ad328c8be873aed98ef1bd5bbcfa1990586f604e9a3b85e2eacf6d0c28b\": rpc error: code = NotFound desc = could not find container \"dd678ad328c8be873aed98ef1bd5bbcfa1990586f604e9a3b85e2eacf6d0c28b\": container with ID starting with dd678ad328c8be873aed98ef1bd5bbcfa1990586f604e9a3b85e2eacf6d0c28b not found: ID does not exist"
Jul 29 15:23:23.145890 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:23.145867    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c73214/auth-test-model-c73214-kserve-579f6cf96c-sjx47"]
Jul 29 15:23:23.150796 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:23.150771    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-c73214/auth-test-model-c73214-kserve-579f6cf96c-sjx47"]
Jul 29 15:23:23.166663 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:23.166642    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c73214/sub-test-model-c73214-kserve-7df548968c-56xpl"]
Jul 29 15:23:23.168285 ip-10-0-142-130 kubenswrapper[2578]: W0729 15:23:23.168260    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb88d232_4934_4085_8fc2_34cfafdfdc0e.slice/crio-147df9ff150826cc26584fe93de720baf51a271595166b1ea38cd09fbbf15a6a WatchSource:0}: Error finding container 147df9ff150826cc26584fe93de720baf51a271595166b1ea38cd09fbbf15a6a: Status 404 returned error can't find the container with id 147df9ff150826cc26584fe93de720baf51a271595166b1ea38cd09fbbf15a6a
Jul 29 15:23:23.174184 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:23.174166    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-93e799/auth-test-model-93e799-kserve-86799bd899-n869l"
Jul 29 15:23:23.195477 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:23.195457    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3994b84-f782-40ea-8529-0d190f555495-tmp-dir\") pod \"c3994b84-f782-40ea-8529-0d190f555495\" (UID: \"c3994b84-f782-40ea-8529-0d190f555495\") "
Jul 29 15:23:23.195606 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:23.195498    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mpxdj\" (UniqueName: \"kubernetes.io/projected/c3994b84-f782-40ea-8529-0d190f555495-kube-api-access-mpxdj\") pod \"c3994b84-f782-40ea-8529-0d190f555495\" (UID: \"c3994b84-f782-40ea-8529-0d190f555495\") "
Jul 29 15:23:23.195606 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:23.195520    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3994b84-f782-40ea-8529-0d190f555495-tls-certs\") pod \"c3994b84-f782-40ea-8529-0d190f555495\" (UID: \"c3994b84-f782-40ea-8529-0d190f555495\") "
Jul 29 15:23:23.195723 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:23.195614    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3994b84-f782-40ea-8529-0d190f555495-home\") pod \"c3994b84-f782-40ea-8529-0d190f555495\" (UID: \"c3994b84-f782-40ea-8529-0d190f555495\") "
Jul 29 15:23:23.195723 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:23.195657    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3994b84-f782-40ea-8529-0d190f555495-dshm\") pod \"c3994b84-f782-40ea-8529-0d190f555495\" (UID: \"c3994b84-f782-40ea-8529-0d190f555495\") "
Jul 29 15:23:23.195723 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:23.195708    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3994b84-f782-40ea-8529-0d190f555495-model-cache\") pod \"c3994b84-f782-40ea-8529-0d190f555495\" (UID: \"c3994b84-f782-40ea-8529-0d190f555495\") "
Jul 29 15:23:23.195875 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:23.195721    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3994b84-f782-40ea-8529-0d190f555495-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c3994b84-f782-40ea-8529-0d190f555495" (UID: "c3994b84-f782-40ea-8529-0d190f555495"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:23:23.195942 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:23.195876    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3994b84-f782-40ea-8529-0d190f555495-home" (OuterVolumeSpecName: "home") pod "c3994b84-f782-40ea-8529-0d190f555495" (UID: "c3994b84-f782-40ea-8529-0d190f555495"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:23:23.196107 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:23.196086    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3994b84-f782-40ea-8529-0d190f555495-home\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:23:23.196171 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:23.196118    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3994b84-f782-40ea-8529-0d190f555495-tmp-dir\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:23:23.196171 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:23.196088    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3994b84-f782-40ea-8529-0d190f555495-model-cache" (OuterVolumeSpecName: "model-cache") pod "c3994b84-f782-40ea-8529-0d190f555495" (UID: "c3994b84-f782-40ea-8529-0d190f555495"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:23:23.198037 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:23.198014    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3994b84-f782-40ea-8529-0d190f555495-dshm" (OuterVolumeSpecName: "dshm") pod "c3994b84-f782-40ea-8529-0d190f555495" (UID: "c3994b84-f782-40ea-8529-0d190f555495"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:23:23.198286 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:23.198258    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3994b84-f782-40ea-8529-0d190f555495-kube-api-access-mpxdj" (OuterVolumeSpecName: "kube-api-access-mpxdj") pod "c3994b84-f782-40ea-8529-0d190f555495" (UID: "c3994b84-f782-40ea-8529-0d190f555495"). InnerVolumeSpecName "kube-api-access-mpxdj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 15:23:23.198381 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:23.198346    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3994b84-f782-40ea-8529-0d190f555495-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c3994b84-f782-40ea-8529-0d190f555495" (UID: "c3994b84-f782-40ea-8529-0d190f555495"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 15:23:23.297135 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:23.297055    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mpxdj\" (UniqueName: \"kubernetes.io/projected/c3994b84-f782-40ea-8529-0d190f555495-kube-api-access-mpxdj\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:23:23.297135 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:23.297084    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3994b84-f782-40ea-8529-0d190f555495-tls-certs\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:23:23.297135 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:23.297095    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3994b84-f782-40ea-8529-0d190f555495-dshm\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:23:23.297135 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:23.297105    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3994b84-f782-40ea-8529-0d190f555495-model-cache\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:23:24.126555 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:24.126532    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-93e799/auth-test-model-93e799-kserve-86799bd899-n869l"
Jul 29 15:23:24.126961 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:24.126531    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-93e799/auth-test-model-93e799-kserve-86799bd899-n869l" event={"ID":"c3994b84-f782-40ea-8529-0d190f555495","Type":"ContainerDied","Data":"3db2a4762ab7dc6a6bd192868fc917bee5509ff00bbd10b6ddbdc53d0c1ffbc7"}
Jul 29 15:23:24.126961 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:24.126661    2578 scope.go:117] "RemoveContainer" containerID="482995507fce78689e59fb3afe3f82f9f1150b19db19a1c87b3094e2ba6be632"
Jul 29 15:23:24.128182 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:24.128157    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c73214/sub-test-model-c73214-kserve-7df548968c-56xpl" event={"ID":"cb88d232-4934-4085-8fc2-34cfafdfdc0e","Type":"ContainerStarted","Data":"b81a41b373663e3625f35327c5979f66e94eb4694de3beaf5f5f72a8a3536139"}
Jul 29 15:23:24.128295 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:24.128195    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c73214/sub-test-model-c73214-kserve-7df548968c-56xpl" event={"ID":"cb88d232-4934-4085-8fc2-34cfafdfdc0e","Type":"ContainerStarted","Data":"147df9ff150826cc26584fe93de720baf51a271595166b1ea38cd09fbbf15a6a"}
Jul 29 15:23:24.149174 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:24.149134    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-c73214/sub-test-model-c73214-kserve-7df548968c-56xpl" podStartSLOduration=2.149122233 podStartE2EDuration="2.149122233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:23:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:23:24.147973029 +0000 UTC m=+2876.450439635" watchObservedRunningTime="2026-07-29 15:23:24.149122233 +0000 UTC m=+2876.451588839"
Jul 29 15:23:24.161604 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:24.161580    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-93e799/auth-test-model-93e799-kserve-86799bd899-n869l"]
Jul 29 15:23:24.165336 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:24.165318    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-93e799/auth-test-model-93e799-kserve-86799bd899-n869l"]
Jul 29 15:23:24.278007 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:24.277979    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b0a7bd1-b896-41f7-bee8-cf3125370ab8" path="/var/lib/kubelet/pods/9b0a7bd1-b896-41f7-bee8-cf3125370ab8/volumes"
Jul 29 15:23:24.278408 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:24.278392    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3994b84-f782-40ea-8529-0d190f555495" path="/var/lib/kubelet/pods/c3994b84-f782-40ea-8529-0d190f555495/volumes"
Jul 29 15:23:26.913991 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:26.913954    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:23:33.029972 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:33.029931    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-c73214/sub-test-model-c73214-kserve-7df548968c-56xpl"
Jul 29 15:23:33.030362 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:33.029988    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-c73214/sub-test-model-c73214-kserve-7df548968c-56xpl"
Jul 29 15:23:33.041666 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:33.041642    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-c73214/sub-test-model-c73214-kserve-7df548968c-56xpl"
Jul 29 15:23:33.180764 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:23:33.180737    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-c73214/sub-test-model-c73214-kserve-7df548968c-56xpl"
Jul 29 15:24:02.912969 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:24:02.912934    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-93e799/sub-test-model-93e799-kserve-7c4db96587-wmw8t"]
Jul 29 15:24:02.913462 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:24:02.913275    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3994b84-f782-40ea-8529-0d190f555495" containerName="main"
Jul 29 15:24:02.913462 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:24:02.913287    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3994b84-f782-40ea-8529-0d190f555495" containerName="main"
Jul 29 15:24:02.913462 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:24:02.913356    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3994b84-f782-40ea-8529-0d190f555495" containerName="main"
Jul 29 15:24:02.916427 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:24:02.916409    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-93e799/sub-test-model-93e799-kserve-7c4db96587-wmw8t"
Jul 29 15:24:02.919556 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:24:02.919531    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-93e799\"/\"openshift-service-ca.crt\""
Jul 29 15:24:02.920912 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:24:02.920889    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-93e799\"/\"default-dockercfg-wvpcl\""
Jul 29 15:24:02.921042 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:24:02.920896    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-93e799\"/\"sub-test-model-93e799-kserve-self-signed-certs\""
Jul 29 15:24:02.921042 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:24:02.920944    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-93e799\"/\"kube-root-ca.crt\""
Jul 29 15:24:02.926673 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:24:02.926651    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-93e799/sub-test-model-93e799-kserve-7c4db96587-wmw8t"]
Jul 29 15:24:03.052449 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:24:03.052415    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3542b748-a61d-4eee-b96c-f0aa06ffdfb4-tmp-dir\") pod \"sub-test-model-93e799-kserve-7c4db96587-wmw8t\" (UID: \"3542b748-a61d-4eee-b96c-f0aa06ffdfb4\") " pod="ai-tenant-e2e-shared-b-93e799/sub-test-model-93e799-kserve-7c4db96587-wmw8t"
Jul 29 15:24:03.052449 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:24:03.052452    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3542b748-a61d-4eee-b96c-f0aa06ffdfb4-dshm\") pod \"sub-test-model-93e799-kserve-7c4db96587-wmw8t\" (UID: \"3542b748-a61d-4eee-b96c-f0aa06ffdfb4\") " pod="ai-tenant-e2e-shared-b-93e799/sub-test-model-93e799-kserve-7c4db96587-wmw8t"
Jul 29 15:24:03.052645 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:24:03.052499    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3542b748-a61d-4eee-b96c-f0aa06ffdfb4-model-cache\") pod \"sub-test-model-93e799-kserve-7c4db96587-wmw8t\" (UID: \"3542b748-a61d-4eee-b96c-f0aa06ffdfb4\") " pod="ai-tenant-e2e-shared-b-93e799/sub-test-model-93e799-kserve-7c4db96587-wmw8t"
Jul 29 15:24:03.052645 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:24:03.052567    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3542b748-a61d-4eee-b96c-f0aa06ffdfb4-tls-certs\") pod \"sub-test-model-93e799-kserve-7c4db96587-wmw8t\" (UID: \"3542b748-a61d-4eee-b96c-f0aa06ffdfb4\") " pod="ai-tenant-e2e-shared-b-93e799/sub-test-model-93e799-kserve-7c4db96587-wmw8t"
Jul 29 15:24:03.052645 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:24:03.052593    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4ngp\" (UniqueName: \"kubernetes.io/projected/3542b748-a61d-4eee-b96c-f0aa06ffdfb4-kube-api-access-t4ngp\") pod \"sub-test-model-93e799-kserve-7c4db96587-wmw8t\" (UID: \"3542b748-a61d-4eee-b96c-f0aa06ffdfb4\") " pod="ai-tenant-e2e-shared-b-93e799/sub-test-model-93e799-kserve-7c4db96587-wmw8t"
Jul 29 15:24:03.052645 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:24:03.052610    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3542b748-a61d-4eee-b96c-f0aa06ffdfb4-home\") pod \"sub-test-model-93e799-kserve-7c4db96587-wmw8t\" (UID: \"3542b748-a61d-4eee-b96c-f0aa06ffdfb4\") " pod="ai-tenant-e2e-shared-b-93e799/sub-test-model-93e799-kserve-7c4db96587-wmw8t"
Jul 29 15:24:03.153600 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:24:03.153562    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4ngp\" (UniqueName: \"kubernetes.io/projected/3542b748-a61d-4eee-b96c-f0aa06ffdfb4-kube-api-access-t4ngp\") pod \"sub-test-model-93e799-kserve-7c4db96587-wmw8t\" (UID: \"3542b748-a61d-4eee-b96c-f0aa06ffdfb4\") " pod="ai-tenant-e2e-shared-b-93e799/sub-test-model-93e799-kserve-7c4db96587-wmw8t"
Jul 29 15:24:03.153600 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:24:03.153601    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3542b748-a61d-4eee-b96c-f0aa06ffdfb4-home\") pod \"sub-test-model-93e799-kserve-7c4db96587-wmw8t\" (UID: \"3542b748-a61d-4eee-b96c-f0aa06ffdfb4\") " pod="ai-tenant-e2e-shared-b-93e799/sub-test-model-93e799-kserve-7c4db96587-wmw8t"
Jul 29 15:24:03.153858 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:24:03.153643    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3542b748-a61d-4eee-b96c-f0aa06ffdfb4-tmp-dir\") pod \"sub-test-model-93e799-kserve-7c4db96587-wmw8t\" (UID: \"3542b748-a61d-4eee-b96c-f0aa06ffdfb4\") " pod="ai-tenant-e2e-shared-b-93e799/sub-test-model-93e799-kserve-7c4db96587-wmw8t"
Jul 29 15:24:03.153858 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:24:03.153670    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3542b748-a61d-4eee-b96c-f0aa06ffdfb4-dshm\") pod \"sub-test-model-93e799-kserve-7c4db96587-wmw8t\" (UID: \"3542b748-a61d-4eee-b96c-f0aa06ffdfb4\") " pod="ai-tenant-e2e-shared-b-93e799/sub-test-model-93e799-kserve-7c4db96587-wmw8t"
Jul 29 15:24:03.153858 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:24:03.153715    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3542b748-a61d-4eee-b96c-f0aa06ffdfb4-model-cache\") pod \"sub-test-model-93e799-kserve-7c4db96587-wmw8t\" (UID: \"3542b748-a61d-4eee-b96c-f0aa06ffdfb4\") " pod="ai-tenant-e2e-shared-b-93e799/sub-test-model-93e799-kserve-7c4db96587-wmw8t"
Jul 29 15:24:03.153858 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:24:03.153801    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3542b748-a61d-4eee-b96c-f0aa06ffdfb4-tls-certs\") pod \"sub-test-model-93e799-kserve-7c4db96587-wmw8t\" (UID: \"3542b748-a61d-4eee-b96c-f0aa06ffdfb4\") " pod="ai-tenant-e2e-shared-b-93e799/sub-test-model-93e799-kserve-7c4db96587-wmw8t"
Jul 29 15:24:03.154095 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:24:03.154073    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3542b748-a61d-4eee-b96c-f0aa06ffdfb4-home\") pod \"sub-test-model-93e799-kserve-7c4db96587-wmw8t\" (UID: \"3542b748-a61d-4eee-b96c-f0aa06ffdfb4\") " pod="ai-tenant-e2e-shared-b-93e799/sub-test-model-93e799-kserve-7c4db96587-wmw8t"
Jul 29 15:24:03.154150 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:24:03.154098    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3542b748-a61d-4eee-b96c-f0aa06ffdfb4-tmp-dir\") pod \"sub-test-model-93e799-kserve-7c4db96587-wmw8t\" (UID: \"3542b748-a61d-4eee-b96c-f0aa06ffdfb4\") " pod="ai-tenant-e2e-shared-b-93e799/sub-test-model-93e799-kserve-7c4db96587-wmw8t"
Jul 29 15:24:03.154187 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:24:03.154166    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3542b748-a61d-4eee-b96c-f0aa06ffdfb4-model-cache\") pod \"sub-test-model-93e799-kserve-7c4db96587-wmw8t\" (UID: \"3542b748-a61d-4eee-b96c-f0aa06ffdfb4\") " pod="ai-tenant-e2e-shared-b-93e799/sub-test-model-93e799-kserve-7c4db96587-wmw8t"
Jul 29 15:24:03.155944 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:24:03.155924    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3542b748-a61d-4eee-b96c-f0aa06ffdfb4-dshm\") pod \"sub-test-model-93e799-kserve-7c4db96587-wmw8t\" (UID: \"3542b748-a61d-4eee-b96c-f0aa06ffdfb4\") " pod="ai-tenant-e2e-shared-b-93e799/sub-test-model-93e799-kserve-7c4db96587-wmw8t"
Jul 29 15:24:03.156227 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:24:03.156206    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3542b748-a61d-4eee-b96c-f0aa06ffdfb4-tls-certs\") pod \"sub-test-model-93e799-kserve-7c4db96587-wmw8t\" (UID: \"3542b748-a61d-4eee-b96c-f0aa06ffdfb4\") " pod="ai-tenant-e2e-shared-b-93e799/sub-test-model-93e799-kserve-7c4db96587-wmw8t"
Jul 29 15:24:03.162850 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:24:03.162829    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4ngp\" (UniqueName: \"kubernetes.io/projected/3542b748-a61d-4eee-b96c-f0aa06ffdfb4-kube-api-access-t4ngp\") pod \"sub-test-model-93e799-kserve-7c4db96587-wmw8t\" (UID: \"3542b748-a61d-4eee-b96c-f0aa06ffdfb4\") " pod="ai-tenant-e2e-shared-b-93e799/sub-test-model-93e799-kserve-7c4db96587-wmw8t"
Jul 29 15:24:03.227457 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:24:03.227387    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-93e799/sub-test-model-93e799-kserve-7c4db96587-wmw8t"
Jul 29 15:24:03.355052 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:24:03.355025    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-93e799/sub-test-model-93e799-kserve-7c4db96587-wmw8t"]
Jul 29 15:24:03.356829 ip-10-0-142-130 kubenswrapper[2578]: W0729 15:24:03.356800    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3542b748_a61d_4eee_b96c_f0aa06ffdfb4.slice/crio-1dd507a4b97339ae06dfa0d0727ca285ae97769bac9f2a1e72476d0f9cbc2dfc WatchSource:0}: Error finding container 1dd507a4b97339ae06dfa0d0727ca285ae97769bac9f2a1e72476d0f9cbc2dfc: Status 404 returned error can't find the container with id 1dd507a4b97339ae06dfa0d0727ca285ae97769bac9f2a1e72476d0f9cbc2dfc
Jul 29 15:24:04.312747 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:24:04.312708    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-93e799/sub-test-model-93e799-kserve-7c4db96587-wmw8t" event={"ID":"3542b748-a61d-4eee-b96c-f0aa06ffdfb4","Type":"ContainerStarted","Data":"bcd28eab643a4cad8e102f9375bf5efc6d77c0eb0d47c44556a40fa91ab85e0d"}
Jul 29 15:24:04.312747 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:24:04.312748    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-93e799/sub-test-model-93e799-kserve-7c4db96587-wmw8t" event={"ID":"3542b748-a61d-4eee-b96c-f0aa06ffdfb4","Type":"ContainerStarted","Data":"1dd507a4b97339ae06dfa0d0727ca285ae97769bac9f2a1e72476d0f9cbc2dfc"}
Jul 29 15:24:04.331603 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:24:04.331555    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-93e799/sub-test-model-93e799-kserve-7c4db96587-wmw8t" podStartSLOduration=2.331540754 podStartE2EDuration="2.331540754s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:24:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:24:04.330803013 +0000 UTC m=+2916.633269620" watchObservedRunningTime="2026-07-29 15:24:04.331540754 +0000 UTC m=+2916.634007339"
Jul 29 15:24:06.407065 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:24:06.407031    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:24:13.227727 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:24:13.227695    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-93e799/sub-test-model-93e799-kserve-7c4db96587-wmw8t"
Jul 29 15:24:13.228115 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:24:13.227741    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-93e799/sub-test-model-93e799-kserve-7c4db96587-wmw8t"
Jul 29 15:24:13.239535 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:24:13.239512    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-93e799/sub-test-model-93e799-kserve-7c4db96587-wmw8t"
Jul 29 15:24:13.368269 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:24:13.368230    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-93e799/sub-test-model-93e799-kserve-7c4db96587-wmw8t"
Jul 29 15:24:42.706425 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:24:42.706388    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:25:01.512733 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:01.512646    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:25:08.676754 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:08.676718    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c73214/sub-test-model-c73214-kserve-7df548968c-56xpl"]
Jul 29 15:25:09.610036 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:09.610004    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-93e799/sub-test-model-93e799-kserve-7c4db96587-wmw8t"]
Jul 29 15:25:14.506734 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:14.506699    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-c73214/rate-test-model-c73214-kserve-5488f58987-9lbc4"]
Jul 29 15:25:14.510029 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:14.510011    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c73214/rate-test-model-c73214-kserve-5488f58987-9lbc4"
Jul 29 15:25:14.512624 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:14.512606    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-c73214\"/\"rate-test-model-c73214-kserve-self-signed-certs\""
Jul 29 15:25:14.518615 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:14.518594    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c73214/rate-test-model-c73214-kserve-5488f58987-9lbc4"]
Jul 29 15:25:14.571997 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:14.571964    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b766e40c-d4ad-4930-b5e9-c3f67586eb64-model-cache\") pod \"rate-test-model-c73214-kserve-5488f58987-9lbc4\" (UID: \"b766e40c-d4ad-4930-b5e9-c3f67586eb64\") " pod="ai-tenant-e2e-shared-a-c73214/rate-test-model-c73214-kserve-5488f58987-9lbc4"
Jul 29 15:25:14.572161 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:14.572004    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b766e40c-d4ad-4930-b5e9-c3f67586eb64-dshm\") pod \"rate-test-model-c73214-kserve-5488f58987-9lbc4\" (UID: \"b766e40c-d4ad-4930-b5e9-c3f67586eb64\") " pod="ai-tenant-e2e-shared-a-c73214/rate-test-model-c73214-kserve-5488f58987-9lbc4"
Jul 29 15:25:14.572161 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:14.572043    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmmvx\" (UniqueName: \"kubernetes.io/projected/b766e40c-d4ad-4930-b5e9-c3f67586eb64-kube-api-access-tmmvx\") pod \"rate-test-model-c73214-kserve-5488f58987-9lbc4\" (UID: \"b766e40c-d4ad-4930-b5e9-c3f67586eb64\") " pod="ai-tenant-e2e-shared-a-c73214/rate-test-model-c73214-kserve-5488f58987-9lbc4"
Jul 29 15:25:14.572161 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:14.572067    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b766e40c-d4ad-4930-b5e9-c3f67586eb64-tls-certs\") pod \"rate-test-model-c73214-kserve-5488f58987-9lbc4\" (UID: \"b766e40c-d4ad-4930-b5e9-c3f67586eb64\") " pod="ai-tenant-e2e-shared-a-c73214/rate-test-model-c73214-kserve-5488f58987-9lbc4"
Jul 29 15:25:14.572161 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:14.572087    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b766e40c-d4ad-4930-b5e9-c3f67586eb64-home\") pod \"rate-test-model-c73214-kserve-5488f58987-9lbc4\" (UID: \"b766e40c-d4ad-4930-b5e9-c3f67586eb64\") " pod="ai-tenant-e2e-shared-a-c73214/rate-test-model-c73214-kserve-5488f58987-9lbc4"
Jul 29 15:25:14.572161 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:14.572146    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b766e40c-d4ad-4930-b5e9-c3f67586eb64-tmp-dir\") pod \"rate-test-model-c73214-kserve-5488f58987-9lbc4\" (UID: \"b766e40c-d4ad-4930-b5e9-c3f67586eb64\") " pod="ai-tenant-e2e-shared-a-c73214/rate-test-model-c73214-kserve-5488f58987-9lbc4"
Jul 29 15:25:14.673128 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:14.673094    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b766e40c-d4ad-4930-b5e9-c3f67586eb64-model-cache\") pod \"rate-test-model-c73214-kserve-5488f58987-9lbc4\" (UID: \"b766e40c-d4ad-4930-b5e9-c3f67586eb64\") " pod="ai-tenant-e2e-shared-a-c73214/rate-test-model-c73214-kserve-5488f58987-9lbc4"
Jul 29 15:25:14.673128 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:14.673131    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b766e40c-d4ad-4930-b5e9-c3f67586eb64-dshm\") pod \"rate-test-model-c73214-kserve-5488f58987-9lbc4\" (UID: \"b766e40c-d4ad-4930-b5e9-c3f67586eb64\") " pod="ai-tenant-e2e-shared-a-c73214/rate-test-model-c73214-kserve-5488f58987-9lbc4"
Jul 29 15:25:14.673408 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:14.673164    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmmvx\" (UniqueName: \"kubernetes.io/projected/b766e40c-d4ad-4930-b5e9-c3f67586eb64-kube-api-access-tmmvx\") pod \"rate-test-model-c73214-kserve-5488f58987-9lbc4\" (UID: \"b766e40c-d4ad-4930-b5e9-c3f67586eb64\") " pod="ai-tenant-e2e-shared-a-c73214/rate-test-model-c73214-kserve-5488f58987-9lbc4"
Jul 29 15:25:14.673408 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:14.673285    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b766e40c-d4ad-4930-b5e9-c3f67586eb64-tls-certs\") pod \"rate-test-model-c73214-kserve-5488f58987-9lbc4\" (UID: \"b766e40c-d4ad-4930-b5e9-c3f67586eb64\") " pod="ai-tenant-e2e-shared-a-c73214/rate-test-model-c73214-kserve-5488f58987-9lbc4"
Jul 29 15:25:14.673408 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:14.673337    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b766e40c-d4ad-4930-b5e9-c3f67586eb64-home\") pod \"rate-test-model-c73214-kserve-5488f58987-9lbc4\" (UID: \"b766e40c-d4ad-4930-b5e9-c3f67586eb64\") " pod="ai-tenant-e2e-shared-a-c73214/rate-test-model-c73214-kserve-5488f58987-9lbc4"
Jul 29 15:25:14.673408 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:14.673378    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b766e40c-d4ad-4930-b5e9-c3f67586eb64-tmp-dir\") pod \"rate-test-model-c73214-kserve-5488f58987-9lbc4\" (UID: \"b766e40c-d4ad-4930-b5e9-c3f67586eb64\") " pod="ai-tenant-e2e-shared-a-c73214/rate-test-model-c73214-kserve-5488f58987-9lbc4"
Jul 29 15:25:14.673679 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:14.673631    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b766e40c-d4ad-4930-b5e9-c3f67586eb64-model-cache\") pod \"rate-test-model-c73214-kserve-5488f58987-9lbc4\" (UID: \"b766e40c-d4ad-4930-b5e9-c3f67586eb64\") " pod="ai-tenant-e2e-shared-a-c73214/rate-test-model-c73214-kserve-5488f58987-9lbc4"
Jul 29 15:25:14.673679 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:14.673668    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b766e40c-d4ad-4930-b5e9-c3f67586eb64-home\") pod \"rate-test-model-c73214-kserve-5488f58987-9lbc4\" (UID: \"b766e40c-d4ad-4930-b5e9-c3f67586eb64\") " pod="ai-tenant-e2e-shared-a-c73214/rate-test-model-c73214-kserve-5488f58987-9lbc4"
Jul 29 15:25:14.673775 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:14.673755    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b766e40c-d4ad-4930-b5e9-c3f67586eb64-tmp-dir\") pod \"rate-test-model-c73214-kserve-5488f58987-9lbc4\" (UID: \"b766e40c-d4ad-4930-b5e9-c3f67586eb64\") " pod="ai-tenant-e2e-shared-a-c73214/rate-test-model-c73214-kserve-5488f58987-9lbc4"
Jul 29 15:25:14.675388 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:14.675368    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b766e40c-d4ad-4930-b5e9-c3f67586eb64-dshm\") pod \"rate-test-model-c73214-kserve-5488f58987-9lbc4\" (UID: \"b766e40c-d4ad-4930-b5e9-c3f67586eb64\") " pod="ai-tenant-e2e-shared-a-c73214/rate-test-model-c73214-kserve-5488f58987-9lbc4"
Jul 29 15:25:14.675726 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:14.675710    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b766e40c-d4ad-4930-b5e9-c3f67586eb64-tls-certs\") pod \"rate-test-model-c73214-kserve-5488f58987-9lbc4\" (UID: \"b766e40c-d4ad-4930-b5e9-c3f67586eb64\") " pod="ai-tenant-e2e-shared-a-c73214/rate-test-model-c73214-kserve-5488f58987-9lbc4"
Jul 29 15:25:14.684297 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:14.684213    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmmvx\" (UniqueName: \"kubernetes.io/projected/b766e40c-d4ad-4930-b5e9-c3f67586eb64-kube-api-access-tmmvx\") pod \"rate-test-model-c73214-kserve-5488f58987-9lbc4\" (UID: \"b766e40c-d4ad-4930-b5e9-c3f67586eb64\") " pod="ai-tenant-e2e-shared-a-c73214/rate-test-model-c73214-kserve-5488f58987-9lbc4"
Jul 29 15:25:14.819890 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:14.819807    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c73214/rate-test-model-c73214-kserve-5488f58987-9lbc4"
Jul 29 15:25:14.945454 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:14.945428    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c73214/rate-test-model-c73214-kserve-5488f58987-9lbc4"]
Jul 29 15:25:14.947398 ip-10-0-142-130 kubenswrapper[2578]: W0729 15:25:14.947373    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb766e40c_d4ad_4930_b5e9_c3f67586eb64.slice/crio-c166f0ae7d6bb77446e282de1e76a20a810c29a3dbf628ea12e86097c4311aa4 WatchSource:0}: Error finding container c166f0ae7d6bb77446e282de1e76a20a810c29a3dbf628ea12e86097c4311aa4: Status 404 returned error can't find the container with id c166f0ae7d6bb77446e282de1e76a20a810c29a3dbf628ea12e86097c4311aa4
Jul 29 15:25:15.635793 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:15.635757    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c73214/rate-test-model-c73214-kserve-5488f58987-9lbc4" event={"ID":"b766e40c-d4ad-4930-b5e9-c3f67586eb64","Type":"ContainerStarted","Data":"5908a8a0b2680e08c7221df4680709c733e1f65cf7935c9dbe11200af065a6e3"}
Jul 29 15:25:15.635793 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:15.635799    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c73214/rate-test-model-c73214-kserve-5488f58987-9lbc4" event={"ID":"b766e40c-d4ad-4930-b5e9-c3f67586eb64","Type":"ContainerStarted","Data":"c166f0ae7d6bb77446e282de1e76a20a810c29a3dbf628ea12e86097c4311aa4"}
Jul 29 15:25:15.660304 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:15.660259    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-c73214/rate-test-model-c73214-kserve-5488f58987-9lbc4" podStartSLOduration=1.660226217 podStartE2EDuration="1.660226217s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:25:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:25:15.659092048 +0000 UTC m=+2987.961558654" watchObservedRunningTime="2026-07-29 15:25:15.660226217 +0000 UTC m=+2987.962692823"
Jul 29 15:25:15.817596 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:15.817562    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:25:23.694673 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:23.694635    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-c73214/sub-test-model-c73214-kserve-7df548968c-56xpl" podUID="cb88d232-4934-4085-8fc2-34cfafdfdc0e" containerName="main" containerID="cri-o://b81a41b373663e3625f35327c5979f66e94eb4694de3beaf5f5f72a8a3536139" gracePeriod=45
Jul 29 15:25:23.936868 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:23.936840    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c73214/sub-test-model-c73214-kserve-7df548968c-56xpl"
Jul 29 15:25:24.054503 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.054477    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb88d232-4934-4085-8fc2-34cfafdfdc0e-tls-certs\") pod \"cb88d232-4934-4085-8fc2-34cfafdfdc0e\" (UID: \"cb88d232-4934-4085-8fc2-34cfafdfdc0e\") "
Jul 29 15:25:24.054642 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.054517    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb88d232-4934-4085-8fc2-34cfafdfdc0e-model-cache\") pod \"cb88d232-4934-4085-8fc2-34cfafdfdc0e\" (UID: \"cb88d232-4934-4085-8fc2-34cfafdfdc0e\") "
Jul 29 15:25:24.054642 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.054542    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb88d232-4934-4085-8fc2-34cfafdfdc0e-home\") pod \"cb88d232-4934-4085-8fc2-34cfafdfdc0e\" (UID: \"cb88d232-4934-4085-8fc2-34cfafdfdc0e\") "
Jul 29 15:25:24.054728 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.054653    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4bwq\" (UniqueName: \"kubernetes.io/projected/cb88d232-4934-4085-8fc2-34cfafdfdc0e-kube-api-access-r4bwq\") pod \"cb88d232-4934-4085-8fc2-34cfafdfdc0e\" (UID: \"cb88d232-4934-4085-8fc2-34cfafdfdc0e\") "
Jul 29 15:25:24.054783 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.054747    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb88d232-4934-4085-8fc2-34cfafdfdc0e-model-cache" (OuterVolumeSpecName: "model-cache") pod "cb88d232-4934-4085-8fc2-34cfafdfdc0e" (UID: "cb88d232-4934-4085-8fc2-34cfafdfdc0e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:25:24.054783 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.054762    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb88d232-4934-4085-8fc2-34cfafdfdc0e-home" (OuterVolumeSpecName: "home") pod "cb88d232-4934-4085-8fc2-34cfafdfdc0e" (UID: "cb88d232-4934-4085-8fc2-34cfafdfdc0e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:25:24.054783 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.054767    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb88d232-4934-4085-8fc2-34cfafdfdc0e-dshm\") pod \"cb88d232-4934-4085-8fc2-34cfafdfdc0e\" (UID: \"cb88d232-4934-4085-8fc2-34cfafdfdc0e\") "
Jul 29 15:25:24.054943 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.054858    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb88d232-4934-4085-8fc2-34cfafdfdc0e-tmp-dir\") pod \"cb88d232-4934-4085-8fc2-34cfafdfdc0e\" (UID: \"cb88d232-4934-4085-8fc2-34cfafdfdc0e\") "
Jul 29 15:25:24.055161 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.055133    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb88d232-4934-4085-8fc2-34cfafdfdc0e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cb88d232-4934-4085-8fc2-34cfafdfdc0e" (UID: "cb88d232-4934-4085-8fc2-34cfafdfdc0e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:25:24.055271 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.055224    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb88d232-4934-4085-8fc2-34cfafdfdc0e-tmp-dir\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:25:24.055271 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.055267    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb88d232-4934-4085-8fc2-34cfafdfdc0e-model-cache\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:25:24.055389 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.055281    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb88d232-4934-4085-8fc2-34cfafdfdc0e-home\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:25:24.056637 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.056613    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb88d232-4934-4085-8fc2-34cfafdfdc0e-dshm" (OuterVolumeSpecName: "dshm") pod "cb88d232-4934-4085-8fc2-34cfafdfdc0e" (UID: "cb88d232-4934-4085-8fc2-34cfafdfdc0e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:25:24.056726 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.056648    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb88d232-4934-4085-8fc2-34cfafdfdc0e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cb88d232-4934-4085-8fc2-34cfafdfdc0e" (UID: "cb88d232-4934-4085-8fc2-34cfafdfdc0e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 15:25:24.056768 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.056719    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb88d232-4934-4085-8fc2-34cfafdfdc0e-kube-api-access-r4bwq" (OuterVolumeSpecName: "kube-api-access-r4bwq") pod "cb88d232-4934-4085-8fc2-34cfafdfdc0e" (UID: "cb88d232-4934-4085-8fc2-34cfafdfdc0e"). InnerVolumeSpecName "kube-api-access-r4bwq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 15:25:24.156520 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.156493    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb88d232-4934-4085-8fc2-34cfafdfdc0e-dshm\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:25:24.156520 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.156519    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb88d232-4934-4085-8fc2-34cfafdfdc0e-tls-certs\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:25:24.156679 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.156532    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4bwq\" (UniqueName: \"kubernetes.io/projected/cb88d232-4934-4085-8fc2-34cfafdfdc0e-kube-api-access-r4bwq\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:25:24.627863 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.627826    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-93e799/sub-test-model-93e799-kserve-7c4db96587-wmw8t" podUID="3542b748-a61d-4eee-b96c-f0aa06ffdfb4" containerName="main" containerID="cri-o://bcd28eab643a4cad8e102f9375bf5efc6d77c0eb0d47c44556a40fa91ab85e0d" gracePeriod=45
Jul 29 15:25:24.676320 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.676290    2578 generic.go:356] "Generic (PLEG): container finished" podID="cb88d232-4934-4085-8fc2-34cfafdfdc0e" containerID="b81a41b373663e3625f35327c5979f66e94eb4694de3beaf5f5f72a8a3536139" exitCode=0
Jul 29 15:25:24.676418 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.676336    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c73214/sub-test-model-c73214-kserve-7df548968c-56xpl"
Jul 29 15:25:24.676418 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.676339    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c73214/sub-test-model-c73214-kserve-7df548968c-56xpl" event={"ID":"cb88d232-4934-4085-8fc2-34cfafdfdc0e","Type":"ContainerDied","Data":"b81a41b373663e3625f35327c5979f66e94eb4694de3beaf5f5f72a8a3536139"}
Jul 29 15:25:24.676530 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.676440    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c73214/sub-test-model-c73214-kserve-7df548968c-56xpl" event={"ID":"cb88d232-4934-4085-8fc2-34cfafdfdc0e","Type":"ContainerDied","Data":"147df9ff150826cc26584fe93de720baf51a271595166b1ea38cd09fbbf15a6a"}
Jul 29 15:25:24.676530 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.676456    2578 scope.go:117] "RemoveContainer" containerID="b81a41b373663e3625f35327c5979f66e94eb4694de3beaf5f5f72a8a3536139"
Jul 29 15:25:24.693207 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.693185    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c73214/sub-test-model-c73214-kserve-7df548968c-56xpl"]
Jul 29 15:25:24.696850 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.696824    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-c73214/sub-test-model-c73214-kserve-7df548968c-56xpl"]
Jul 29 15:25:24.738347 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.738132    2578 scope.go:117] "RemoveContainer" containerID="b81a41b373663e3625f35327c5979f66e94eb4694de3beaf5f5f72a8a3536139"
Jul 29 15:25:24.738464 ip-10-0-142-130 kubenswrapper[2578]: E0729 15:25:24.738444    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b81a41b373663e3625f35327c5979f66e94eb4694de3beaf5f5f72a8a3536139\": container with ID starting with b81a41b373663e3625f35327c5979f66e94eb4694de3beaf5f5f72a8a3536139 not found: ID does not exist" containerID="b81a41b373663e3625f35327c5979f66e94eb4694de3beaf5f5f72a8a3536139"
Jul 29 15:25:24.738524 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.738472    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b81a41b373663e3625f35327c5979f66e94eb4694de3beaf5f5f72a8a3536139"} err="failed to get container status \"b81a41b373663e3625f35327c5979f66e94eb4694de3beaf5f5f72a8a3536139\": rpc error: code = NotFound desc = could not find container \"b81a41b373663e3625f35327c5979f66e94eb4694de3beaf5f5f72a8a3536139\": container with ID starting with b81a41b373663e3625f35327c5979f66e94eb4694de3beaf5f5f72a8a3536139 not found: ID does not exist"
Jul 29 15:25:24.820206 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.820173    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-c73214/rate-test-model-c73214-kserve-5488f58987-9lbc4"
Jul 29 15:25:24.820354 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.820223    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-c73214/rate-test-model-c73214-kserve-5488f58987-9lbc4"
Jul 29 15:25:24.831851 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.831830    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-c73214/rate-test-model-c73214-kserve-5488f58987-9lbc4"
Jul 29 15:25:24.876925 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.876899    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-93e799/sub-test-model-93e799-kserve-7c4db96587-wmw8t"
Jul 29 15:25:24.963941 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.963876    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3542b748-a61d-4eee-b96c-f0aa06ffdfb4-tls-certs\") pod \"3542b748-a61d-4eee-b96c-f0aa06ffdfb4\" (UID: \"3542b748-a61d-4eee-b96c-f0aa06ffdfb4\") "
Jul 29 15:25:24.963941 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.963923    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3542b748-a61d-4eee-b96c-f0aa06ffdfb4-model-cache\") pod \"3542b748-a61d-4eee-b96c-f0aa06ffdfb4\" (UID: \"3542b748-a61d-4eee-b96c-f0aa06ffdfb4\") "
Jul 29 15:25:24.964103 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.963949    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3542b748-a61d-4eee-b96c-f0aa06ffdfb4-tmp-dir\") pod \"3542b748-a61d-4eee-b96c-f0aa06ffdfb4\" (UID: \"3542b748-a61d-4eee-b96c-f0aa06ffdfb4\") "
Jul 29 15:25:24.964103 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.964057    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3542b748-a61d-4eee-b96c-f0aa06ffdfb4-home\") pod \"3542b748-a61d-4eee-b96c-f0aa06ffdfb4\" (UID: \"3542b748-a61d-4eee-b96c-f0aa06ffdfb4\") "
Jul 29 15:25:24.964173 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.964129    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3542b748-a61d-4eee-b96c-f0aa06ffdfb4-dshm\") pod \"3542b748-a61d-4eee-b96c-f0aa06ffdfb4\" (UID: \"3542b748-a61d-4eee-b96c-f0aa06ffdfb4\") "
Jul 29 15:25:24.964216 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.964177    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3542b748-a61d-4eee-b96c-f0aa06ffdfb4-home" (OuterVolumeSpecName: "home") pod "3542b748-a61d-4eee-b96c-f0aa06ffdfb4" (UID: "3542b748-a61d-4eee-b96c-f0aa06ffdfb4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:25:24.964216 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.964188    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4ngp\" (UniqueName: \"kubernetes.io/projected/3542b748-a61d-4eee-b96c-f0aa06ffdfb4-kube-api-access-t4ngp\") pod \"3542b748-a61d-4eee-b96c-f0aa06ffdfb4\" (UID: \"3542b748-a61d-4eee-b96c-f0aa06ffdfb4\") "
Jul 29 15:25:24.964216 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.964201    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3542b748-a61d-4eee-b96c-f0aa06ffdfb4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3542b748-a61d-4eee-b96c-f0aa06ffdfb4" (UID: "3542b748-a61d-4eee-b96c-f0aa06ffdfb4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:25:24.964417 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.964214    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3542b748-a61d-4eee-b96c-f0aa06ffdfb4-model-cache" (OuterVolumeSpecName: "model-cache") pod "3542b748-a61d-4eee-b96c-f0aa06ffdfb4" (UID: "3542b748-a61d-4eee-b96c-f0aa06ffdfb4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:25:24.964519 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.964502    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3542b748-a61d-4eee-b96c-f0aa06ffdfb4-model-cache\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:25:24.964573 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.964519    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3542b748-a61d-4eee-b96c-f0aa06ffdfb4-tmp-dir\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:25:24.964573 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.964527    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3542b748-a61d-4eee-b96c-f0aa06ffdfb4-home\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:25:24.966068 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.966050    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3542b748-a61d-4eee-b96c-f0aa06ffdfb4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3542b748-a61d-4eee-b96c-f0aa06ffdfb4" (UID: "3542b748-a61d-4eee-b96c-f0aa06ffdfb4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 15:25:24.966139 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.966051    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3542b748-a61d-4eee-b96c-f0aa06ffdfb4-dshm" (OuterVolumeSpecName: "dshm") pod "3542b748-a61d-4eee-b96c-f0aa06ffdfb4" (UID: "3542b748-a61d-4eee-b96c-f0aa06ffdfb4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:25:24.966368 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:24.966348    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3542b748-a61d-4eee-b96c-f0aa06ffdfb4-kube-api-access-t4ngp" (OuterVolumeSpecName: "kube-api-access-t4ngp") pod "3542b748-a61d-4eee-b96c-f0aa06ffdfb4" (UID: "3542b748-a61d-4eee-b96c-f0aa06ffdfb4"). InnerVolumeSpecName "kube-api-access-t4ngp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 15:25:25.065643 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:25.065617    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3542b748-a61d-4eee-b96c-f0aa06ffdfb4-tls-certs\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:25:25.065643 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:25.065638    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3542b748-a61d-4eee-b96c-f0aa06ffdfb4-dshm\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:25:25.065643 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:25.065647    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4ngp\" (UniqueName: \"kubernetes.io/projected/3542b748-a61d-4eee-b96c-f0aa06ffdfb4-kube-api-access-t4ngp\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:25:25.310252 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:25.310207    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:25:25.681935 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:25.681847    2578 generic.go:356] "Generic (PLEG): container finished" podID="3542b748-a61d-4eee-b96c-f0aa06ffdfb4" containerID="bcd28eab643a4cad8e102f9375bf5efc6d77c0eb0d47c44556a40fa91ab85e0d" exitCode=0
Jul 29 15:25:25.681935 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:25.681891    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-93e799/sub-test-model-93e799-kserve-7c4db96587-wmw8t"
Jul 29 15:25:25.682166 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:25.681932    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-93e799/sub-test-model-93e799-kserve-7c4db96587-wmw8t" event={"ID":"3542b748-a61d-4eee-b96c-f0aa06ffdfb4","Type":"ContainerDied","Data":"bcd28eab643a4cad8e102f9375bf5efc6d77c0eb0d47c44556a40fa91ab85e0d"}
Jul 29 15:25:25.682166 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:25.681974    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-93e799/sub-test-model-93e799-kserve-7c4db96587-wmw8t" event={"ID":"3542b748-a61d-4eee-b96c-f0aa06ffdfb4","Type":"ContainerDied","Data":"1dd507a4b97339ae06dfa0d0727ca285ae97769bac9f2a1e72476d0f9cbc2dfc"}
Jul 29 15:25:25.682166 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:25.681991    2578 scope.go:117] "RemoveContainer" containerID="bcd28eab643a4cad8e102f9375bf5efc6d77c0eb0d47c44556a40fa91ab85e0d"
Jul 29 15:25:25.691640 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:25.691622    2578 scope.go:117] "RemoveContainer" containerID="bcd28eab643a4cad8e102f9375bf5efc6d77c0eb0d47c44556a40fa91ab85e0d"
Jul 29 15:25:25.691900 ip-10-0-142-130 kubenswrapper[2578]: E0729 15:25:25.691879    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcd28eab643a4cad8e102f9375bf5efc6d77c0eb0d47c44556a40fa91ab85e0d\": container with ID starting with bcd28eab643a4cad8e102f9375bf5efc6d77c0eb0d47c44556a40fa91ab85e0d not found: ID does not exist" containerID="bcd28eab643a4cad8e102f9375bf5efc6d77c0eb0d47c44556a40fa91ab85e0d"
Jul 29 15:25:25.691967 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:25.691908    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcd28eab643a4cad8e102f9375bf5efc6d77c0eb0d47c44556a40fa91ab85e0d"} err="failed to get container status \"bcd28eab643a4cad8e102f9375bf5efc6d77c0eb0d47c44556a40fa91ab85e0d\": rpc error: code = NotFound desc = could not find container \"bcd28eab643a4cad8e102f9375bf5efc6d77c0eb0d47c44556a40fa91ab85e0d\": container with ID starting with bcd28eab643a4cad8e102f9375bf5efc6d77c0eb0d47c44556a40fa91ab85e0d not found: ID does not exist"
Jul 29 15:25:25.695916 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:25.695891    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-c73214/rate-test-model-c73214-kserve-5488f58987-9lbc4"
Jul 29 15:25:25.709168 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:25.709141    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-93e799/sub-test-model-93e799-kserve-7c4db96587-wmw8t"]
Jul 29 15:25:25.723594 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:25.723573    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-93e799/sub-test-model-93e799-kserve-7c4db96587-wmw8t"]
Jul 29 15:25:26.281560 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:26.279345    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3542b748-a61d-4eee-b96c-f0aa06ffdfb4" path="/var/lib/kubelet/pods/3542b748-a61d-4eee-b96c-f0aa06ffdfb4/volumes"
Jul 29 15:25:26.281560 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:26.279955    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb88d232-4934-4085-8fc2-34cfafdfdc0e" path="/var/lib/kubelet/pods/cb88d232-4934-4085-8fc2-34cfafdfdc0e/volumes"
Jul 29 15:25:47.115870 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:47.115829    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-93e799/rate-test-model-93e799-kserve-7bbbc4864c-kwzlr"]
Jul 29 15:25:47.116596 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:47.116391    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3542b748-a61d-4eee-b96c-f0aa06ffdfb4" containerName="main"
Jul 29 15:25:47.116596 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:47.116411    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3542b748-a61d-4eee-b96c-f0aa06ffdfb4" containerName="main"
Jul 29 15:25:47.116596 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:47.116438    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb88d232-4934-4085-8fc2-34cfafdfdc0e" containerName="main"
Jul 29 15:25:47.116596 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:47.116447    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb88d232-4934-4085-8fc2-34cfafdfdc0e" containerName="main"
Jul 29 15:25:47.116596 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:47.116551    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3542b748-a61d-4eee-b96c-f0aa06ffdfb4" containerName="main"
Jul 29 15:25:47.116596 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:47.116566    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb88d232-4934-4085-8fc2-34cfafdfdc0e" containerName="main"
Jul 29 15:25:47.119644 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:47.119623    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-93e799/rate-test-model-93e799-kserve-7bbbc4864c-kwzlr"
Jul 29 15:25:47.122491 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:47.122468    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-93e799\"/\"default-dockercfg-wvpcl\""
Jul 29 15:25:47.123788 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:47.123758    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-93e799\"/\"kube-root-ca.crt\""
Jul 29 15:25:47.123894 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:47.123838    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-93e799\"/\"openshift-service-ca.crt\""
Jul 29 15:25:47.123894 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:47.123880    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-93e799\"/\"rate-test-model-93e799-kserve-self-signed-certs\""
Jul 29 15:25:47.134556 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:47.134534    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-93e799/rate-test-model-93e799-kserve-7bbbc4864c-kwzlr"]
Jul 29 15:25:47.259089 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:47.259057    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8a6baaf-11aa-4928-beab-0a099ee66e8f-tls-certs\") pod \"rate-test-model-93e799-kserve-7bbbc4864c-kwzlr\" (UID: \"e8a6baaf-11aa-4928-beab-0a099ee66e8f\") " pod="ai-tenant-e2e-shared-b-93e799/rate-test-model-93e799-kserve-7bbbc4864c-kwzlr"
Jul 29 15:25:47.259284 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:47.259098    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e8a6baaf-11aa-4928-beab-0a099ee66e8f-model-cache\") pod \"rate-test-model-93e799-kserve-7bbbc4864c-kwzlr\" (UID: \"e8a6baaf-11aa-4928-beab-0a099ee66e8f\") " pod="ai-tenant-e2e-shared-b-93e799/rate-test-model-93e799-kserve-7bbbc4864c-kwzlr"
Jul 29 15:25:47.259284 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:47.259128    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdplx\" (UniqueName: \"kubernetes.io/projected/e8a6baaf-11aa-4928-beab-0a099ee66e8f-kube-api-access-tdplx\") pod \"rate-test-model-93e799-kserve-7bbbc4864c-kwzlr\" (UID: \"e8a6baaf-11aa-4928-beab-0a099ee66e8f\") " pod="ai-tenant-e2e-shared-b-93e799/rate-test-model-93e799-kserve-7bbbc4864c-kwzlr"
Jul 29 15:25:47.259284 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:47.259216    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e8a6baaf-11aa-4928-beab-0a099ee66e8f-home\") pod \"rate-test-model-93e799-kserve-7bbbc4864c-kwzlr\" (UID: \"e8a6baaf-11aa-4928-beab-0a099ee66e8f\") " pod="ai-tenant-e2e-shared-b-93e799/rate-test-model-93e799-kserve-7bbbc4864c-kwzlr"
Jul 29 15:25:47.259401 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:47.259308    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e8a6baaf-11aa-4928-beab-0a099ee66e8f-dshm\") pod \"rate-test-model-93e799-kserve-7bbbc4864c-kwzlr\" (UID: \"e8a6baaf-11aa-4928-beab-0a099ee66e8f\") " pod="ai-tenant-e2e-shared-b-93e799/rate-test-model-93e799-kserve-7bbbc4864c-kwzlr"
Jul 29 15:25:47.259401 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:47.259333    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8a6baaf-11aa-4928-beab-0a099ee66e8f-tmp-dir\") pod \"rate-test-model-93e799-kserve-7bbbc4864c-kwzlr\" (UID: \"e8a6baaf-11aa-4928-beab-0a099ee66e8f\") " pod="ai-tenant-e2e-shared-b-93e799/rate-test-model-93e799-kserve-7bbbc4864c-kwzlr"
Jul 29 15:25:47.360759 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:47.360718    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8a6baaf-11aa-4928-beab-0a099ee66e8f-tls-certs\") pod \"rate-test-model-93e799-kserve-7bbbc4864c-kwzlr\" (UID: \"e8a6baaf-11aa-4928-beab-0a099ee66e8f\") " pod="ai-tenant-e2e-shared-b-93e799/rate-test-model-93e799-kserve-7bbbc4864c-kwzlr"
Jul 29 15:25:47.360759 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:47.360764    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e8a6baaf-11aa-4928-beab-0a099ee66e8f-model-cache\") pod \"rate-test-model-93e799-kserve-7bbbc4864c-kwzlr\" (UID: \"e8a6baaf-11aa-4928-beab-0a099ee66e8f\") " pod="ai-tenant-e2e-shared-b-93e799/rate-test-model-93e799-kserve-7bbbc4864c-kwzlr"
Jul 29 15:25:47.361010 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:47.360790    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdplx\" (UniqueName: \"kubernetes.io/projected/e8a6baaf-11aa-4928-beab-0a099ee66e8f-kube-api-access-tdplx\") pod \"rate-test-model-93e799-kserve-7bbbc4864c-kwzlr\" (UID: \"e8a6baaf-11aa-4928-beab-0a099ee66e8f\") " pod="ai-tenant-e2e-shared-b-93e799/rate-test-model-93e799-kserve-7bbbc4864c-kwzlr"
Jul 29 15:25:47.361010 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:47.360823    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e8a6baaf-11aa-4928-beab-0a099ee66e8f-home\") pod \"rate-test-model-93e799-kserve-7bbbc4864c-kwzlr\" (UID: \"e8a6baaf-11aa-4928-beab-0a099ee66e8f\") " pod="ai-tenant-e2e-shared-b-93e799/rate-test-model-93e799-kserve-7bbbc4864c-kwzlr"
Jul 29 15:25:47.361010 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:47.360868    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e8a6baaf-11aa-4928-beab-0a099ee66e8f-dshm\") pod \"rate-test-model-93e799-kserve-7bbbc4864c-kwzlr\" (UID: \"e8a6baaf-11aa-4928-beab-0a099ee66e8f\") " pod="ai-tenant-e2e-shared-b-93e799/rate-test-model-93e799-kserve-7bbbc4864c-kwzlr"
Jul 29 15:25:47.361010 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:47.360883    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8a6baaf-11aa-4928-beab-0a099ee66e8f-tmp-dir\") pod \"rate-test-model-93e799-kserve-7bbbc4864c-kwzlr\" (UID: \"e8a6baaf-11aa-4928-beab-0a099ee66e8f\") " pod="ai-tenant-e2e-shared-b-93e799/rate-test-model-93e799-kserve-7bbbc4864c-kwzlr"
Jul 29 15:25:47.361218 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:47.361194    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e8a6baaf-11aa-4928-beab-0a099ee66e8f-model-cache\") pod \"rate-test-model-93e799-kserve-7bbbc4864c-kwzlr\" (UID: \"e8a6baaf-11aa-4928-beab-0a099ee66e8f\") " pod="ai-tenant-e2e-shared-b-93e799/rate-test-model-93e799-kserve-7bbbc4864c-kwzlr"
Jul 29 15:25:47.361339 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:47.361319    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e8a6baaf-11aa-4928-beab-0a099ee66e8f-home\") pod \"rate-test-model-93e799-kserve-7bbbc4864c-kwzlr\" (UID: \"e8a6baaf-11aa-4928-beab-0a099ee66e8f\") " pod="ai-tenant-e2e-shared-b-93e799/rate-test-model-93e799-kserve-7bbbc4864c-kwzlr"
Jul 29 15:25:47.361393 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:47.361356    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8a6baaf-11aa-4928-beab-0a099ee66e8f-tmp-dir\") pod \"rate-test-model-93e799-kserve-7bbbc4864c-kwzlr\" (UID: \"e8a6baaf-11aa-4928-beab-0a099ee66e8f\") " pod="ai-tenant-e2e-shared-b-93e799/rate-test-model-93e799-kserve-7bbbc4864c-kwzlr"
Jul 29 15:25:47.363016 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:47.362990    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e8a6baaf-11aa-4928-beab-0a099ee66e8f-dshm\") pod \"rate-test-model-93e799-kserve-7bbbc4864c-kwzlr\" (UID: \"e8a6baaf-11aa-4928-beab-0a099ee66e8f\") " pod="ai-tenant-e2e-shared-b-93e799/rate-test-model-93e799-kserve-7bbbc4864c-kwzlr"
Jul 29 15:25:47.363275 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:47.363258    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8a6baaf-11aa-4928-beab-0a099ee66e8f-tls-certs\") pod \"rate-test-model-93e799-kserve-7bbbc4864c-kwzlr\" (UID: \"e8a6baaf-11aa-4928-beab-0a099ee66e8f\") " pod="ai-tenant-e2e-shared-b-93e799/rate-test-model-93e799-kserve-7bbbc4864c-kwzlr"
Jul 29 15:25:47.375983 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:47.375924    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdplx\" (UniqueName: \"kubernetes.io/projected/e8a6baaf-11aa-4928-beab-0a099ee66e8f-kube-api-access-tdplx\") pod \"rate-test-model-93e799-kserve-7bbbc4864c-kwzlr\" (UID: \"e8a6baaf-11aa-4928-beab-0a099ee66e8f\") " pod="ai-tenant-e2e-shared-b-93e799/rate-test-model-93e799-kserve-7bbbc4864c-kwzlr"
Jul 29 15:25:47.429947 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:47.429911    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-93e799/rate-test-model-93e799-kserve-7bbbc4864c-kwzlr"
Jul 29 15:25:47.559791 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:47.559768    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-93e799/rate-test-model-93e799-kserve-7bbbc4864c-kwzlr"]
Jul 29 15:25:47.562540 ip-10-0-142-130 kubenswrapper[2578]: W0729 15:25:47.562509    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode8a6baaf_11aa_4928_beab_0a099ee66e8f.slice/crio-6a15f182c279d1afc92a6368ac4c7b3520d76b64c0f5a1e7447e881aa16e8fb7 WatchSource:0}: Error finding container 6a15f182c279d1afc92a6368ac4c7b3520d76b64c0f5a1e7447e881aa16e8fb7: Status 404 returned error can't find the container with id 6a15f182c279d1afc92a6368ac4c7b3520d76b64c0f5a1e7447e881aa16e8fb7
Jul 29 15:25:47.783478 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:47.783441    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-93e799/rate-test-model-93e799-kserve-7bbbc4864c-kwzlr" event={"ID":"e8a6baaf-11aa-4928-beab-0a099ee66e8f","Type":"ContainerStarted","Data":"66dcffdc7d3e4601c4f9fe5357e37d11da43c313c41f2df27390201f6158b395"}
Jul 29 15:25:47.783478 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:47.783489    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-93e799/rate-test-model-93e799-kserve-7bbbc4864c-kwzlr" event={"ID":"e8a6baaf-11aa-4928-beab-0a099ee66e8f","Type":"ContainerStarted","Data":"6a15f182c279d1afc92a6368ac4c7b3520d76b64c0f5a1e7447e881aa16e8fb7"}
Jul 29 15:25:47.801009 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:47.800963    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-93e799/rate-test-model-93e799-kserve-7bbbc4864c-kwzlr" podStartSLOduration=0.800948467 podStartE2EDuration="800.948467ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:25:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:25:47.800628444 +0000 UTC m=+3020.103095051" watchObservedRunningTime="2026-07-29 15:25:47.800948467 +0000 UTC m=+3020.103415073"
Jul 29 15:25:50.304640 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:50.304608    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:25:57.430332 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:57.430297    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-93e799/rate-test-model-93e799-kserve-7bbbc4864c-kwzlr"
Jul 29 15:25:57.430332 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:57.430338    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-93e799/rate-test-model-93e799-kserve-7bbbc4864c-kwzlr"
Jul 29 15:25:57.442417 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:57.442391    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-93e799/rate-test-model-93e799-kserve-7bbbc4864c-kwzlr"
Jul 29 15:25:57.844129 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:25:57.844099    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-93e799/rate-test-model-93e799-kserve-7bbbc4864c-kwzlr"
Jul 29 15:26:22.707877 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:26:22.707789    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:26:36.706961 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:26:36.706920    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:26:49.406275 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:26:49.406228    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:26:53.898368 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:26:53.898337    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c73214/rate-test-model-c73214-kserve-5488f58987-9lbc4"]
Jul 29 15:26:54.721679 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:26:54.721645    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-93e799/rate-test-model-93e799-kserve-7bbbc4864c-kwzlr"]
Jul 29 15:26:58.656190 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:26:58.656156    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7695-140291048019120"]
Jul 29 15:26:58.659527 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:26:58.659507    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7695-140291048019120"
Jul 29 15:26:58.662337 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:26:58.662314    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-n6sn7\""
Jul 29 15:26:58.666019 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:26:58.665987    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7695-140291048019120"]
Jul 29 15:26:58.803521 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:26:58.803490    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtptv\" (UniqueName: \"kubernetes.io/projected/1b806e0c-d125-47f3-bc06-187f1cf0e42c-kube-api-access-vtptv\") pod \"test-curl-7695-140291048019120\" (UID: \"1b806e0c-d125-47f3-bc06-187f1cf0e42c\") " pod="opendatahub/test-curl-7695-140291048019120"
Jul 29 15:26:58.904100 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:26:58.904066    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtptv\" (UniqueName: \"kubernetes.io/projected/1b806e0c-d125-47f3-bc06-187f1cf0e42c-kube-api-access-vtptv\") pod \"test-curl-7695-140291048019120\" (UID: \"1b806e0c-d125-47f3-bc06-187f1cf0e42c\") " pod="opendatahub/test-curl-7695-140291048019120"
Jul 29 15:26:58.913688 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:26:58.913618    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtptv\" (UniqueName: \"kubernetes.io/projected/1b806e0c-d125-47f3-bc06-187f1cf0e42c-kube-api-access-vtptv\") pod \"test-curl-7695-140291048019120\" (UID: \"1b806e0c-d125-47f3-bc06-187f1cf0e42c\") " pod="opendatahub/test-curl-7695-140291048019120"
Jul 29 15:26:58.969205 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:26:58.969177    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7695-140291048019120"
Jul 29 15:26:59.092131 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:26:59.092106    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7695-140291048019120"]
Jul 29 15:26:59.094690 ip-10-0-142-130 kubenswrapper[2578]: W0729 15:26:59.094661    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b806e0c_d125_47f3_bc06_187f1cf0e42c.slice/crio-42c3e845cefd2e20512e16880c5a4bfdd629a5600313e8c8868d64cf6750e2fa WatchSource:0}: Error finding container 42c3e845cefd2e20512e16880c5a4bfdd629a5600313e8c8868d64cf6750e2fa: Status 404 returned error can't find the container with id 42c3e845cefd2e20512e16880c5a4bfdd629a5600313e8c8868d64cf6750e2fa
Jul 29 15:26:59.095962 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:26:59.095939    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 15:26:59.108317 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:26:59.108292    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7695-140291048019120" event={"ID":"1b806e0c-d125-47f3-bc06-187f1cf0e42c","Type":"ContainerStarted","Data":"42c3e845cefd2e20512e16880c5a4bfdd629a5600313e8c8868d64cf6750e2fa"}
Jul 29 15:27:00.114808 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:00.114728    2578 generic.go:356] "Generic (PLEG): container finished" podID="1b806e0c-d125-47f3-bc06-187f1cf0e42c" containerID="6c6f7d3b561bad4603596b453766ec63382396674b7b87f9edf9b74a5fb06411" exitCode=0
Jul 29 15:27:00.114808 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:00.114777    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7695-140291048019120" event={"ID":"1b806e0c-d125-47f3-bc06-187f1cf0e42c","Type":"ContainerDied","Data":"6c6f7d3b561bad4603596b453766ec63382396674b7b87f9edf9b74a5fb06411"}
Jul 29 15:27:01.249790 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:01.249757    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7695-140291048019120"
Jul 29 15:27:01.287078 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:01.287056    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7695-140291048019120_1b806e0c-d125-47f3-bc06-187f1cf0e42c/test-curl-7695-140291048019120/0.log"
Jul 29 15:27:01.312547 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:01.312522    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7695-140291048019120"]
Jul 29 15:27:01.315087 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:01.315061    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7695-140291048019120"]
Jul 29 15:27:01.326009 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:01.325987    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vtptv\" (UniqueName: \"kubernetes.io/projected/1b806e0c-d125-47f3-bc06-187f1cf0e42c-kube-api-access-vtptv\") pod \"1b806e0c-d125-47f3-bc06-187f1cf0e42c\" (UID: \"1b806e0c-d125-47f3-bc06-187f1cf0e42c\") "
Jul 29 15:27:01.327853 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:01.327834    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b806e0c-d125-47f3-bc06-187f1cf0e42c-kube-api-access-vtptv" (OuterVolumeSpecName: "kube-api-access-vtptv") pod "1b806e0c-d125-47f3-bc06-187f1cf0e42c" (UID: "1b806e0c-d125-47f3-bc06-187f1cf0e42c"). InnerVolumeSpecName "kube-api-access-vtptv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 15:27:01.427497 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:01.427441    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtptv\" (UniqueName: \"kubernetes.io/projected/1b806e0c-d125-47f3-bc06-187f1cf0e42c-kube-api-access-vtptv\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:27:02.126587 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:02.126559    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="42c3e845cefd2e20512e16880c5a4bfdd629a5600313e8c8868d64cf6750e2fa"
Jul 29 15:27:02.126587 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:02.126580    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7695-140291048019120"
Jul 29 15:27:02.136678 ip-10-0-142-130 kubenswrapper[2578]: E0729 15:27:02.136653    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7695-140291048019120\" is forbidden: User \"system:node:ip-10-0-142-130.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-130.ec2.internal' and this object" podUID="1b806e0c-d125-47f3-bc06-187f1cf0e42c" pod="opendatahub/test-curl-7695-140291048019120"
Jul 29 15:27:02.277894 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:02.277866    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b806e0c-d125-47f3-bc06-187f1cf0e42c" path="/var/lib/kubelet/pods/1b806e0c-d125-47f3-bc06-187f1cf0e42c/volumes"
Jul 29 15:27:04.680171 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:04.680139    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7695-140291047942160"]
Jul 29 15:27:04.680543 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:04.680494    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b806e0c-d125-47f3-bc06-187f1cf0e42c" containerName="test-curl-7695-140291048019120"
Jul 29 15:27:04.680543 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:04.680506    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b806e0c-d125-47f3-bc06-187f1cf0e42c" containerName="test-curl-7695-140291048019120"
Jul 29 15:27:04.680618 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:04.680580    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b806e0c-d125-47f3-bc06-187f1cf0e42c" containerName="test-curl-7695-140291048019120"
Jul 29 15:27:04.683677 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:04.683661    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7695-140291047942160"
Jul 29 15:27:04.686313 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:04.686292    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-n6sn7\""
Jul 29 15:27:04.689756 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:04.689734    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7695-140291047942160"]
Jul 29 15:27:04.756867 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:04.756840    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jlld\" (UniqueName: \"kubernetes.io/projected/f6ac45d8-c14e-4be7-80de-b357797a07cd-kube-api-access-5jlld\") pod \"test-curl-7695-140291047942160\" (UID: \"f6ac45d8-c14e-4be7-80de-b357797a07cd\") " pod="opendatahub/test-curl-7695-140291047942160"
Jul 29 15:27:04.858020 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:04.857993    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jlld\" (UniqueName: \"kubernetes.io/projected/f6ac45d8-c14e-4be7-80de-b357797a07cd-kube-api-access-5jlld\") pod \"test-curl-7695-140291047942160\" (UID: \"f6ac45d8-c14e-4be7-80de-b357797a07cd\") " pod="opendatahub/test-curl-7695-140291047942160"
Jul 29 15:27:04.865616 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:04.865593    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jlld\" (UniqueName: \"kubernetes.io/projected/f6ac45d8-c14e-4be7-80de-b357797a07cd-kube-api-access-5jlld\") pod \"test-curl-7695-140291047942160\" (UID: \"f6ac45d8-c14e-4be7-80de-b357797a07cd\") " pod="opendatahub/test-curl-7695-140291047942160"
Jul 29 15:27:04.897327 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:04.897301    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:27:04.994069 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:04.994033    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7695-140291047942160"
Jul 29 15:27:05.119106 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:05.119083    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7695-140291047942160"]
Jul 29 15:27:05.121166 ip-10-0-142-130 kubenswrapper[2578]: W0729 15:27:05.121134    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf6ac45d8_c14e_4be7_80de_b357797a07cd.slice/crio-402a6463a5c61044e9c69964c5b4862616fed9045d7a1a464fffec69ae9f5043 WatchSource:0}: Error finding container 402a6463a5c61044e9c69964c5b4862616fed9045d7a1a464fffec69ae9f5043: Status 404 returned error can't find the container with id 402a6463a5c61044e9c69964c5b4862616fed9045d7a1a464fffec69ae9f5043
Jul 29 15:27:05.142170 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:05.142145    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7695-140291047942160" event={"ID":"f6ac45d8-c14e-4be7-80de-b357797a07cd","Type":"ContainerStarted","Data":"402a6463a5c61044e9c69964c5b4862616fed9045d7a1a464fffec69ae9f5043"}
Jul 29 15:27:06.149177 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:06.149076    2578 generic.go:356] "Generic (PLEG): container finished" podID="f6ac45d8-c14e-4be7-80de-b357797a07cd" containerID="3534e2d25abf4f459f09625193b31d72c1128f5a399602d8c660ada588955549" exitCode=0
Jul 29 15:27:06.149550 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:06.149176    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7695-140291047942160" event={"ID":"f6ac45d8-c14e-4be7-80de-b357797a07cd","Type":"ContainerDied","Data":"3534e2d25abf4f459f09625193b31d72c1128f5a399602d8c660ada588955549"}
Jul 29 15:27:07.286545 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:07.286515    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7695-140291047942160"
Jul 29 15:27:07.306474 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:07.306456    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7695-140291047942160_f6ac45d8-c14e-4be7-80de-b357797a07cd/test-curl-7695-140291047942160/0.log"
Jul 29 15:27:07.331653 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:07.331625    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7695-140291047942160"]
Jul 29 15:27:07.335209 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:07.335190    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7695-140291047942160"]
Jul 29 15:27:07.380835 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:07.380812    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jlld\" (UniqueName: \"kubernetes.io/projected/f6ac45d8-c14e-4be7-80de-b357797a07cd-kube-api-access-5jlld\") pod \"f6ac45d8-c14e-4be7-80de-b357797a07cd\" (UID: \"f6ac45d8-c14e-4be7-80de-b357797a07cd\") "
Jul 29 15:27:07.382990 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:07.382968    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6ac45d8-c14e-4be7-80de-b357797a07cd-kube-api-access-5jlld" (OuterVolumeSpecName: "kube-api-access-5jlld") pod "f6ac45d8-c14e-4be7-80de-b357797a07cd" (UID: "f6ac45d8-c14e-4be7-80de-b357797a07cd"). InnerVolumeSpecName "kube-api-access-5jlld". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 15:27:07.482768 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:07.482685    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jlld\" (UniqueName: \"kubernetes.io/projected/f6ac45d8-c14e-4be7-80de-b357797a07cd-kube-api-access-5jlld\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:27:08.159997 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:08.159971    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7695-140291047942160"
Jul 29 15:27:08.159997 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:08.159988    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="402a6463a5c61044e9c69964c5b4862616fed9045d7a1a464fffec69ae9f5043"
Jul 29 15:27:08.170322 ip-10-0-142-130 kubenswrapper[2578]: E0729 15:27:08.170291    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7695-140291047942160\" is forbidden: User \"system:node:ip-10-0-142-130.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-130.ec2.internal' and this object" podUID="f6ac45d8-c14e-4be7-80de-b357797a07cd" pod="opendatahub/test-curl-7695-140291047942160"
Jul 29 15:27:08.278461 ip-10-0-142-130 kubenswrapper[2578]: E0729 15:27:08.278425    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7695-140291047942160\" is forbidden: User \"system:node:ip-10-0-142-130.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-130.ec2.internal' and this object" podUID="f6ac45d8-c14e-4be7-80de-b357797a07cd" pod="opendatahub/test-curl-7695-140291047942160"
Jul 29 15:27:08.279227 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:08.279208    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6ac45d8-c14e-4be7-80de-b357797a07cd" path="/var/lib/kubelet/pods/f6ac45d8-c14e-4be7-80de-b357797a07cd/volumes"
Jul 29 15:27:08.916553 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:08.916520    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-c73214/rate-test-model-c73214-kserve-5488f58987-9lbc4" podUID="b766e40c-d4ad-4930-b5e9-c3f67586eb64" containerName="main" containerID="cri-o://5908a8a0b2680e08c7221df4680709c733e1f65cf7935c9dbe11200af065a6e3" gracePeriod=45
Jul 29 15:27:09.167095 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:09.167026    2578 generic.go:356] "Generic (PLEG): container finished" podID="b766e40c-d4ad-4930-b5e9-c3f67586eb64" containerID="5908a8a0b2680e08c7221df4680709c733e1f65cf7935c9dbe11200af065a6e3" exitCode=0
Jul 29 15:27:09.167217 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:09.167108    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c73214/rate-test-model-c73214-kserve-5488f58987-9lbc4" event={"ID":"b766e40c-d4ad-4930-b5e9-c3f67586eb64","Type":"ContainerDied","Data":"5908a8a0b2680e08c7221df4680709c733e1f65cf7935c9dbe11200af065a6e3"}
Jul 29 15:27:09.167217 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:09.167155    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c73214/rate-test-model-c73214-kserve-5488f58987-9lbc4" event={"ID":"b766e40c-d4ad-4930-b5e9-c3f67586eb64","Type":"ContainerDied","Data":"c166f0ae7d6bb77446e282de1e76a20a810c29a3dbf628ea12e86097c4311aa4"}
Jul 29 15:27:09.167217 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:09.167173    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c166f0ae7d6bb77446e282de1e76a20a810c29a3dbf628ea12e86097c4311aa4"
Jul 29 15:27:09.175036 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:09.175019    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c73214/rate-test-model-c73214-kserve-5488f58987-9lbc4"
Jul 29 15:27:09.298438 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:09.298411    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmmvx\" (UniqueName: \"kubernetes.io/projected/b766e40c-d4ad-4930-b5e9-c3f67586eb64-kube-api-access-tmmvx\") pod \"b766e40c-d4ad-4930-b5e9-c3f67586eb64\" (UID: \"b766e40c-d4ad-4930-b5e9-c3f67586eb64\") "
Jul 29 15:27:09.298573 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:09.298457    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b766e40c-d4ad-4930-b5e9-c3f67586eb64-tmp-dir\") pod \"b766e40c-d4ad-4930-b5e9-c3f67586eb64\" (UID: \"b766e40c-d4ad-4930-b5e9-c3f67586eb64\") "
Jul 29 15:27:09.298653 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:09.298632    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b766e40c-d4ad-4930-b5e9-c3f67586eb64-model-cache\") pod \"b766e40c-d4ad-4930-b5e9-c3f67586eb64\" (UID: \"b766e40c-d4ad-4930-b5e9-c3f67586eb64\") "
Jul 29 15:27:09.298705 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:09.298673    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b766e40c-d4ad-4930-b5e9-c3f67586eb64-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b766e40c-d4ad-4930-b5e9-c3f67586eb64" (UID: "b766e40c-d4ad-4930-b5e9-c3f67586eb64"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:27:09.298705 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:09.298685    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b766e40c-d4ad-4930-b5e9-c3f67586eb64-tls-certs\") pod \"b766e40c-d4ad-4930-b5e9-c3f67586eb64\" (UID: \"b766e40c-d4ad-4930-b5e9-c3f67586eb64\") "
Jul 29 15:27:09.298819 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:09.298734    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b766e40c-d4ad-4930-b5e9-c3f67586eb64-home\") pod \"b766e40c-d4ad-4930-b5e9-c3f67586eb64\" (UID: \"b766e40c-d4ad-4930-b5e9-c3f67586eb64\") "
Jul 29 15:27:09.298819 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:09.298767    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b766e40c-d4ad-4930-b5e9-c3f67586eb64-dshm\") pod \"b766e40c-d4ad-4930-b5e9-c3f67586eb64\" (UID: \"b766e40c-d4ad-4930-b5e9-c3f67586eb64\") "
Jul 29 15:27:09.298946 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:09.298897    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b766e40c-d4ad-4930-b5e9-c3f67586eb64-model-cache" (OuterVolumeSpecName: "model-cache") pod "b766e40c-d4ad-4930-b5e9-c3f67586eb64" (UID: "b766e40c-d4ad-4930-b5e9-c3f67586eb64"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:27:09.299014 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:09.298978    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b766e40c-d4ad-4930-b5e9-c3f67586eb64-home" (OuterVolumeSpecName: "home") pod "b766e40c-d4ad-4930-b5e9-c3f67586eb64" (UID: "b766e40c-d4ad-4930-b5e9-c3f67586eb64"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:27:09.299053 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:09.299027    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b766e40c-d4ad-4930-b5e9-c3f67586eb64-tmp-dir\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:27:09.299053 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:09.299041    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b766e40c-d4ad-4930-b5e9-c3f67586eb64-model-cache\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:27:09.299053 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:09.299050    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b766e40c-d4ad-4930-b5e9-c3f67586eb64-home\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:27:09.300534 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:09.300504    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b766e40c-d4ad-4930-b5e9-c3f67586eb64-kube-api-access-tmmvx" (OuterVolumeSpecName: "kube-api-access-tmmvx") pod "b766e40c-d4ad-4930-b5e9-c3f67586eb64" (UID: "b766e40c-d4ad-4930-b5e9-c3f67586eb64"). InnerVolumeSpecName "kube-api-access-tmmvx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 15:27:09.300676 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:09.300647    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b766e40c-d4ad-4930-b5e9-c3f67586eb64-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b766e40c-d4ad-4930-b5e9-c3f67586eb64" (UID: "b766e40c-d4ad-4930-b5e9-c3f67586eb64"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 15:27:09.300771 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:09.300706    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b766e40c-d4ad-4930-b5e9-c3f67586eb64-dshm" (OuterVolumeSpecName: "dshm") pod "b766e40c-d4ad-4930-b5e9-c3f67586eb64" (UID: "b766e40c-d4ad-4930-b5e9-c3f67586eb64"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:27:09.400357 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:09.400334    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b766e40c-d4ad-4930-b5e9-c3f67586eb64-tls-certs\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:27:09.400357 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:09.400354    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b766e40c-d4ad-4930-b5e9-c3f67586eb64-dshm\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:27:09.400357 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:09.400362    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmmvx\" (UniqueName: \"kubernetes.io/projected/b766e40c-d4ad-4930-b5e9-c3f67586eb64-kube-api-access-tmmvx\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:27:09.739657 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:09.739619    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-93e799/rate-test-model-93e799-kserve-7bbbc4864c-kwzlr" podUID="e8a6baaf-11aa-4928-beab-0a099ee66e8f" containerName="main" containerID="cri-o://66dcffdc7d3e4601c4f9fe5357e37d11da43c313c41f2df27390201f6158b395" gracePeriod=45
Jul 29 15:27:09.982291 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:09.982267    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-93e799/rate-test-model-93e799-kserve-7bbbc4864c-kwzlr"
Jul 29 15:27:10.107482 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.107416    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8a6baaf-11aa-4928-beab-0a099ee66e8f-tmp-dir\") pod \"e8a6baaf-11aa-4928-beab-0a099ee66e8f\" (UID: \"e8a6baaf-11aa-4928-beab-0a099ee66e8f\") "
Jul 29 15:27:10.107482 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.107458    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tdplx\" (UniqueName: \"kubernetes.io/projected/e8a6baaf-11aa-4928-beab-0a099ee66e8f-kube-api-access-tdplx\") pod \"e8a6baaf-11aa-4928-beab-0a099ee66e8f\" (UID: \"e8a6baaf-11aa-4928-beab-0a099ee66e8f\") "
Jul 29 15:27:10.107670 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.107502    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e8a6baaf-11aa-4928-beab-0a099ee66e8f-dshm\") pod \"e8a6baaf-11aa-4928-beab-0a099ee66e8f\" (UID: \"e8a6baaf-11aa-4928-beab-0a099ee66e8f\") "
Jul 29 15:27:10.107670 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.107521    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e8a6baaf-11aa-4928-beab-0a099ee66e8f-home\") pod \"e8a6baaf-11aa-4928-beab-0a099ee66e8f\" (UID: \"e8a6baaf-11aa-4928-beab-0a099ee66e8f\") "
Jul 29 15:27:10.107670 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.107552    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e8a6baaf-11aa-4928-beab-0a099ee66e8f-model-cache\") pod \"e8a6baaf-11aa-4928-beab-0a099ee66e8f\" (UID: \"e8a6baaf-11aa-4928-beab-0a099ee66e8f\") "
Jul 29 15:27:10.107670 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.107570    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8a6baaf-11aa-4928-beab-0a099ee66e8f-tls-certs\") pod \"e8a6baaf-11aa-4928-beab-0a099ee66e8f\" (UID: \"e8a6baaf-11aa-4928-beab-0a099ee66e8f\") "
Jul 29 15:27:10.107868 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.107700    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8a6baaf-11aa-4928-beab-0a099ee66e8f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e8a6baaf-11aa-4928-beab-0a099ee66e8f" (UID: "e8a6baaf-11aa-4928-beab-0a099ee66e8f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:27:10.107928 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.107843    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8a6baaf-11aa-4928-beab-0a099ee66e8f-home" (OuterVolumeSpecName: "home") pod "e8a6baaf-11aa-4928-beab-0a099ee66e8f" (UID: "e8a6baaf-11aa-4928-beab-0a099ee66e8f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:27:10.107928 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.107883    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8a6baaf-11aa-4928-beab-0a099ee66e8f-model-cache" (OuterVolumeSpecName: "model-cache") pod "e8a6baaf-11aa-4928-beab-0a099ee66e8f" (UID: "e8a6baaf-11aa-4928-beab-0a099ee66e8f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:27:10.108018 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.107945    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8a6baaf-11aa-4928-beab-0a099ee66e8f-tmp-dir\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:27:10.108018 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.107963    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e8a6baaf-11aa-4928-beab-0a099ee66e8f-home\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:27:10.109497 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.109475    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8a6baaf-11aa-4928-beab-0a099ee66e8f-dshm" (OuterVolumeSpecName: "dshm") pod "e8a6baaf-11aa-4928-beab-0a099ee66e8f" (UID: "e8a6baaf-11aa-4928-beab-0a099ee66e8f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:27:10.109621 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.109576    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8a6baaf-11aa-4928-beab-0a099ee66e8f-kube-api-access-tdplx" (OuterVolumeSpecName: "kube-api-access-tdplx") pod "e8a6baaf-11aa-4928-beab-0a099ee66e8f" (UID: "e8a6baaf-11aa-4928-beab-0a099ee66e8f"). InnerVolumeSpecName "kube-api-access-tdplx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 15:27:10.109621 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.109606    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8a6baaf-11aa-4928-beab-0a099ee66e8f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e8a6baaf-11aa-4928-beab-0a099ee66e8f" (UID: "e8a6baaf-11aa-4928-beab-0a099ee66e8f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 15:27:10.173337 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.173306    2578 generic.go:356] "Generic (PLEG): container finished" podID="e8a6baaf-11aa-4928-beab-0a099ee66e8f" containerID="66dcffdc7d3e4601c4f9fe5357e37d11da43c313c41f2df27390201f6158b395" exitCode=0
Jul 29 15:27:10.173444 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.173353    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-93e799/rate-test-model-93e799-kserve-7bbbc4864c-kwzlr"
Jul 29 15:27:10.173444 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.173392    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-93e799/rate-test-model-93e799-kserve-7bbbc4864c-kwzlr" event={"ID":"e8a6baaf-11aa-4928-beab-0a099ee66e8f","Type":"ContainerDied","Data":"66dcffdc7d3e4601c4f9fe5357e37d11da43c313c41f2df27390201f6158b395"}
Jul 29 15:27:10.173444 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.173433    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-93e799/rate-test-model-93e799-kserve-7bbbc4864c-kwzlr" event={"ID":"e8a6baaf-11aa-4928-beab-0a099ee66e8f","Type":"ContainerDied","Data":"6a15f182c279d1afc92a6368ac4c7b3520d76b64c0f5a1e7447e881aa16e8fb7"}
Jul 29 15:27:10.173540 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.173451    2578 scope.go:117] "RemoveContainer" containerID="66dcffdc7d3e4601c4f9fe5357e37d11da43c313c41f2df27390201f6158b395"
Jul 29 15:27:10.173591 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.173578    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c73214/rate-test-model-c73214-kserve-5488f58987-9lbc4"
Jul 29 15:27:10.181649 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.181628    2578 scope.go:117] "RemoveContainer" containerID="66dcffdc7d3e4601c4f9fe5357e37d11da43c313c41f2df27390201f6158b395"
Jul 29 15:27:10.181925 ip-10-0-142-130 kubenswrapper[2578]: E0729 15:27:10.181906    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66dcffdc7d3e4601c4f9fe5357e37d11da43c313c41f2df27390201f6158b395\": container with ID starting with 66dcffdc7d3e4601c4f9fe5357e37d11da43c313c41f2df27390201f6158b395 not found: ID does not exist" containerID="66dcffdc7d3e4601c4f9fe5357e37d11da43c313c41f2df27390201f6158b395"
Jul 29 15:27:10.182005 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.181933    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66dcffdc7d3e4601c4f9fe5357e37d11da43c313c41f2df27390201f6158b395"} err="failed to get container status \"66dcffdc7d3e4601c4f9fe5357e37d11da43c313c41f2df27390201f6158b395\": rpc error: code = NotFound desc = could not find container \"66dcffdc7d3e4601c4f9fe5357e37d11da43c313c41f2df27390201f6158b395\": container with ID starting with 66dcffdc7d3e4601c4f9fe5357e37d11da43c313c41f2df27390201f6158b395 not found: ID does not exist"
Jul 29 15:27:10.204118 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.204097    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c73214/rate-test-model-c73214-kserve-5488f58987-9lbc4"]
Jul 29 15:27:10.208776 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.208759    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e8a6baaf-11aa-4928-beab-0a099ee66e8f-dshm\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:27:10.208843 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.208780    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e8a6baaf-11aa-4928-beab-0a099ee66e8f-model-cache\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:27:10.208843 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.208788    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8a6baaf-11aa-4928-beab-0a099ee66e8f-tls-certs\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:27:10.208843 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.208796    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdplx\" (UniqueName: \"kubernetes.io/projected/e8a6baaf-11aa-4928-beab-0a099ee66e8f-kube-api-access-tdplx\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:27:10.213835 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.213815    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-c73214/rate-test-model-c73214-kserve-5488f58987-9lbc4"]
Jul 29 15:27:10.234703 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.234682    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-93e799/rate-test-model-93e799-kserve-7bbbc4864c-kwzlr"]
Jul 29 15:27:10.253659 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.253640    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-93e799/rate-test-model-93e799-kserve-7bbbc4864c-kwzlr"]
Jul 29 15:27:10.280590 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.280564    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b766e40c-d4ad-4930-b5e9-c3f67586eb64" path="/var/lib/kubelet/pods/b766e40c-d4ad-4930-b5e9-c3f67586eb64/volumes"
Jul 29 15:27:10.281309 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.281289    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8a6baaf-11aa-4928-beab-0a099ee66e8f" path="/var/lib/kubelet/pods/e8a6baaf-11aa-4928-beab-0a099ee66e8f/volumes"
Jul 29 15:27:10.757162 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.757130    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7695-140291047943168"]
Jul 29 15:27:10.757517 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.757502    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6ac45d8-c14e-4be7-80de-b357797a07cd" containerName="test-curl-7695-140291047942160"
Jul 29 15:27:10.757517 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.757517    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6ac45d8-c14e-4be7-80de-b357797a07cd" containerName="test-curl-7695-140291047942160"
Jul 29 15:27:10.757646 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.757527    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8a6baaf-11aa-4928-beab-0a099ee66e8f" containerName="main"
Jul 29 15:27:10.757646 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.757532    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8a6baaf-11aa-4928-beab-0a099ee66e8f" containerName="main"
Jul 29 15:27:10.757646 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.757546    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b766e40c-d4ad-4930-b5e9-c3f67586eb64" containerName="main"
Jul 29 15:27:10.757646 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.757554    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b766e40c-d4ad-4930-b5e9-c3f67586eb64" containerName="main"
Jul 29 15:27:10.757646 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.757623    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8a6baaf-11aa-4928-beab-0a099ee66e8f" containerName="main"
Jul 29 15:27:10.757646 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.757630    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b766e40c-d4ad-4930-b5e9-c3f67586eb64" containerName="main"
Jul 29 15:27:10.757646 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.757639    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6ac45d8-c14e-4be7-80de-b357797a07cd" containerName="test-curl-7695-140291047942160"
Jul 29 15:27:10.761773 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.761753    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7695-140291047943168"
Jul 29 15:27:10.764550 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.764531    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-n6sn7\""
Jul 29 15:27:10.766962 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.766943    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7695-140291047943168"]
Jul 29 15:27:10.915333 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:10.915290    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmtbn\" (UniqueName: \"kubernetes.io/projected/3863598e-7943-45a6-b106-a6a37ccffcb0-kube-api-access-hmtbn\") pod \"test-curl-7695-140291047943168\" (UID: \"3863598e-7943-45a6-b106-a6a37ccffcb0\") " pod="opendatahub/test-curl-7695-140291047943168"
Jul 29 15:27:11.016196 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:11.016121    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmtbn\" (UniqueName: \"kubernetes.io/projected/3863598e-7943-45a6-b106-a6a37ccffcb0-kube-api-access-hmtbn\") pod \"test-curl-7695-140291047943168\" (UID: \"3863598e-7943-45a6-b106-a6a37ccffcb0\") " pod="opendatahub/test-curl-7695-140291047943168"
Jul 29 15:27:11.025207 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:11.025179    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmtbn\" (UniqueName: \"kubernetes.io/projected/3863598e-7943-45a6-b106-a6a37ccffcb0-kube-api-access-hmtbn\") pod \"test-curl-7695-140291047943168\" (UID: \"3863598e-7943-45a6-b106-a6a37ccffcb0\") " pod="opendatahub/test-curl-7695-140291047943168"
Jul 29 15:27:11.072469 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:11.072444    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7695-140291047943168"
Jul 29 15:27:11.199715 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:11.199692    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7695-140291047943168"]
Jul 29 15:27:11.202279 ip-10-0-142-130 kubenswrapper[2578]: W0729 15:27:11.202252    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3863598e_7943_45a6_b106_a6a37ccffcb0.slice/crio-255b3042e238131d1b00a6870981aa4fee136ff6452b162d17b8c7a7da399504 WatchSource:0}: Error finding container 255b3042e238131d1b00a6870981aa4fee136ff6452b162d17b8c7a7da399504: Status 404 returned error can't find the container with id 255b3042e238131d1b00a6870981aa4fee136ff6452b162d17b8c7a7da399504
Jul 29 15:27:12.189876 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:12.189844    2578 generic.go:356] "Generic (PLEG): container finished" podID="3863598e-7943-45a6-b106-a6a37ccffcb0" containerID="50b8aa756ebb90204674cbaa05c8c44fb6d50a878c8e16ae5a6cae9aea6321f1" exitCode=0
Jul 29 15:27:12.190259 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:12.189927    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7695-140291047943168" event={"ID":"3863598e-7943-45a6-b106-a6a37ccffcb0","Type":"ContainerDied","Data":"50b8aa756ebb90204674cbaa05c8c44fb6d50a878c8e16ae5a6cae9aea6321f1"}
Jul 29 15:27:12.190259 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:12.189967    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7695-140291047943168" event={"ID":"3863598e-7943-45a6-b106-a6a37ccffcb0","Type":"ContainerStarted","Data":"255b3042e238131d1b00a6870981aa4fee136ff6452b162d17b8c7a7da399504"}
Jul 29 15:27:13.319673 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:13.319651    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7695-140291047943168"
Jul 29 15:27:13.340792 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:13.340768    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7695-140291047943168_3863598e-7943-45a6-b106-a6a37ccffcb0/test-curl-7695-140291047943168/0.log"
Jul 29 15:27:13.366555 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:13.366527    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7695-140291047943168"]
Jul 29 15:27:13.368085 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:13.368065    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7695-140291047943168"]
Jul 29 15:27:13.440130 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:13.440101    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmtbn\" (UniqueName: \"kubernetes.io/projected/3863598e-7943-45a6-b106-a6a37ccffcb0-kube-api-access-hmtbn\") pod \"3863598e-7943-45a6-b106-a6a37ccffcb0\" (UID: \"3863598e-7943-45a6-b106-a6a37ccffcb0\") "
Jul 29 15:27:13.442076 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:13.442054    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3863598e-7943-45a6-b106-a6a37ccffcb0-kube-api-access-hmtbn" (OuterVolumeSpecName: "kube-api-access-hmtbn") pod "3863598e-7943-45a6-b106-a6a37ccffcb0" (UID: "3863598e-7943-45a6-b106-a6a37ccffcb0"). InnerVolumeSpecName "kube-api-access-hmtbn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 15:27:13.541564 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:13.541538    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmtbn\" (UniqueName: \"kubernetes.io/projected/3863598e-7943-45a6-b106-a6a37ccffcb0-kube-api-access-hmtbn\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:27:14.200913 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:14.200886    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7695-140291047943168"
Jul 29 15:27:14.201100 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:14.200920    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="255b3042e238131d1b00a6870981aa4fee136ff6452b162d17b8c7a7da399504"
Jul 29 15:27:14.212822 ip-10-0-142-130 kubenswrapper[2578]: E0729 15:27:14.212795    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7695-140291047943168\" is forbidden: User \"system:node:ip-10-0-142-130.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-130.ec2.internal' and this object" podUID="3863598e-7943-45a6-b106-a6a37ccffcb0" pod="opendatahub/test-curl-7695-140291047943168"
Jul 29 15:27:14.280580 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:14.280547    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3863598e-7943-45a6-b106-a6a37ccffcb0" path="/var/lib/kubelet/pods/3863598e-7943-45a6-b106-a6a37ccffcb0/volumes"
Jul 29 15:27:25.211870 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:25.211831    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:27:43.388466 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:43.388436    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds"]
Jul 29 15:27:43.390829 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:43.388790    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3863598e-7943-45a6-b106-a6a37ccffcb0" containerName="test-curl-7695-140291047943168"
Jul 29 15:27:43.390829 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:43.388803    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3863598e-7943-45a6-b106-a6a37ccffcb0" containerName="test-curl-7695-140291047943168"
Jul 29 15:27:43.390829 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:43.388885    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3863598e-7943-45a6-b106-a6a37ccffcb0" containerName="test-curl-7695-140291047943168"
Jul 29 15:27:43.391715 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:43.391695    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds"
Jul 29 15:27:43.394386 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:43.394365    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-a4092e-openshift-default-dockercfg-h8g4v\""
Jul 29 15:27:43.405296 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:43.405273    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds"]
Jul 29 15:27:43.506062 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:43.506026    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-istiod-ca-cert\") pod \"e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds\" (UID: \"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b\") " pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds"
Jul 29 15:27:43.506259 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:43.506070    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-istio-token\") pod \"e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds\" (UID: \"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b\") " pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds"
Jul 29 15:27:43.506259 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:43.506092    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-istio-data\") pod \"e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds\" (UID: \"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b\") " pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds"
Jul 29 15:27:43.506259 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:43.506186    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-workload-certs\") pod \"e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds\" (UID: \"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b\") " pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds"
Jul 29 15:27:43.506259 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:43.506214    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-istio-envoy\") pod \"e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds\" (UID: \"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b\") " pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds"
Jul 29 15:27:43.506259 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:43.506232    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-workload-socket\") pod \"e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds\" (UID: \"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b\") " pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds"
Jul 29 15:27:43.506443 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:43.506294    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-istio-podinfo\") pod \"e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds\" (UID: \"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b\") " pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds"
Jul 29 15:27:43.506443 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:43.506327    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dknfp\" (UniqueName: \"kubernetes.io/projected/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-kube-api-access-dknfp\") pod \"e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds\" (UID: \"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b\") " pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds"
Jul 29 15:27:43.506443 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:43.506389    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-credential-socket\") pod \"e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds\" (UID: \"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b\") " pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds"
Jul 29 15:27:43.606996 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:43.606968    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-istiod-ca-cert\") pod \"e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds\" (UID: \"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b\") " pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds"
Jul 29 15:27:43.606996 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:43.607003    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-istio-token\") pod \"e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds\" (UID: \"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b\") " pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds"
Jul 29 15:27:43.607228 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:43.607022    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-istio-data\") pod \"e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds\" (UID: \"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b\") " pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds"
Jul 29 15:27:43.607228 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:43.607059    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-workload-certs\") pod \"e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds\" (UID: \"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b\") " pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds"
Jul 29 15:27:43.607228 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:43.607073    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-istio-envoy\") pod \"e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds\" (UID: \"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b\") " pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds"
Jul 29 15:27:43.607228 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:43.607095    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-workload-socket\") pod \"e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds\" (UID: \"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b\") " pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds"
Jul 29 15:27:43.607228 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:43.607124    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-istio-podinfo\") pod \"e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds\" (UID: \"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b\") " pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds"
Jul 29 15:27:43.607228 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:43.607160    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dknfp\" (UniqueName: \"kubernetes.io/projected/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-kube-api-access-dknfp\") pod \"e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds\" (UID: \"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b\") " pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds"
Jul 29 15:27:43.607228 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:43.607204    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-credential-socket\") pod \"e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds\" (UID: \"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b\") " pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds"
Jul 29 15:27:43.607606 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:43.607513    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-istio-data\") pod \"e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds\" (UID: \"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b\") " pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds"
Jul 29 15:27:43.607606 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:43.607568    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-workload-certs\") pod \"e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds\" (UID: \"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b\") " pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds"
Jul 29 15:27:43.607687 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:43.607650    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-workload-socket\") pod \"e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds\" (UID: \"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b\") " pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds"
Jul 29 15:27:43.607822 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:43.607798    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-istiod-ca-cert\") pod \"e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds\" (UID: \"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b\") " pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds"
Jul 29 15:27:43.607822 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:43.607821    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-credential-socket\") pod \"e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds\" (UID: \"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b\") " pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds"
Jul 29 15:27:43.609389 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:43.609372    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-istio-envoy\") pod \"e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds\" (UID: \"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b\") " pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds"
Jul 29 15:27:43.609639 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:43.609620    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-istio-podinfo\") pod \"e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds\" (UID: \"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b\") " pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds"
Jul 29 15:27:43.616439 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:43.616415    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-istio-token\") pod \"e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds\" (UID: \"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b\") " pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds"
Jul 29 15:27:43.616439 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:43.616433    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dknfp\" (UniqueName: \"kubernetes.io/projected/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-kube-api-access-dknfp\") pod \"e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds\" (UID: \"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b\") " pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds"
Jul 29 15:27:43.701978 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:43.701915    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds"
Jul 29 15:27:43.838477 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:43.838380    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds"]
Jul 29 15:27:43.841016 ip-10-0-142-130 kubenswrapper[2578]: W0729 15:27:43.840990    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdfb9c7c_6e5c_450b_bc1c_5fbc22eb3e3b.slice/crio-5cf2c5a90d48978d561653d494484f8d316b2957dc71da5fcfe2e6ac8918cb86 WatchSource:0}: Error finding container 5cf2c5a90d48978d561653d494484f8d316b2957dc71da5fcfe2e6ac8918cb86: Status 404 returned error can't find the container with id 5cf2c5a90d48978d561653d494484f8d316b2957dc71da5fcfe2e6ac8918cb86
Jul 29 15:27:43.843184 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:43.843146    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 15:27:43.843267 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:43.843232    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 15:27:43.843309 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:43.843298    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 15:27:44.337219 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:44.337178    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds" event={"ID":"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b","Type":"ContainerStarted","Data":"b5aa39e9399def07fe2874eb757beedf2d3720c650f8314998e9fabd6de93117"}
Jul 29 15:27:44.337398 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:44.337228    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds" event={"ID":"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b","Type":"ContainerStarted","Data":"5cf2c5a90d48978d561653d494484f8d316b2957dc71da5fcfe2e6ac8918cb86"}
Jul 29 15:27:44.366494 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:44.366439    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds" podStartSLOduration=1.366425925 podStartE2EDuration="1.366425925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:27:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:27:44.365065791 +0000 UTC m=+3136.667532397" watchObservedRunningTime="2026-07-29 15:27:44.366425925 +0000 UTC m=+3136.668892572"
Jul 29 15:27:44.702356 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:44.702281    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds"
Jul 29 15:27:44.706841 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:44.706814    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds"
Jul 29 15:27:45.343052 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:45.343024    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds"
Jul 29 15:27:45.343868 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:45.343849    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds"
Jul 29 15:27:55.606490 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:27:55.606397    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:28:04.432917 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:04.432883    2578 generic.go:356] "Generic (PLEG): container finished" podID="fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b" containerID="b5aa39e9399def07fe2874eb757beedf2d3720c650f8314998e9fabd6de93117" exitCode=0
Jul 29 15:28:04.433332 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:04.432959    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds" event={"ID":"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b","Type":"ContainerDied","Data":"b5aa39e9399def07fe2874eb757beedf2d3720c650f8314998e9fabd6de93117"}
Jul 29 15:28:04.433378 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:04.433339    2578 scope.go:117] "RemoveContainer" containerID="b5aa39e9399def07fe2874eb757beedf2d3720c650f8314998e9fabd6de93117"
Jul 29 15:28:04.434342 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:04.434318    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 15:28:04.434416 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:04.434379    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 15:28:04.434416 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:04.434411    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 15:28:05.442710 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:05.442671    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds" event={"ID":"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b","Type":"ContainerStarted","Data":"f4e0254e5761a03ffa3e7d56987fb71bb41a93957da67956a4ca391580182961"}
Jul 29 15:28:05.702454 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:05.702362    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds"
Jul 29 15:28:05.702622 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:05.702582    2578 patch_prober.go:28] interesting pod/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 29 15:28:05.702668 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:05.702640    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds" podUID="fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 29 15:28:06.702191 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:06.702160    2578 patch_prober.go:28] interesting pod/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 29 15:28:06.702641 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:06.702209    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds" podUID="fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 29 15:28:07.702959 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:07.702925    2578 patch_prober.go:28] interesting pod/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 29 15:28:07.703368 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:07.702975    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds" podUID="fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 29 15:28:08.703084 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:08.703049    2578 patch_prober.go:28] interesting pod/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 29 15:28:08.703506 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:08.703103    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds" podUID="fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 29 15:28:09.705833 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:09.705806    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds"
Jul 29 15:28:09.706261 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:09.706142    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds"
Jul 29 15:28:09.706758 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:09.706741    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds"
Jul 29 15:28:27.100298 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:27.100256    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-3261e1/ipp-route-3261e1-kserve-cdf9964f5-kl44k"]
Jul 29 15:28:27.102708 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:27.102684    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-3261e1/ipp-route-3261e1-kserve-cdf9964f5-kl44k"
Jul 29 15:28:27.105550 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:27.105524    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-3261e1\"/\"kube-root-ca.crt\""
Jul 29 15:28:27.105550 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:27.105540    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-3261e1\"/\"openshift-service-ca.crt\""
Jul 29 15:28:27.106743 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:27.106727    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-3261e1\"/\"default-dockercfg-85t58\""
Jul 29 15:28:27.106838 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:27.106766    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-3261e1\"/\"ipp-route-3261e1-kserve-self-signed-certs\""
Jul 29 15:28:27.116162 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:27.116141    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-3261e1/ipp-route-3261e1-kserve-cdf9964f5-kl44k"]
Jul 29 15:28:27.199115 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:27.199085    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/550b19bc-080e-4ef0-8839-d050c76465f6-tls-certs\") pod \"ipp-route-3261e1-kserve-cdf9964f5-kl44k\" (UID: \"550b19bc-080e-4ef0-8839-d050c76465f6\") " pod="ai-tenant-e2e-ipp-a-3261e1/ipp-route-3261e1-kserve-cdf9964f5-kl44k"
Jul 29 15:28:27.199303 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:27.199131    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/550b19bc-080e-4ef0-8839-d050c76465f6-tmp-dir\") pod \"ipp-route-3261e1-kserve-cdf9964f5-kl44k\" (UID: \"550b19bc-080e-4ef0-8839-d050c76465f6\") " pod="ai-tenant-e2e-ipp-a-3261e1/ipp-route-3261e1-kserve-cdf9964f5-kl44k"
Jul 29 15:28:27.199303 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:27.199203    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55v29\" (UniqueName: \"kubernetes.io/projected/550b19bc-080e-4ef0-8839-d050c76465f6-kube-api-access-55v29\") pod \"ipp-route-3261e1-kserve-cdf9964f5-kl44k\" (UID: \"550b19bc-080e-4ef0-8839-d050c76465f6\") " pod="ai-tenant-e2e-ipp-a-3261e1/ipp-route-3261e1-kserve-cdf9964f5-kl44k"
Jul 29 15:28:27.199303 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:27.199264    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/550b19bc-080e-4ef0-8839-d050c76465f6-dshm\") pod \"ipp-route-3261e1-kserve-cdf9964f5-kl44k\" (UID: \"550b19bc-080e-4ef0-8839-d050c76465f6\") " pod="ai-tenant-e2e-ipp-a-3261e1/ipp-route-3261e1-kserve-cdf9964f5-kl44k"
Jul 29 15:28:27.199452 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:27.199333    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/550b19bc-080e-4ef0-8839-d050c76465f6-home\") pod \"ipp-route-3261e1-kserve-cdf9964f5-kl44k\" (UID: \"550b19bc-080e-4ef0-8839-d050c76465f6\") " pod="ai-tenant-e2e-ipp-a-3261e1/ipp-route-3261e1-kserve-cdf9964f5-kl44k"
Jul 29 15:28:27.199452 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:27.199384    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/550b19bc-080e-4ef0-8839-d050c76465f6-model-cache\") pod \"ipp-route-3261e1-kserve-cdf9964f5-kl44k\" (UID: \"550b19bc-080e-4ef0-8839-d050c76465f6\") " pod="ai-tenant-e2e-ipp-a-3261e1/ipp-route-3261e1-kserve-cdf9964f5-kl44k"
Jul 29 15:28:27.300629 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:27.300591    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/550b19bc-080e-4ef0-8839-d050c76465f6-home\") pod \"ipp-route-3261e1-kserve-cdf9964f5-kl44k\" (UID: \"550b19bc-080e-4ef0-8839-d050c76465f6\") " pod="ai-tenant-e2e-ipp-a-3261e1/ipp-route-3261e1-kserve-cdf9964f5-kl44k"
Jul 29 15:28:27.300794 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:27.300651    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/550b19bc-080e-4ef0-8839-d050c76465f6-model-cache\") pod \"ipp-route-3261e1-kserve-cdf9964f5-kl44k\" (UID: \"550b19bc-080e-4ef0-8839-d050c76465f6\") " pod="ai-tenant-e2e-ipp-a-3261e1/ipp-route-3261e1-kserve-cdf9964f5-kl44k"
Jul 29 15:28:27.300794 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:27.300682    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/550b19bc-080e-4ef0-8839-d050c76465f6-tls-certs\") pod \"ipp-route-3261e1-kserve-cdf9964f5-kl44k\" (UID: \"550b19bc-080e-4ef0-8839-d050c76465f6\") " pod="ai-tenant-e2e-ipp-a-3261e1/ipp-route-3261e1-kserve-cdf9964f5-kl44k"
Jul 29 15:28:27.300794 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:27.300713    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/550b19bc-080e-4ef0-8839-d050c76465f6-tmp-dir\") pod \"ipp-route-3261e1-kserve-cdf9964f5-kl44k\" (UID: \"550b19bc-080e-4ef0-8839-d050c76465f6\") " pod="ai-tenant-e2e-ipp-a-3261e1/ipp-route-3261e1-kserve-cdf9964f5-kl44k"
Jul 29 15:28:27.300794 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:27.300759    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55v29\" (UniqueName: \"kubernetes.io/projected/550b19bc-080e-4ef0-8839-d050c76465f6-kube-api-access-55v29\") pod \"ipp-route-3261e1-kserve-cdf9964f5-kl44k\" (UID: \"550b19bc-080e-4ef0-8839-d050c76465f6\") " pod="ai-tenant-e2e-ipp-a-3261e1/ipp-route-3261e1-kserve-cdf9964f5-kl44k"
Jul 29 15:28:27.300794 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:27.300788    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/550b19bc-080e-4ef0-8839-d050c76465f6-dshm\") pod \"ipp-route-3261e1-kserve-cdf9964f5-kl44k\" (UID: \"550b19bc-080e-4ef0-8839-d050c76465f6\") " pod="ai-tenant-e2e-ipp-a-3261e1/ipp-route-3261e1-kserve-cdf9964f5-kl44k"
Jul 29 15:28:27.301125 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:27.301105    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/550b19bc-080e-4ef0-8839-d050c76465f6-model-cache\") pod \"ipp-route-3261e1-kserve-cdf9964f5-kl44k\" (UID: \"550b19bc-080e-4ef0-8839-d050c76465f6\") " pod="ai-tenant-e2e-ipp-a-3261e1/ipp-route-3261e1-kserve-cdf9964f5-kl44k"
Jul 29 15:28:27.301162 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:27.301140    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/550b19bc-080e-4ef0-8839-d050c76465f6-tmp-dir\") pod \"ipp-route-3261e1-kserve-cdf9964f5-kl44k\" (UID: \"550b19bc-080e-4ef0-8839-d050c76465f6\") " pod="ai-tenant-e2e-ipp-a-3261e1/ipp-route-3261e1-kserve-cdf9964f5-kl44k"
Jul 29 15:28:27.301213 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:27.301198    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/550b19bc-080e-4ef0-8839-d050c76465f6-home\") pod \"ipp-route-3261e1-kserve-cdf9964f5-kl44k\" (UID: \"550b19bc-080e-4ef0-8839-d050c76465f6\") " pod="ai-tenant-e2e-ipp-a-3261e1/ipp-route-3261e1-kserve-cdf9964f5-kl44k"
Jul 29 15:28:27.302985 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:27.302964    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/550b19bc-080e-4ef0-8839-d050c76465f6-dshm\") pod \"ipp-route-3261e1-kserve-cdf9964f5-kl44k\" (UID: \"550b19bc-080e-4ef0-8839-d050c76465f6\") " pod="ai-tenant-e2e-ipp-a-3261e1/ipp-route-3261e1-kserve-cdf9964f5-kl44k"
Jul 29 15:28:27.303222 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:27.303206    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/550b19bc-080e-4ef0-8839-d050c76465f6-tls-certs\") pod \"ipp-route-3261e1-kserve-cdf9964f5-kl44k\" (UID: \"550b19bc-080e-4ef0-8839-d050c76465f6\") " pod="ai-tenant-e2e-ipp-a-3261e1/ipp-route-3261e1-kserve-cdf9964f5-kl44k"
Jul 29 15:28:27.309179 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:27.309155    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55v29\" (UniqueName: \"kubernetes.io/projected/550b19bc-080e-4ef0-8839-d050c76465f6-kube-api-access-55v29\") pod \"ipp-route-3261e1-kserve-cdf9964f5-kl44k\" (UID: \"550b19bc-080e-4ef0-8839-d050c76465f6\") " pod="ai-tenant-e2e-ipp-a-3261e1/ipp-route-3261e1-kserve-cdf9964f5-kl44k"
Jul 29 15:28:27.413138 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:27.413044    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-3261e1/ipp-route-3261e1-kserve-cdf9964f5-kl44k"
Jul 29 15:28:27.548649 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:27.548627    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-3261e1/ipp-route-3261e1-kserve-cdf9964f5-kl44k"]
Jul 29 15:28:27.550931 ip-10-0-142-130 kubenswrapper[2578]: W0729 15:28:27.550902    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod550b19bc_080e_4ef0_8839_d050c76465f6.slice/crio-29a547b596a68de61951630a541c6e3064e0a7f155c3a2e4ec53745e0de9cf46 WatchSource:0}: Error finding container 29a547b596a68de61951630a541c6e3064e0a7f155c3a2e4ec53745e0de9cf46: Status 404 returned error can't find the container with id 29a547b596a68de61951630a541c6e3064e0a7f155c3a2e4ec53745e0de9cf46
Jul 29 15:28:28.552200 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:28.552161    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-3261e1/ipp-route-3261e1-kserve-cdf9964f5-kl44k" event={"ID":"550b19bc-080e-4ef0-8839-d050c76465f6","Type":"ContainerStarted","Data":"fc600ef0a0a033e92e623cf66025b2c11850e50ce2596e68c266da65b3125c42"}
Jul 29 15:28:28.552575 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:28.552212    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-3261e1/ipp-route-3261e1-kserve-cdf9964f5-kl44k" event={"ID":"550b19bc-080e-4ef0-8839-d050c76465f6","Type":"ContainerStarted","Data":"29a547b596a68de61951630a541c6e3064e0a7f155c3a2e4ec53745e0de9cf46"}
Jul 29 15:28:28.571463 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:28.571415    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-3261e1/ipp-route-3261e1-kserve-cdf9964f5-kl44k" podStartSLOduration=1.571401789 podStartE2EDuration="1.571401789s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:28:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:28:28.570211953 +0000 UTC m=+3180.872678560" watchObservedRunningTime="2026-07-29 15:28:28.571401789 +0000 UTC m=+3180.873868395"
Jul 29 15:28:30.314185 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:30.314147    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:28:37.413524 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:37.413487    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-3261e1/ipp-route-3261e1-kserve-cdf9964f5-kl44k"
Jul 29 15:28:37.414100 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:37.413539    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-3261e1/ipp-route-3261e1-kserve-cdf9964f5-kl44k"
Jul 29 15:28:37.425490 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:37.425462    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-3261e1/ipp-route-3261e1-kserve-cdf9964f5-kl44k"
Jul 29 15:28:37.608193 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:37.608159    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-3261e1/ipp-route-3261e1-kserve-cdf9964f5-kl44k"
Jul 29 15:28:58.511442 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:28:58.511410    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:29:16.717421 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:29:16.717383    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:29:47.513923 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:29:47.513887    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:30:07.515905 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:30:07.515874    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:30:14.373480 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:30:14.373448    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-3261e1/ipp-route-3261e1-kserve-cdf9964f5-kl44k"]
Jul 29 15:30:18.426762 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:30:18.426730    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:30:29.392224 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:30:29.392169    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-3261e1/ipp-route-3261e1-kserve-cdf9964f5-kl44k" podUID="550b19bc-080e-4ef0-8839-d050c76465f6" containerName="main" containerID="cri-o://fc600ef0a0a033e92e623cf66025b2c11850e50ce2596e68c266da65b3125c42" gracePeriod=45
Jul 29 15:30:29.636976 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:30:29.636951    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-3261e1/ipp-route-3261e1-kserve-cdf9964f5-kl44k"
Jul 29 15:30:29.675973 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:30:29.675885    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/550b19bc-080e-4ef0-8839-d050c76465f6-tmp-dir\") pod \"550b19bc-080e-4ef0-8839-d050c76465f6\" (UID: \"550b19bc-080e-4ef0-8839-d050c76465f6\") "
Jul 29 15:30:29.675973 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:30:29.675951    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/550b19bc-080e-4ef0-8839-d050c76465f6-tls-certs\") pod \"550b19bc-080e-4ef0-8839-d050c76465f6\" (UID: \"550b19bc-080e-4ef0-8839-d050c76465f6\") "
Jul 29 15:30:29.676169 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:30:29.675989    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/550b19bc-080e-4ef0-8839-d050c76465f6-model-cache\") pod \"550b19bc-080e-4ef0-8839-d050c76465f6\" (UID: \"550b19bc-080e-4ef0-8839-d050c76465f6\") "
Jul 29 15:30:29.676169 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:30:29.676038    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/550b19bc-080e-4ef0-8839-d050c76465f6-dshm\") pod \"550b19bc-080e-4ef0-8839-d050c76465f6\" (UID: \"550b19bc-080e-4ef0-8839-d050c76465f6\") "
Jul 29 15:30:29.676169 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:30:29.676103    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55v29\" (UniqueName: \"kubernetes.io/projected/550b19bc-080e-4ef0-8839-d050c76465f6-kube-api-access-55v29\") pod \"550b19bc-080e-4ef0-8839-d050c76465f6\" (UID: \"550b19bc-080e-4ef0-8839-d050c76465f6\") "
Jul 29 15:30:29.676169 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:30:29.676132    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/550b19bc-080e-4ef0-8839-d050c76465f6-home\") pod \"550b19bc-080e-4ef0-8839-d050c76465f6\" (UID: \"550b19bc-080e-4ef0-8839-d050c76465f6\") "
Jul 29 15:30:29.676403 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:30:29.676158    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/550b19bc-080e-4ef0-8839-d050c76465f6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "550b19bc-080e-4ef0-8839-d050c76465f6" (UID: "550b19bc-080e-4ef0-8839-d050c76465f6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:30:29.676403 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:30:29.676365    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/550b19bc-080e-4ef0-8839-d050c76465f6-model-cache" (OuterVolumeSpecName: "model-cache") pod "550b19bc-080e-4ef0-8839-d050c76465f6" (UID: "550b19bc-080e-4ef0-8839-d050c76465f6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:30:29.676521 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:30:29.676475    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/550b19bc-080e-4ef0-8839-d050c76465f6-model-cache\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:30:29.676521 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:30:29.676493    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/550b19bc-080e-4ef0-8839-d050c76465f6-tmp-dir\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:30:29.676622 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:30:29.676564    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/550b19bc-080e-4ef0-8839-d050c76465f6-home" (OuterVolumeSpecName: "home") pod "550b19bc-080e-4ef0-8839-d050c76465f6" (UID: "550b19bc-080e-4ef0-8839-d050c76465f6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:30:29.678352 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:30:29.678318    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/550b19bc-080e-4ef0-8839-d050c76465f6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "550b19bc-080e-4ef0-8839-d050c76465f6" (UID: "550b19bc-080e-4ef0-8839-d050c76465f6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 15:30:29.678479 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:30:29.678349    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/550b19bc-080e-4ef0-8839-d050c76465f6-dshm" (OuterVolumeSpecName: "dshm") pod "550b19bc-080e-4ef0-8839-d050c76465f6" (UID: "550b19bc-080e-4ef0-8839-d050c76465f6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:30:29.678578 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:30:29.678559    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/550b19bc-080e-4ef0-8839-d050c76465f6-kube-api-access-55v29" (OuterVolumeSpecName: "kube-api-access-55v29") pod "550b19bc-080e-4ef0-8839-d050c76465f6" (UID: "550b19bc-080e-4ef0-8839-d050c76465f6"). InnerVolumeSpecName "kube-api-access-55v29". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 15:30:29.777122 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:30:29.777088    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/550b19bc-080e-4ef0-8839-d050c76465f6-dshm\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:30:29.777122 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:30:29.777115    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55v29\" (UniqueName: \"kubernetes.io/projected/550b19bc-080e-4ef0-8839-d050c76465f6-kube-api-access-55v29\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:30:29.777122 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:30:29.777125    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/550b19bc-080e-4ef0-8839-d050c76465f6-home\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:30:29.777386 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:30:29.777132    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/550b19bc-080e-4ef0-8839-d050c76465f6-tls-certs\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:30:30.114323 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:30:30.114287    2578 generic.go:356] "Generic (PLEG): container finished" podID="550b19bc-080e-4ef0-8839-d050c76465f6" containerID="fc600ef0a0a033e92e623cf66025b2c11850e50ce2596e68c266da65b3125c42" exitCode=0
Jul 29 15:30:30.114490 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:30:30.114330    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-3261e1/ipp-route-3261e1-kserve-cdf9964f5-kl44k"
Jul 29 15:30:30.114490 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:30:30.114375    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-3261e1/ipp-route-3261e1-kserve-cdf9964f5-kl44k" event={"ID":"550b19bc-080e-4ef0-8839-d050c76465f6","Type":"ContainerDied","Data":"fc600ef0a0a033e92e623cf66025b2c11850e50ce2596e68c266da65b3125c42"}
Jul 29 15:30:30.114490 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:30:30.114418    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-3261e1/ipp-route-3261e1-kserve-cdf9964f5-kl44k" event={"ID":"550b19bc-080e-4ef0-8839-d050c76465f6","Type":"ContainerDied","Data":"29a547b596a68de61951630a541c6e3064e0a7f155c3a2e4ec53745e0de9cf46"}
Jul 29 15:30:30.114490 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:30:30.114434    2578 scope.go:117] "RemoveContainer" containerID="fc600ef0a0a033e92e623cf66025b2c11850e50ce2596e68c266da65b3125c42"
Jul 29 15:30:30.123158 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:30:30.123144    2578 scope.go:117] "RemoveContainer" containerID="fc600ef0a0a033e92e623cf66025b2c11850e50ce2596e68c266da65b3125c42"
Jul 29 15:30:30.123395 ip-10-0-142-130 kubenswrapper[2578]: E0729 15:30:30.123378    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc600ef0a0a033e92e623cf66025b2c11850e50ce2596e68c266da65b3125c42\": container with ID starting with fc600ef0a0a033e92e623cf66025b2c11850e50ce2596e68c266da65b3125c42 not found: ID does not exist" containerID="fc600ef0a0a033e92e623cf66025b2c11850e50ce2596e68c266da65b3125c42"
Jul 29 15:30:30.123458 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:30:30.123404    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc600ef0a0a033e92e623cf66025b2c11850e50ce2596e68c266da65b3125c42"} err="failed to get container status \"fc600ef0a0a033e92e623cf66025b2c11850e50ce2596e68c266da65b3125c42\": rpc error: code = NotFound desc = could not find container \"fc600ef0a0a033e92e623cf66025b2c11850e50ce2596e68c266da65b3125c42\": container with ID starting with fc600ef0a0a033e92e623cf66025b2c11850e50ce2596e68c266da65b3125c42 not found: ID does not exist"
Jul 29 15:30:30.135393 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:30:30.135372    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-3261e1/ipp-route-3261e1-kserve-cdf9964f5-kl44k"]
Jul 29 15:30:30.140017 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:30:30.139994    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-3261e1/ipp-route-3261e1-kserve-cdf9964f5-kl44k"]
Jul 29 15:30:30.278185 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:30:30.278154    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="550b19bc-080e-4ef0-8839-d050c76465f6" path="/var/lib/kubelet/pods/550b19bc-080e-4ef0-8839-d050c76465f6/volumes"
Jul 29 15:31:14.107880 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:14.107790    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:31:19.435129 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:19.435093    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds"]
Jul 29 15:31:19.435620 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:19.435339    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds" podUID="fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b" containerName="istio-proxy" containerID="cri-o://f4e0254e5761a03ffa3e7d56987fb71bb41a93957da67956a4ca391580182961" gracePeriod=30
Jul 29 15:31:24.678153 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:24.678125    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds"
Jul 29 15:31:24.756961 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:24.756925    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-istio-token\") pod \"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b\" (UID: \"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b\") "
Jul 29 15:31:24.757167 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:24.756975    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-workload-socket\") pod \"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b\" (UID: \"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b\") "
Jul 29 15:31:24.757167 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:24.757006    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-istio-envoy\") pod \"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b\" (UID: \"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b\") "
Jul 29 15:31:24.757167 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:24.757047    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-credential-socket\") pod \"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b\" (UID: \"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b\") "
Jul 29 15:31:24.757167 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:24.757078    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-workload-certs\") pod \"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b\" (UID: \"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b\") "
Jul 29 15:31:24.757167 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:24.757115    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-istio-podinfo\") pod \"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b\" (UID: \"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b\") "
Jul 29 15:31:24.757446 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:24.757211    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dknfp\" (UniqueName: \"kubernetes.io/projected/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-kube-api-access-dknfp\") pod \"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b\" (UID: \"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b\") "
Jul 29 15:31:24.757446 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:24.757292    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-istio-data\") pod \"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b\" (UID: \"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b\") "
Jul 29 15:31:24.757446 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:24.757321    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-istiod-ca-cert\") pod \"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b\" (UID: \"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b\") "
Jul 29 15:31:24.757446 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:24.757357    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b" (UID: "fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:31:24.757446 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:24.757376    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b" (UID: "fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:31:24.757687 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:24.757599    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-workload-socket\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:31:24.757687 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:24.757617    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-credential-socket\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:31:24.757856 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:24.757830    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b" (UID: "fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 15:31:24.757996 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:24.757960    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b" (UID: "fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:31:24.758176 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:24.758152    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-istio-data" (OuterVolumeSpecName: "istio-data") pod "fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b" (UID: "fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:31:24.759411 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:24.759389    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b" (UID: "fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 15:31:24.759551 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:24.759534    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b" (UID: "fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:31:24.759680 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:24.759655    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-istio-token" (OuterVolumeSpecName: "istio-token") pod "fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b" (UID: "fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 15:31:24.759805 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:24.759677    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-kube-api-access-dknfp" (OuterVolumeSpecName: "kube-api-access-dknfp") pod "fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b" (UID: "fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b"). InnerVolumeSpecName "kube-api-access-dknfp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 15:31:24.858939 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:24.858905    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-istio-data\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:31:24.858939 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:24.858934    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-istiod-ca-cert\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:31:24.858939 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:24.858942    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-istio-token\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:31:24.858939 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:24.858950    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-istio-envoy\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:31:24.859196 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:24.858957    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-workload-certs\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:31:24.859196 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:24.858965    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-istio-podinfo\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:31:24.859196 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:24.858972    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dknfp\" (UniqueName: \"kubernetes.io/projected/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b-kube-api-access-dknfp\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:31:25.370852 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:25.370816    2578 generic.go:356] "Generic (PLEG): container finished" podID="fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b" containerID="f4e0254e5761a03ffa3e7d56987fb71bb41a93957da67956a4ca391580182961" exitCode=0
Jul 29 15:31:25.371026 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:25.370867    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds"
Jul 29 15:31:25.371026 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:25.370867    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds" event={"ID":"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b","Type":"ContainerDied","Data":"f4e0254e5761a03ffa3e7d56987fb71bb41a93957da67956a4ca391580182961"}
Jul 29 15:31:25.371026 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:25.370929    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds" event={"ID":"fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b","Type":"ContainerDied","Data":"5cf2c5a90d48978d561653d494484f8d316b2957dc71da5fcfe2e6ac8918cb86"}
Jul 29 15:31:25.371026 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:25.370960    2578 scope.go:117] "RemoveContainer" containerID="f4e0254e5761a03ffa3e7d56987fb71bb41a93957da67956a4ca391580182961"
Jul 29 15:31:25.379766 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:25.379747    2578 scope.go:117] "RemoveContainer" containerID="b5aa39e9399def07fe2874eb757beedf2d3720c650f8314998e9fabd6de93117"
Jul 29 15:31:25.387262 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:25.387245    2578 scope.go:117] "RemoveContainer" containerID="f4e0254e5761a03ffa3e7d56987fb71bb41a93957da67956a4ca391580182961"
Jul 29 15:31:25.387519 ip-10-0-142-130 kubenswrapper[2578]: E0729 15:31:25.387500    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4e0254e5761a03ffa3e7d56987fb71bb41a93957da67956a4ca391580182961\": container with ID starting with f4e0254e5761a03ffa3e7d56987fb71bb41a93957da67956a4ca391580182961 not found: ID does not exist" containerID="f4e0254e5761a03ffa3e7d56987fb71bb41a93957da67956a4ca391580182961"
Jul 29 15:31:25.387560 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:25.387527    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4e0254e5761a03ffa3e7d56987fb71bb41a93957da67956a4ca391580182961"} err="failed to get container status \"f4e0254e5761a03ffa3e7d56987fb71bb41a93957da67956a4ca391580182961\": rpc error: code = NotFound desc = could not find container \"f4e0254e5761a03ffa3e7d56987fb71bb41a93957da67956a4ca391580182961\": container with ID starting with f4e0254e5761a03ffa3e7d56987fb71bb41a93957da67956a4ca391580182961 not found: ID does not exist"
Jul 29 15:31:25.387560 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:25.387546    2578 scope.go:117] "RemoveContainer" containerID="b5aa39e9399def07fe2874eb757beedf2d3720c650f8314998e9fabd6de93117"
Jul 29 15:31:25.387762 ip-10-0-142-130 kubenswrapper[2578]: E0729 15:31:25.387742    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5aa39e9399def07fe2874eb757beedf2d3720c650f8314998e9fabd6de93117\": container with ID starting with b5aa39e9399def07fe2874eb757beedf2d3720c650f8314998e9fabd6de93117 not found: ID does not exist" containerID="b5aa39e9399def07fe2874eb757beedf2d3720c650f8314998e9fabd6de93117"
Jul 29 15:31:25.387798 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:25.387768    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5aa39e9399def07fe2874eb757beedf2d3720c650f8314998e9fabd6de93117"} err="failed to get container status \"b5aa39e9399def07fe2874eb757beedf2d3720c650f8314998e9fabd6de93117\": rpc error: code = NotFound desc = could not find container \"b5aa39e9399def07fe2874eb757beedf2d3720c650f8314998e9fabd6de93117\": container with ID starting with b5aa39e9399def07fe2874eb757beedf2d3720c650f8314998e9fabd6de93117 not found: ID does not exist"
Jul 29 15:31:25.429297 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:25.429268    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds"]
Jul 29 15:31:25.435262 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:25.435223    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-a4092e-openshift-default-799bc8f5f4-mx4ds"]
Jul 29 15:31:26.277895 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:26.277863    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b" path="/var/lib/kubelet/pods/fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b/volumes"
Jul 29 15:31:28.458857 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:28.458819    2578 scope.go:117] "RemoveContainer" containerID="5908a8a0b2680e08c7221df4680709c733e1f65cf7935c9dbe11200af065a6e3"
Jul 29 15:31:33.848625 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:33.848586    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:31:37.909671 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:37.909639    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm"]
Jul 29 15:31:37.910068 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:37.909865    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm" podUID="5473b65c-746a-4f25-8572-3d1aa2db9c71" containerName="istio-proxy" containerID="cri-o://10d189f679ad68f7857094f31c8bbbf3c9cd7e65f134de9ba8bff91b7b1d92cc" gracePeriod=30
Jul 29 15:31:40.183923 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:40.183884    2578 patch_prober.go:28] interesting pod/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 15:31:40.184315 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:40.183958    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm" podUID="5473b65c-746a-4f25-8572-3d1aa2db9c71" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 15:31:43.153321 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:43.153295    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm"
Jul 29 15:31:43.235871 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:43.235850    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5473b65c-746a-4f25-8572-3d1aa2db9c71-istio-token\") pod \"5473b65c-746a-4f25-8572-3d1aa2db9c71\" (UID: \"5473b65c-746a-4f25-8572-3d1aa2db9c71\") "
Jul 29 15:31:43.236019 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:43.235887    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5473b65c-746a-4f25-8572-3d1aa2db9c71-istio-podinfo\") pod \"5473b65c-746a-4f25-8572-3d1aa2db9c71\" (UID: \"5473b65c-746a-4f25-8572-3d1aa2db9c71\") "
Jul 29 15:31:43.236019 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:43.235928    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5473b65c-746a-4f25-8572-3d1aa2db9c71-istio-envoy\") pod \"5473b65c-746a-4f25-8572-3d1aa2db9c71\" (UID: \"5473b65c-746a-4f25-8572-3d1aa2db9c71\") "
Jul 29 15:31:43.236019 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:43.235969    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pw4l5\" (UniqueName: \"kubernetes.io/projected/5473b65c-746a-4f25-8572-3d1aa2db9c71-kube-api-access-pw4l5\") pod \"5473b65c-746a-4f25-8572-3d1aa2db9c71\" (UID: \"5473b65c-746a-4f25-8572-3d1aa2db9c71\") "
Jul 29 15:31:43.236019 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:43.236002    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5473b65c-746a-4f25-8572-3d1aa2db9c71-credential-socket\") pod \"5473b65c-746a-4f25-8572-3d1aa2db9c71\" (UID: \"5473b65c-746a-4f25-8572-3d1aa2db9c71\") "
Jul 29 15:31:43.236262 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:43.236036    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5473b65c-746a-4f25-8572-3d1aa2db9c71-istio-data\") pod \"5473b65c-746a-4f25-8572-3d1aa2db9c71\" (UID: \"5473b65c-746a-4f25-8572-3d1aa2db9c71\") "
Jul 29 15:31:43.236262 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:43.236069    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5473b65c-746a-4f25-8572-3d1aa2db9c71-istiod-ca-cert\") pod \"5473b65c-746a-4f25-8572-3d1aa2db9c71\" (UID: \"5473b65c-746a-4f25-8572-3d1aa2db9c71\") "
Jul 29 15:31:43.236262 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:43.236092    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5473b65c-746a-4f25-8572-3d1aa2db9c71-workload-socket\") pod \"5473b65c-746a-4f25-8572-3d1aa2db9c71\" (UID: \"5473b65c-746a-4f25-8572-3d1aa2db9c71\") "
Jul 29 15:31:43.236262 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:43.236160    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5473b65c-746a-4f25-8572-3d1aa2db9c71-workload-certs\") pod \"5473b65c-746a-4f25-8572-3d1aa2db9c71\" (UID: \"5473b65c-746a-4f25-8572-3d1aa2db9c71\") "
Jul 29 15:31:43.236796 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:43.236478    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5473b65c-746a-4f25-8572-3d1aa2db9c71-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5473b65c-746a-4f25-8572-3d1aa2db9c71" (UID: "5473b65c-746a-4f25-8572-3d1aa2db9c71"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:31:43.236796 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:43.236684    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5473b65c-746a-4f25-8572-3d1aa2db9c71-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5473b65c-746a-4f25-8572-3d1aa2db9c71" (UID: "5473b65c-746a-4f25-8572-3d1aa2db9c71"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:31:43.236796 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:43.236702    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5473b65c-746a-4f25-8572-3d1aa2db9c71-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5473b65c-746a-4f25-8572-3d1aa2db9c71" (UID: "5473b65c-746a-4f25-8572-3d1aa2db9c71"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:31:43.236796 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:43.236588    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5473b65c-746a-4f25-8572-3d1aa2db9c71-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5473b65c-746a-4f25-8572-3d1aa2db9c71" (UID: "5473b65c-746a-4f25-8572-3d1aa2db9c71"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 15:31:43.237473 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:43.237450    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5473b65c-746a-4f25-8572-3d1aa2db9c71-istio-data" (OuterVolumeSpecName: "istio-data") pod "5473b65c-746a-4f25-8572-3d1aa2db9c71" (UID: "5473b65c-746a-4f25-8572-3d1aa2db9c71"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:31:43.238288 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:43.238261    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5473b65c-746a-4f25-8572-3d1aa2db9c71-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5473b65c-746a-4f25-8572-3d1aa2db9c71" (UID: "5473b65c-746a-4f25-8572-3d1aa2db9c71"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 15:31:43.238375 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:43.238298    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5473b65c-746a-4f25-8572-3d1aa2db9c71-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5473b65c-746a-4f25-8572-3d1aa2db9c71" (UID: "5473b65c-746a-4f25-8572-3d1aa2db9c71"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 15:31:43.238566 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:43.238544    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5473b65c-746a-4f25-8572-3d1aa2db9c71-kube-api-access-pw4l5" (OuterVolumeSpecName: "kube-api-access-pw4l5") pod "5473b65c-746a-4f25-8572-3d1aa2db9c71" (UID: "5473b65c-746a-4f25-8572-3d1aa2db9c71"). InnerVolumeSpecName "kube-api-access-pw4l5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 15:31:43.238611 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:43.238557    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5473b65c-746a-4f25-8572-3d1aa2db9c71-istio-token" (OuterVolumeSpecName: "istio-token") pod "5473b65c-746a-4f25-8572-3d1aa2db9c71" (UID: "5473b65c-746a-4f25-8572-3d1aa2db9c71"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 15:31:43.337934 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:43.337893    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5473b65c-746a-4f25-8572-3d1aa2db9c71-istio-envoy\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:31:43.337934 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:43.337931    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pw4l5\" (UniqueName: \"kubernetes.io/projected/5473b65c-746a-4f25-8572-3d1aa2db9c71-kube-api-access-pw4l5\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:31:43.337934 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:43.337944    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5473b65c-746a-4f25-8572-3d1aa2db9c71-credential-socket\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:31:43.338183 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:43.337955    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5473b65c-746a-4f25-8572-3d1aa2db9c71-istio-data\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:31:43.338183 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:43.337966    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5473b65c-746a-4f25-8572-3d1aa2db9c71-istiod-ca-cert\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:31:43.338183 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:43.337976    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5473b65c-746a-4f25-8572-3d1aa2db9c71-workload-socket\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:31:43.338183 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:43.337987    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5473b65c-746a-4f25-8572-3d1aa2db9c71-workload-certs\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:31:43.338183 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:43.337997    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5473b65c-746a-4f25-8572-3d1aa2db9c71-istio-token\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:31:43.338183 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:43.338008    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5473b65c-746a-4f25-8572-3d1aa2db9c71-istio-podinfo\") on node \"ip-10-0-142-130.ec2.internal\" DevicePath \"\""
Jul 29 15:31:43.455679 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:43.455647    2578 generic.go:356] "Generic (PLEG): container finished" podID="5473b65c-746a-4f25-8572-3d1aa2db9c71" containerID="10d189f679ad68f7857094f31c8bbbf3c9cd7e65f134de9ba8bff91b7b1d92cc" exitCode=0
Jul 29 15:31:43.455859 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:43.455691    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm" event={"ID":"5473b65c-746a-4f25-8572-3d1aa2db9c71","Type":"ContainerDied","Data":"10d189f679ad68f7857094f31c8bbbf3c9cd7e65f134de9ba8bff91b7b1d92cc"}
Jul 29 15:31:43.455859 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:43.455694    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm"
Jul 29 15:31:43.455859 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:43.455734    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm" event={"ID":"5473b65c-746a-4f25-8572-3d1aa2db9c71","Type":"ContainerDied","Data":"26f2b184e2f29bbd5aa20a13b678cd4d7c0a86990bf57480f9a4b0dfd44f5859"}
Jul 29 15:31:43.455859 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:43.455757    2578 scope.go:117] "RemoveContainer" containerID="10d189f679ad68f7857094f31c8bbbf3c9cd7e65f134de9ba8bff91b7b1d92cc"
Jul 29 15:31:43.464676 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:43.464654    2578 scope.go:117] "RemoveContainer" containerID="4ff99cf55f9c8b431f65bac2a675dea33861cd669168be4ce35f5cf4f7718003"
Jul 29 15:31:43.472951 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:43.472933    2578 scope.go:117] "RemoveContainer" containerID="10d189f679ad68f7857094f31c8bbbf3c9cd7e65f134de9ba8bff91b7b1d92cc"
Jul 29 15:31:43.473223 ip-10-0-142-130 kubenswrapper[2578]: E0729 15:31:43.473204    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10d189f679ad68f7857094f31c8bbbf3c9cd7e65f134de9ba8bff91b7b1d92cc\": container with ID starting with 10d189f679ad68f7857094f31c8bbbf3c9cd7e65f134de9ba8bff91b7b1d92cc not found: ID does not exist" containerID="10d189f679ad68f7857094f31c8bbbf3c9cd7e65f134de9ba8bff91b7b1d92cc"
Jul 29 15:31:43.473284 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:43.473256    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10d189f679ad68f7857094f31c8bbbf3c9cd7e65f134de9ba8bff91b7b1d92cc"} err="failed to get container status \"10d189f679ad68f7857094f31c8bbbf3c9cd7e65f134de9ba8bff91b7b1d92cc\": rpc error: code = NotFound desc = could not find container \"10d189f679ad68f7857094f31c8bbbf3c9cd7e65f134de9ba8bff91b7b1d92cc\": container with ID starting with 10d189f679ad68f7857094f31c8bbbf3c9cd7e65f134de9ba8bff91b7b1d92cc not found: ID does not exist"
Jul 29 15:31:43.473284 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:43.473277    2578 scope.go:117] "RemoveContainer" containerID="4ff99cf55f9c8b431f65bac2a675dea33861cd669168be4ce35f5cf4f7718003"
Jul 29 15:31:43.473565 ip-10-0-142-130 kubenswrapper[2578]: E0729 15:31:43.473529    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ff99cf55f9c8b431f65bac2a675dea33861cd669168be4ce35f5cf4f7718003\": container with ID starting with 4ff99cf55f9c8b431f65bac2a675dea33861cd669168be4ce35f5cf4f7718003 not found: ID does not exist" containerID="4ff99cf55f9c8b431f65bac2a675dea33861cd669168be4ce35f5cf4f7718003"
Jul 29 15:31:43.473614 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:43.473570    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ff99cf55f9c8b431f65bac2a675dea33861cd669168be4ce35f5cf4f7718003"} err="failed to get container status \"4ff99cf55f9c8b431f65bac2a675dea33861cd669168be4ce35f5cf4f7718003\": rpc error: code = NotFound desc = could not find container \"4ff99cf55f9c8b431f65bac2a675dea33861cd669168be4ce35f5cf4f7718003\": container with ID starting with 4ff99cf55f9c8b431f65bac2a675dea33861cd669168be4ce35f5cf4f7718003 not found: ID does not exist"
Jul 29 15:31:43.478886 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:43.478859    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm"]
Jul 29 15:31:43.483835 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:43.483813    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-c73214-openshift-default-6df979658d-jfqzm"]
Jul 29 15:31:44.278185 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:44.278143    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5473b65c-746a-4f25-8572-3d1aa2db9c71" path="/var/lib/kubelet/pods/5473b65c-746a-4f25-8572-3d1aa2db9c71/volumes"
Jul 29 15:31:51.907640 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:51.907596    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jnr2g"]
Jul 29 15:31:56.486702 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:31:56.486671    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-54795fb46c-r45s2_485ee488-44de-43ec-a35d-f84bde2dd733/authorino/0.log"
Jul 29 15:32:02.294312 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:02.294286    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-qglhw_51d991f1-423f-41e0-81cf-c3d859149afd/server/0.log"
Jul 29 15:32:02.646659 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:02.646571    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g_819750fd-a9e2-4690-8826-6bf85ad53ad7/copy-manifests/0.log"
Jul 29 15:32:02.658570 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:02.658544    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g_819750fd-a9e2-4690-8826-6bf85ad53ad7/manager/0.log"
Jul 29 15:32:04.914532 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:04.914477    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-54795fb46c-r45s2_485ee488-44de-43ec-a35d-f84bde2dd733/authorino/0.log"
Jul 29 15:32:05.274962 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:05.274932    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-pm2l8_676a23a3-d552-493a-818c-2460ccd064e6/kuadrant-console-plugin/0.log"
Jul 29 15:32:05.633093 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:05.633022    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-jnr2g_85b718ed-49e5-419c-a635-5033955e9805/limitador/0.log"
Jul 29 15:32:06.114494 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:06.114464    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg_93a8478b-bc49-484c-bd3b-7e978bbfb159/istio-proxy/0.log"
Jul 29 15:32:06.452002 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:06.451928    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-68ffcd8f6-z8x7c_6ef89b7f-3230-49d7-9c32-202bd88c7771/kube-auth-proxy/0.log"
Jul 29 15:32:06.575478 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:06.575447    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-g2pdn_5571b540-dc6c-40a3-936d-3bf485e23a83/istio-proxy/1.log"
Jul 29 15:32:07.837100 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:07.837070    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-nswgs_6bcc2414-7465-41a5-b6ca-8d71498716dd/main/0.log"
Jul 29 15:32:13.632604 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:13.632574    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mh6mr/must-gather-268g8"]
Jul 29 15:32:13.632984 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:13.632886    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="550b19bc-080e-4ef0-8839-d050c76465f6" containerName="main"
Jul 29 15:32:13.632984 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:13.632897    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="550b19bc-080e-4ef0-8839-d050c76465f6" containerName="main"
Jul 29 15:32:13.632984 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:13.632906    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5473b65c-746a-4f25-8572-3d1aa2db9c71" containerName="istio-proxy"
Jul 29 15:32:13.632984 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:13.632912    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5473b65c-746a-4f25-8572-3d1aa2db9c71" containerName="istio-proxy"
Jul 29 15:32:13.632984 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:13.632919    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5473b65c-746a-4f25-8572-3d1aa2db9c71" containerName="istio-proxy"
Jul 29 15:32:13.632984 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:13.632924    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5473b65c-746a-4f25-8572-3d1aa2db9c71" containerName="istio-proxy"
Jul 29 15:32:13.632984 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:13.632932    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b" containerName="istio-proxy"
Jul 29 15:32:13.632984 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:13.632937    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b" containerName="istio-proxy"
Jul 29 15:32:13.632984 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:13.632943    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b" containerName="istio-proxy"
Jul 29 15:32:13.632984 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:13.632948    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b" containerName="istio-proxy"
Jul 29 15:32:13.633322 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:13.633013    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b" containerName="istio-proxy"
Jul 29 15:32:13.633322 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:13.633021    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5473b65c-746a-4f25-8572-3d1aa2db9c71" containerName="istio-proxy"
Jul 29 15:32:13.633322 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:13.633026    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5473b65c-746a-4f25-8572-3d1aa2db9c71" containerName="istio-proxy"
Jul 29 15:32:13.633322 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:13.633031    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="550b19bc-080e-4ef0-8839-d050c76465f6" containerName="main"
Jul 29 15:32:13.633322 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:13.633129    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdfb9c7c-6e5c-450b-bc1c-5fbc22eb3e3b" containerName="istio-proxy"
Jul 29 15:32:13.635899 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:13.635881    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mh6mr/must-gather-268g8"
Jul 29 15:32:13.638620 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:13.638599    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mh6mr\"/\"default-dockercfg-t5t7t\""
Jul 29 15:32:13.639099 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:13.639053    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mh6mr\"/\"openshift-service-ca.crt\""
Jul 29 15:32:13.639304 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:13.639289    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mh6mr\"/\"kube-root-ca.crt\""
Jul 29 15:32:13.648561 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:13.648542    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mh6mr/must-gather-268g8"]
Jul 29 15:32:13.685967 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:13.685941    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ce844a96-5a39-4d82-bf99-421c9a213098-must-gather-output\") pod \"must-gather-268g8\" (UID: \"ce844a96-5a39-4d82-bf99-421c9a213098\") " pod="openshift-must-gather-mh6mr/must-gather-268g8"
Jul 29 15:32:13.686076 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:13.685983    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcp9w\" (UniqueName: \"kubernetes.io/projected/ce844a96-5a39-4d82-bf99-421c9a213098-kube-api-access-xcp9w\") pod \"must-gather-268g8\" (UID: \"ce844a96-5a39-4d82-bf99-421c9a213098\") " pod="openshift-must-gather-mh6mr/must-gather-268g8"
Jul 29 15:32:13.787068 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:13.787042    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ce844a96-5a39-4d82-bf99-421c9a213098-must-gather-output\") pod \"must-gather-268g8\" (UID: \"ce844a96-5a39-4d82-bf99-421c9a213098\") " pod="openshift-must-gather-mh6mr/must-gather-268g8"
Jul 29 15:32:13.787177 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:13.787082    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcp9w\" (UniqueName: \"kubernetes.io/projected/ce844a96-5a39-4d82-bf99-421c9a213098-kube-api-access-xcp9w\") pod \"must-gather-268g8\" (UID: \"ce844a96-5a39-4d82-bf99-421c9a213098\") " pod="openshift-must-gather-mh6mr/must-gather-268g8"
Jul 29 15:32:13.787454 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:13.787435    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ce844a96-5a39-4d82-bf99-421c9a213098-must-gather-output\") pod \"must-gather-268g8\" (UID: \"ce844a96-5a39-4d82-bf99-421c9a213098\") " pod="openshift-must-gather-mh6mr/must-gather-268g8"
Jul 29 15:32:13.795144 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:13.795127    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcp9w\" (UniqueName: \"kubernetes.io/projected/ce844a96-5a39-4d82-bf99-421c9a213098-kube-api-access-xcp9w\") pod \"must-gather-268g8\" (UID: \"ce844a96-5a39-4d82-bf99-421c9a213098\") " pod="openshift-must-gather-mh6mr/must-gather-268g8"
Jul 29 15:32:13.944878 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:13.944802    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mh6mr/must-gather-268g8"
Jul 29 15:32:14.066052 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:14.066028    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mh6mr/must-gather-268g8"]
Jul 29 15:32:14.067946 ip-10-0-142-130 kubenswrapper[2578]: W0729 15:32:14.067920    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce844a96_5a39_4d82_bf99_421c9a213098.slice/crio-1b0dd9408b3d62cff79c1edd2c6bd8fc6eee36af91ea0491edae9f1e26e11512 WatchSource:0}: Error finding container 1b0dd9408b3d62cff79c1edd2c6bd8fc6eee36af91ea0491edae9f1e26e11512: Status 404 returned error can't find the container with id 1b0dd9408b3d62cff79c1edd2c6bd8fc6eee36af91ea0491edae9f1e26e11512
Jul 29 15:32:14.069741 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:14.069725    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 15:32:14.600887 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:14.600854    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mh6mr/must-gather-268g8" event={"ID":"ce844a96-5a39-4d82-bf99-421c9a213098","Type":"ContainerStarted","Data":"1b0dd9408b3d62cff79c1edd2c6bd8fc6eee36af91ea0491edae9f1e26e11512"}
Jul 29 15:32:15.611057 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:15.610922    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mh6mr/must-gather-268g8" event={"ID":"ce844a96-5a39-4d82-bf99-421c9a213098","Type":"ContainerStarted","Data":"2194edb9c777ec9bd1fe8daac7bc84660cefca5e22c9ee47bc81bff19c5c3059"}
Jul 29 15:32:15.611057 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:15.610979    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mh6mr/must-gather-268g8" event={"ID":"ce844a96-5a39-4d82-bf99-421c9a213098","Type":"ContainerStarted","Data":"e5b5d6c93fe042e67d747b39517d2aa4e4a95d2be41f8c537a4801dbbadea2c7"}
Jul 29 15:32:15.628727 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:15.628677    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mh6mr/must-gather-268g8" podStartSLOduration=1.419769066 podStartE2EDuration="2.628659806s" totalImagesPullingTime="1.20889074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:32:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:32:15.626851647 +0000 UTC m=+3407.929318256" watchObservedRunningTime="2026-07-29 15:32:15.628659806 +0000 UTC m=+3407.931126415"
Jul 29 15:32:16.718955 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:16.718929    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2vpqw_a331e3af-23b3-4dd4-a427-8b1a93f9441c/global-pull-secret-syncer/0.log"
Jul 29 15:32:16.876627 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:16.876599    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fhxsx_cc65f159-92b2-4ba1-ba56-9ebde361a37f/konnectivity-agent/0.log"
Jul 29 15:32:16.971743 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:16.971653    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-130.ec2.internal_038bed7cc4edb557ac94333e7b84bbab/haproxy/0.log"
Jul 29 15:32:22.236942 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:22.236215    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-54795fb46c-r45s2_485ee488-44de-43ec-a35d-f84bde2dd733/authorino/0.log"
Jul 29 15:32:22.323384 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:22.323358    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-pm2l8_676a23a3-d552-493a-818c-2460ccd064e6/kuadrant-console-plugin/0.log"
Jul 29 15:32:22.552857 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:22.552687    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-jnr2g_85b718ed-49e5-419c-a635-5033955e9805/limitador/0.log"
Jul 29 15:32:24.382249 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:24.382207    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-jzs6j_3374b2f4-b82c-49f8-a75a-29d044c45a30/kube-state-metrics/0.log"
Jul 29 15:32:24.402869 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:24.402833    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-jzs6j_3374b2f4-b82c-49f8-a75a-29d044c45a30/kube-rbac-proxy-main/0.log"
Jul 29 15:32:24.424387 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:24.424356    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-jzs6j_3374b2f4-b82c-49f8-a75a-29d044c45a30/kube-rbac-proxy-self/0.log"
Jul 29 15:32:24.454539 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:24.454505    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5f54f66665-cnc72_b633136e-5c4d-430a-a6da-3c6756a71e29/metrics-server/0.log"
Jul 29 15:32:24.595289 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:24.595200    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gn6fx_1af5883d-41e6-4dbb-a3ef-53f2a9937964/node-exporter/0.log"
Jul 29 15:32:24.613879 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:24.613846    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gn6fx_1af5883d-41e6-4dbb-a3ef-53f2a9937964/kube-rbac-proxy/0.log"
Jul 29 15:32:24.636585 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:24.636554    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gn6fx_1af5883d-41e6-4dbb-a3ef-53f2a9937964/init-textfile/0.log"
Jul 29 15:32:24.853192 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:24.853090    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_351545a7-31c7-448e-ad93-1886c625e846/prometheus/0.log"
Jul 29 15:32:24.871786 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:24.871742    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_351545a7-31c7-448e-ad93-1886c625e846/config-reloader/0.log"
Jul 29 15:32:24.890811 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:24.890786    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_351545a7-31c7-448e-ad93-1886c625e846/thanos-sidecar/0.log"
Jul 29 15:32:24.917072 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:24.917045    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_351545a7-31c7-448e-ad93-1886c625e846/kube-rbac-proxy-web/0.log"
Jul 29 15:32:24.937367 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:24.937339    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_351545a7-31c7-448e-ad93-1886c625e846/kube-rbac-proxy/0.log"
Jul 29 15:32:24.956461 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:24.956432    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_351545a7-31c7-448e-ad93-1886c625e846/kube-rbac-proxy-thanos/0.log"
Jul 29 15:32:24.980530 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:24.980503    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_351545a7-31c7-448e-ad93-1886c625e846/init-config-reloader/0.log"
Jul 29 15:32:25.006756 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:25.006722    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-58qjn_88f100c9-c3a6-4896-bab2-7d019a4b9142/prometheus-operator/0.log"
Jul 29 15:32:25.022127 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:25.022101    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-58qjn_88f100c9-c3a6-4896-bab2-7d019a4b9142/kube-rbac-proxy/0.log"
Jul 29 15:32:25.042884 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:25.042856    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-vxwws_1f4507aa-711d-42bf-a236-7e17db4b2857/prometheus-operator-admission-webhook/0.log"
Jul 29 15:32:25.155557 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:25.155484    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69c4bf449-6w46j_0575e2d0-cace-4000-b93c-f3cddbf2fbc1/thanos-query/0.log"
Jul 29 15:32:25.178931 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:25.178904    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69c4bf449-6w46j_0575e2d0-cace-4000-b93c-f3cddbf2fbc1/kube-rbac-proxy-web/0.log"
Jul 29 15:32:25.203601 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:25.203572    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69c4bf449-6w46j_0575e2d0-cace-4000-b93c-f3cddbf2fbc1/kube-rbac-proxy/0.log"
Jul 29 15:32:25.224223 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:25.224198    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69c4bf449-6w46j_0575e2d0-cace-4000-b93c-f3cddbf2fbc1/prom-label-proxy/0.log"
Jul 29 15:32:25.252055 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:25.252024    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69c4bf449-6w46j_0575e2d0-cace-4000-b93c-f3cddbf2fbc1/kube-rbac-proxy-rules/0.log"
Jul 29 15:32:25.271843 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:25.271810    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69c4bf449-6w46j_0575e2d0-cace-4000-b93c-f3cddbf2fbc1/kube-rbac-proxy-metrics/0.log"
Jul 29 15:32:26.765197 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:26.765164    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mh6mr/perf-node-gather-daemonset-9tznc"]
Jul 29 15:32:26.773849 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:26.773821    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mh6mr/perf-node-gather-daemonset-9tznc"
Jul 29 15:32:26.781023 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:26.780997    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mh6mr/perf-node-gather-daemonset-9tznc"]
Jul 29 15:32:26.929863 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:26.929830    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c29d784f-8da4-4971-aa06-a161883b8387-proc\") pod \"perf-node-gather-daemonset-9tznc\" (UID: \"c29d784f-8da4-4971-aa06-a161883b8387\") " pod="openshift-must-gather-mh6mr/perf-node-gather-daemonset-9tznc"
Jul 29 15:32:26.930037 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:26.929877    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c29d784f-8da4-4971-aa06-a161883b8387-lib-modules\") pod \"perf-node-gather-daemonset-9tznc\" (UID: \"c29d784f-8da4-4971-aa06-a161883b8387\") " pod="openshift-must-gather-mh6mr/perf-node-gather-daemonset-9tznc"
Jul 29 15:32:26.930037 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:26.929993    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c29d784f-8da4-4971-aa06-a161883b8387-sys\") pod \"perf-node-gather-daemonset-9tznc\" (UID: \"c29d784f-8da4-4971-aa06-a161883b8387\") " pod="openshift-must-gather-mh6mr/perf-node-gather-daemonset-9tznc"
Jul 29 15:32:26.930134 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:26.930032    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c29d784f-8da4-4971-aa06-a161883b8387-podres\") pod \"perf-node-gather-daemonset-9tznc\" (UID: \"c29d784f-8da4-4971-aa06-a161883b8387\") " pod="openshift-must-gather-mh6mr/perf-node-gather-daemonset-9tznc"
Jul 29 15:32:26.930134 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:26.930103    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q45xh\" (UniqueName: \"kubernetes.io/projected/c29d784f-8da4-4971-aa06-a161883b8387-kube-api-access-q45xh\") pod \"perf-node-gather-daemonset-9tznc\" (UID: \"c29d784f-8da4-4971-aa06-a161883b8387\") " pod="openshift-must-gather-mh6mr/perf-node-gather-daemonset-9tznc"
Jul 29 15:32:27.031454 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:27.031379    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c29d784f-8da4-4971-aa06-a161883b8387-proc\") pod \"perf-node-gather-daemonset-9tznc\" (UID: \"c29d784f-8da4-4971-aa06-a161883b8387\") " pod="openshift-must-gather-mh6mr/perf-node-gather-daemonset-9tznc"
Jul 29 15:32:27.031454 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:27.031428    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c29d784f-8da4-4971-aa06-a161883b8387-lib-modules\") pod \"perf-node-gather-daemonset-9tznc\" (UID: \"c29d784f-8da4-4971-aa06-a161883b8387\") " pod="openshift-must-gather-mh6mr/perf-node-gather-daemonset-9tznc"
Jul 29 15:32:27.031679 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:27.031520    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c29d784f-8da4-4971-aa06-a161883b8387-sys\") pod \"perf-node-gather-daemonset-9tznc\" (UID: \"c29d784f-8da4-4971-aa06-a161883b8387\") " pod="openshift-must-gather-mh6mr/perf-node-gather-daemonset-9tznc"
Jul 29 15:32:27.031679 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:27.031548    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c29d784f-8da4-4971-aa06-a161883b8387-podres\") pod \"perf-node-gather-daemonset-9tznc\" (UID: \"c29d784f-8da4-4971-aa06-a161883b8387\") " pod="openshift-must-gather-mh6mr/perf-node-gather-daemonset-9tznc"
Jul 29 15:32:27.031679 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:27.031520    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c29d784f-8da4-4971-aa06-a161883b8387-proc\") pod \"perf-node-gather-daemonset-9tznc\" (UID: \"c29d784f-8da4-4971-aa06-a161883b8387\") " pod="openshift-must-gather-mh6mr/perf-node-gather-daemonset-9tznc"
Jul 29 15:32:27.031679 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:27.031565    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c29d784f-8da4-4971-aa06-a161883b8387-sys\") pod \"perf-node-gather-daemonset-9tznc\" (UID: \"c29d784f-8da4-4971-aa06-a161883b8387\") " pod="openshift-must-gather-mh6mr/perf-node-gather-daemonset-9tznc"
Jul 29 15:32:27.031679 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:27.031634    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c29d784f-8da4-4971-aa06-a161883b8387-lib-modules\") pod \"perf-node-gather-daemonset-9tznc\" (UID: \"c29d784f-8da4-4971-aa06-a161883b8387\") " pod="openshift-must-gather-mh6mr/perf-node-gather-daemonset-9tznc"
Jul 29 15:32:27.031679 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:27.031637    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q45xh\" (UniqueName: \"kubernetes.io/projected/c29d784f-8da4-4971-aa06-a161883b8387-kube-api-access-q45xh\") pod \"perf-node-gather-daemonset-9tznc\" (UID: \"c29d784f-8da4-4971-aa06-a161883b8387\") " pod="openshift-must-gather-mh6mr/perf-node-gather-daemonset-9tznc"
Jul 29 15:32:27.031993 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:27.031698    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c29d784f-8da4-4971-aa06-a161883b8387-podres\") pod \"perf-node-gather-daemonset-9tznc\" (UID: \"c29d784f-8da4-4971-aa06-a161883b8387\") " pod="openshift-must-gather-mh6mr/perf-node-gather-daemonset-9tznc"
Jul 29 15:32:27.042128 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:27.042102    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q45xh\" (UniqueName: \"kubernetes.io/projected/c29d784f-8da4-4971-aa06-a161883b8387-kube-api-access-q45xh\") pod \"perf-node-gather-daemonset-9tznc\" (UID: \"c29d784f-8da4-4971-aa06-a161883b8387\") " pod="openshift-must-gather-mh6mr/perf-node-gather-daemonset-9tznc"
Jul 29 15:32:27.096705 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:27.096655    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mh6mr/perf-node-gather-daemonset-9tznc"
Jul 29 15:32:27.269379 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:27.267475    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mh6mr/perf-node-gather-daemonset-9tznc"]
Jul 29 15:32:27.273170 ip-10-0-142-130 kubenswrapper[2578]: W0729 15:32:27.273128    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc29d784f_8da4_4971_aa06_a161883b8387.slice/crio-299635b0eb949af248a1ca63becec659cfa978615d56abb8ce7e5f720fea0d16 WatchSource:0}: Error finding container 299635b0eb949af248a1ca63becec659cfa978615d56abb8ce7e5f720fea0d16: Status 404 returned error can't find the container with id 299635b0eb949af248a1ca63becec659cfa978615d56abb8ce7e5f720fea0d16
Jul 29 15:32:27.696671 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:27.696571    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mh6mr/perf-node-gather-daemonset-9tznc" event={"ID":"c29d784f-8da4-4971-aa06-a161883b8387","Type":"ContainerStarted","Data":"8ce4c244aa4af43791dde6b43d8e4bf0a4c004d0d14d0d6444f7dad0bc2a6e30"}
Jul 29 15:32:27.696671 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:27.696647    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mh6mr/perf-node-gather-daemonset-9tznc" event={"ID":"c29d784f-8da4-4971-aa06-a161883b8387","Type":"ContainerStarted","Data":"299635b0eb949af248a1ca63becec659cfa978615d56abb8ce7e5f720fea0d16"}
Jul 29 15:32:27.697462 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:27.697437    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mh6mr/perf-node-gather-daemonset-9tznc"
Jul 29 15:32:27.714843 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:27.714798    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mh6mr/perf-node-gather-daemonset-9tznc" podStartSLOduration=1.71478069 podStartE2EDuration="1.71478069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:32:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:32:27.714089254 +0000 UTC m=+3420.016555867" watchObservedRunningTime="2026-07-29 15:32:27.71478069 +0000 UTC m=+3420.017247295"
Jul 29 15:32:29.067488 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:29.067457    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f6wgr_87cfbdb3-8e14-4362-9ff8-a85011328e5c/dns/0.log"
Jul 29 15:32:29.087643 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:29.087615    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f6wgr_87cfbdb3-8e14-4362-9ff8-a85011328e5c/kube-rbac-proxy/0.log"
Jul 29 15:32:29.206688 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:29.206660    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7x2lq_7bd27b85-9683-41c2-a03a-acdb420a89e2/dns-node-resolver/0.log"
Jul 29 15:32:29.751148 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:29.751121    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-45d2s_19ba33a6-9b54-4130-a3e0-950186199417/node-ca/0.log"
Jul 29 15:32:30.683456 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:30.683427    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg_93a8478b-bc49-484c-bd3b-7e978bbfb159/istio-proxy/0.log"
Jul 29 15:32:30.864010 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:30.863983    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-68ffcd8f6-z8x7c_6ef89b7f-3230-49d7-9c32-202bd88c7771/kube-auth-proxy/0.log"
Jul 29 15:32:30.888537 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:30.888505    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-g2pdn_5571b540-dc6c-40a3-936d-3bf485e23a83/istio-proxy/0.log"
Jul 29 15:32:30.921710 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:30.921676    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-g2pdn_5571b540-dc6c-40a3-936d-3bf485e23a83/istio-proxy/1.log"
Jul 29 15:32:31.812213 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:31.812188    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-v7v42_8d5cdf58-6ba5-4f67-b365-f6bf6e641880/serve-healthcheck-canary/0.log"
Jul 29 15:32:32.308756 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:32.308728    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pxbfb_3d7da1fa-df00-472a-8eeb-71bd340d3e0c/kube-rbac-proxy/0.log"
Jul 29 15:32:32.325609 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:32.325578    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pxbfb_3d7da1fa-df00-472a-8eeb-71bd340d3e0c/exporter/0.log"
Jul 29 15:32:32.346955 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:32.346929    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pxbfb_3d7da1fa-df00-472a-8eeb-71bd340d3e0c/extractor/0.log"
Jul 29 15:32:34.718291 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:34.718257    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mh6mr/perf-node-gather-daemonset-9tznc"
Jul 29 15:32:34.718742 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:34.718721    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-qglhw_51d991f1-423f-41e0-81cf-c3d859149afd/server/0.log"
Jul 29 15:32:34.945625 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:34.945587    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g_819750fd-a9e2-4690-8826-6bf85ad53ad7/manager/0.log"
Jul 29 15:32:34.967317 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:34.967294    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65f9f6cd8c-jgk2g_819750fd-a9e2-4690-8826-6bf85ad53ad7/copy-manifests/0.log"
Jul 29 15:32:36.133567 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:36.133491    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg_93a8478b-bc49-484c-bd3b-7e978bbfb159/istio-proxy/0.log"
Jul 29 15:32:36.303878 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:36.303838    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-68ffcd8f6-z8x7c_6ef89b7f-3230-49d7-9c32-202bd88c7771/kube-auth-proxy/0.log"
Jul 29 15:32:36.324445 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:36.324369    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-g2pdn_5571b540-dc6c-40a3-936d-3bf485e23a83/istio-proxy/0.log"
Jul 29 15:32:36.359591 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:36.359559    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-g2pdn_5571b540-dc6c-40a3-936d-3bf485e23a83/istio-proxy/1.log"
Jul 29 15:32:36.388168 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:36.388093    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-856778fb54-q4pb7_bdb265f3-9e91-4702-aecf-7b9d05602728/manager/0.log"
Jul 29 15:32:37.721541 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:37.721513    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-rwpkg_93a8478b-bc49-484c-bd3b-7e978bbfb159/istio-proxy/0.log"
Jul 29 15:32:37.894965 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:37.894933    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-68ffcd8f6-z8x7c_6ef89b7f-3230-49d7-9c32-202bd88c7771/kube-auth-proxy/0.log"
Jul 29 15:32:37.919417 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:37.919386    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-g2pdn_5571b540-dc6c-40a3-936d-3bf485e23a83/istio-proxy/0.log"
Jul 29 15:32:37.954686 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:37.954656    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-g2pdn_5571b540-dc6c-40a3-936d-3bf485e23a83/istio-proxy/1.log"
Jul 29 15:32:42.836868 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:42.836838    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-snmxs_07bd3568-fdc0-4b2b-968f-16a9798a8837/kube-multus-additional-cni-plugins/0.log"
Jul 29 15:32:42.855698 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:42.855665    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-snmxs_07bd3568-fdc0-4b2b-968f-16a9798a8837/egress-router-binary-copy/0.log"
Jul 29 15:32:42.871599 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:42.871577    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-snmxs_07bd3568-fdc0-4b2b-968f-16a9798a8837/cni-plugins/0.log"
Jul 29 15:32:42.887585 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:42.887559    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-snmxs_07bd3568-fdc0-4b2b-968f-16a9798a8837/bond-cni-plugin/0.log"
Jul 29 15:32:42.904483 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:42.904465    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-snmxs_07bd3568-fdc0-4b2b-968f-16a9798a8837/routeoverride-cni/0.log"
Jul 29 15:32:42.921956 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:42.921933    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-snmxs_07bd3568-fdc0-4b2b-968f-16a9798a8837/whereabouts-cni-bincopy/0.log"
Jul 29 15:32:42.939258 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:42.939229    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-snmxs_07bd3568-fdc0-4b2b-968f-16a9798a8837/whereabouts-cni/0.log"
Jul 29 15:32:43.039563 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:43.039504    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xzx26_b15e08c3-042f-4cee-b09a-ac696b3a8c75/kube-multus/0.log"
Jul 29 15:32:43.060213 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:43.060181    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6mrz9_3d750720-77d3-457c-91d0-a8638d494329/network-metrics-daemon/0.log"
Jul 29 15:32:43.082576 ip-10-0-142-130 kubenswrapper[2578]: I0729 15:32:43.082553    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6mrz9_3d750720-77d3-457c-91d0-a8638d494329/kube-rbac-proxy/0.log"