LLM Roofline
Beelink / Geekom / Minisforum · UMA · Backend: llama.cpp

Ryzen AI 9 HX 370 Mini-PC (64 GB) — LLM Sizing & Speed Matrix

Sub-$1k 64 GB x86 Mini-PC (Beelink SER9 / Geekom A9 Max); great for MoE A3B and 14B Q4.

Reference Pricing
$899 Street
Usable Memory
48 GiB (54 tuned)
Memory Bandwidth
120 GB/s (70% eff.)
FP16 Compute
23 TFLOPS
Roofline Ridge
123.2 FLOP/B
Power (Load / Idle)
65W / 9W

Buy or Rent Ryzen AI 9 HX 370 Mini-PC (64 GB)

Vendor & Cloud Links
Beelink SER9 (Ryzen AI 9 HX 370)
Beelink · Direct Hardware
↗
Geekom AI Mini-PC Series
Geekom · Direct Hardware
↗
Minisforum Ryzen AI Mini-PC
Minisforum · Direct Hardware
↗

All 32 Open-Weight Models on Ryzen AI 9 HX 370 Mini-PC (64 GB) (Q4_K_M @ 32k)

Model Status Weights Total @ 32k Decode TTFT (4k) Max Safe Ctx
Llama-3.3 Nemotron Super 49B COMFORTABLE 28.7 GiB 36.5 GiB 2.2 tok/s 40.83s 123k
Mixtral 8x7B Instruct COMFORTABLE 26.9 GiB 32.0 GiB 6.0 tok/s 10.67s 32k
Qwen3 32B COMFORTABLE 18.9 GiB 28.1 GiB 2.9 tok/s 27.70s 40k
Qwen2.5 Coder 32B COMFORTABLE 18.9 GiB 28.1 GiB 2.9 tok/s 27.06s 32k
DeepSeek-R1 Distill Qwen 32B COMFORTABLE 18.9 GiB 28.1 GiB 2.9 tok/s 27.06s 128k
QwQ 32B Reasoning COMFORTABLE 18.9 GiB 28.1 GiB 2.9 tok/s 27.06s 40k
GLM-4 32B 0414 COMFORTABLE 18.6 GiB 21.9 GiB 3.8 tok/s 26.82s 32k
Qwen3 30B-A3B COMFORTABLE 17.6 GiB 21.4 GiB 14.1 tok/s 3.28s 40k
Gemma 3 27B IT COMFORTABLE 15.8 GiB 20.0 GiB 4.2 tok/s 22.55s 128k
Mistral Small 3.1 24B COMFORTABLE 13.8 GiB 20.1 GiB 4.2 tok/s 19.56s 128k
Codestral 22B COMFORTABLE 12.8 GiB 21.2 GiB 4.0 tok/s 18.72s 32k
Qwen3 14B COMFORTABLE 8.5 GiB 14.8 GiB 5.8 tok/s 12.41s 40k
Qwen2.5 14B Instruct COMFORTABLE 8.5 GiB 15.8 GiB 5.4 tok/s 12.55s 32k
DeepSeek-R1 Distill Qwen 14B COMFORTABLE 8.5 GiB 15.8 GiB 5.4 tok/s 12.55s 128k
Phi-4 14B COMFORTABLE 8.5 GiB 12.8 GiB 6.8 tok/s 12.33s 16k
Gemma 3 12B IT COMFORTABLE 7.0 GiB 10.4 GiB 8.4 tok/s 10.33s 128k
Qwen3 8B COMFORTABLE 4.7 GiB 10.3 GiB 8.5 tok/s 7.00s 40k
Llama 3.1 8B Instruct COMFORTABLE 4.6 GiB 9.7 GiB 9.1 tok/s 6.82s 128k
Qwen2.5 7B Instruct COMFORTABLE 4.4 GiB 7.2 GiB 12.8 tok/s 6.38s 32k
Gemma 3 4B IT COMFORTABLE 2.5 GiB 4.2 GiB 23.4 tok/s 3.66s 128k
Qwen2.5 72B Instruct TUNABLE_UMA 41.9 GiB 53.5 GiB 1.5 tok/s 59.70s 32k
DeepSeek-R1 Distill Llama 70B TUNABLE_UMA 40.7 GiB 52.3 GiB 1.5 tok/s 58.04s 37k
Llama 3.3 70B Instruct TUNABLE_UMA 40.7 GiB 52.3 GiB 1.5 tok/s 58.04s 37k
Llama 3.1 70B Instruct TUNABLE_UMA 40.7 GiB 52.3 GiB 1.5 tok/s 58.04s 37k
DeepSeek-R1 671B OOM 386.4 GiB 390.1 GiB OOM — OOM
DeepSeek-V3 671B OOM 386.4 GiB 390.1 GiB OOM — OOM
Llama 3.1 405B Instruct OOM 233.8 GiB 252.3 GiB OOM — OOM
Llama 4 Maverick 400B-A17B OOM 231.5 GiB 238.8 GiB OOM — OOM
Qwen3 235B-A22B OOM 135.4 GiB 142.4 GiB OOM — OOM
Mixtral 8x22B Instruct OOM 81.2 GiB 89.6 GiB OOM — OOM
Command A 111B OOM 63.9 GiB 68.9 GiB OOM — OOM
Llama 4 Scout 109B-A17B OOM 62.8 GiB 70.0 GiB OOM — OOM

Interactive Ryzen AI 9 HX 370 Mini-PC (64 GB) Simulator

49.9B Dense · GQA
120 GB/s · 23 TFLOPS
3. Weight Quantization 4.85 bpw
4. KV Cache
32,768 tok
Compute Roofline
COMFORTABLE FIT Memory-Bandwidth Bound
Max Safe Ctx: 92k (123k tuned)
Memory Allocation Footprint 36.54 / 48.00 GiB usable
Weights: 28.74 GiB KV Cache: 6.13 GiB Overhead: 1.68 GiB Headroom: 11.46 GiB
Decode Speed
2.2
tok/s (batch=1)
Prefill Speed
100
prompt tok/s
TTFT Latency
40.83s
for 4,096 tok
Active Params
49.9B
of 49.9B total
llama.cpp Server Command 
llama-server -hf nvidia/Llama-3_3-Nemotron-Super-49B-v1:Q4_K_M -ngl 99 -fa on -c 32768 --port 8080
Context KV Cache Total VRAM Decode Status
4k 0.77 GiB 30.62 GiB 2.6 tok/s COMFORTABLE
8k 1.53 GiB 31.94 GiB 2.6 tok/s COMFORTABLE
16k 3.06 GiB 33.48 GiB 2.5 tok/s COMFORTABLE
32k 6.13 GiB 36.54 GiB 2.2 tok/s COMFORTABLE
64k 12.25 GiB 42.66 GiB 1.9 tok/s COMFORTABLE
128k 24.50 GiB 54.91 GiB 1.5 tok/s OOM

Buy-vs-Cloud-vs-API Monthly TCO Break-Even

USE SERVERLESS API
Own Hardware/mo
$27.27
1998.5h active + power
Cloud GPU/mo
$2045.42
@$0.89/hr spot/pod
Serverless API/mo
$13.50
Payback: 136 mo

Recommended Hardware & Cloud Deployment

Contextual to fit status

Hardware FAQ — Ryzen AI 9 HX 370 Mini-PC (64 GB)

How much usable VRAM / GPU memory does Ryzen AI 9 HX 370 Mini-PC (64 GB) actually provide for LLMs?

Out of the box, Ryzen AI 9 HX 370 Mini-PC (64 GB) safely reserves 48 GiB for GPU inference, expandable up to 54 GiB with OS UMA tuning.

What is the largest Q4_K_M model Ryzen AI 9 HX 370 Mini-PC (64 GB) can run at 32k context?

With Q4_K_M weights and FP16 KV cache at 32k context, the largest fitting model in our verified catalog on Ryzen AI 9 HX 370 Mini-PC (64 GB) is Llama-3.3 Nemotron Super 49B (49.9B total).