Qwen 3 30B-A3B (MoE) at FP8 (E4M3) needs 30.0 GB for its weights and 36.4 GB in total at 8K context with 8 concurrent users. That means it fits on a single Mac M3 Max (64GB). Every figure is computed by tokcalc's open-source capacity model.
| GPUs | Total VRAM | VRAM needed | Decode tok/s | Aggregate tok/s | TTFT | Cost / 1M tok | Fits? |
|---|---|---|---|---|---|---|---|
| 1× Mac | 64 GB | 36.4 GB | 130.0 | 1167 | 7.06 s | — | ✓ |
| 2× Mac | 128 GB | 36.4 GB | 221.0 | 4667 | 3.55 s | — | ✓ |
| 4× Mac | 256 GB | 36.4 GB | 442.0 | 18667 | 1.79 s | — | ✓ |
| 8× Mac | 512 GB | 36.4 GB | 884.0 | 74667 | 908.8 ms | — | ✓ |
| Context | Concurrent users | KV per request | Fits? |
|---|---|---|---|
| 4K | 84 | 412.3 MB | ✓ fits |
| 8K | 42 | 824.6 MB | ✓ fits |
| 33K | 10 | 3.22 GB | ✓ fits |
| 66K | 5 | 6.44 GB | ✓ fits |
| 131K | 2 | 12.88 GB | ✓ fits |
| GPU | GPUs | Aggregate tok/s | Cost / 1M tok |
|---|---|---|---|
| RTX 5090 32GB | 2× | 23762 | $0.0117 |
| AMD MI300X 192GB | 1× | 20670 | $0.0336 |
| A100 40GB SXM4 | 1× | 6045 | $0.0414 |
| AMD MI325X 288GB | 1× | 23400 | $0.0415 |
| A100 80GB SXM4 | 1× | 7800 | $0.0427 |
| Intel Gaudi 3 128GB | 1× | 12870 | $0.0432 |
Yes. Qwen 3 30B-A3B (MoE) at FP8 (E4M3) needs 36.4 GB including the KV cache, and Mac M3 Max (64GB) has 64 GB — so it fits on a single GPU.
130.0 tokens/sec per stream and 1167 tok/s aggregate with continuous batching at 8 concurrent users. Time to first token is 7.06 s, and inter-token latency is 7.7 ms.
— per 1M output tokens at 1× Mac M3 Max (64GB). That is the marginal hardware cost — add idle capacity, ops, and egress for the real figure.
30.0 GB for the weights at FP8 (E4M3), plus 6.4 GB of KV cache for 8 concurrent requests at 8K context — 36.4 GB total. Every extra concurrent user at long context costs more, so leave headroom.
It works. Compare — per 1M tokens against the alternatives below — the cheapest option that fits the same workload is 4× RTX 3080 10GB at $0.005513, and the fastest is 1× Cerebras CS-3 (WSE-3) at 78000 tok/s.
Same formulas, your context length, concurrency, and quantisation.