B200 SXM 192GB has 192 GB of VRAM and 8,000 GB/s of memory bandwidth, plus 1800 GB/s of NVLink. It runs 38 models from the catalog on a single card — up to DeepSeek Coder V2 236B (MoE) — and serves Llama 3.3 70B at 1326 tok/s aggregate. All figures are computed by tokcalc's open-source capacity model.
| Vendor | NVIDIA |
| Category | datacenter |
| VRAM | 192 GB |
| Memory bandwidth | 8,000 GB/s |
| FP16/BF16 dense compute | not publicly reported |
| NVLink bandwidth | 1800 GB/s |
| Release year | 2025 |
| Typical cloud price | $6/hr |
| Note | FP4/FP8 specs only; FP16 dense not publicly reported |
| Model | Params | Quant | VRAM needed | Aggregate tok/s | Cost / 1M tok |
|---|---|---|---|---|---|
| GTE Large (1024-dim) | 0.44B | fp16 | 7.32 GB | 70909 | $0.0235 |
| Multilingual E5 Large (1024-dim) | 0.56B | fp16 | 7.56 GB | 55714 | $0.0299 |
| BGE-M3 (embed, 1024-dim) | 0.57B | fp16 | 7.58 GB | 54930 | $0.0303 |
| SmolLM2 1.7B Instruct | 1.70B | fp16 | 16.28 GB | 18353 | $0.0908 |
| Phi-3 Mini 3.8B | 3.80B | fp16 | 33.37 GB | 8211 | $0.2030 |
| Qwen 3 4B | 4B | fp16 | 17.66 GB | 7800 | $0.2137 |
| Llama 2 7B | 6.74B | fp16 | 47.84 GB | 4629 | $0.3600 |
| Qwen 2.5-VL 7B (VLM) | 7B | fp16 | 17.76 GB | 4457 | $0.3739 |
| Mistral 7B v0.3 | 7.24B | fp16 | 23.07 GB | 4309 | $0.3868 |
| Qwen2 7B | 7.62B | fp16 | 19.00 GB | 4094 | $0.4071 |
| Qwen 3 8B | 8B | fp16 | 25.66 GB | 3900 | $0.4274 |
| Llama 3 8B | 8.03B | fp16 | 24.65 GB | 3885 | $0.4290 |
| Gemma 2 9B | 9B | fp16 | 40.55 GB | 3467 | $0.4808 |
| Falcon 3 10B Instruct | 10B | fp16 | 30.74 GB | 3120 | $0.5342 |
| Pixtral 12B (VLM) | 12B | fp16 | 34.74 GB | 2600 | $0.6410 |
| OLMo 2 13B | 13B | fp16 | 36.74 GB | 2400 | $0.6944 |
| Phi-4 14B | 14B | fp16 | 38.74 GB | 2229 | $0.7479 |
| Qwen 2.5 14B | 14B | fp16 | 40.88 GB | 2229 | $0.7479 |
| Qwen 3 14B | 14B | fp16 | 38.74 GB | 2229 | $0.7479 |
| GPT-NeoX 20B | 20B | fp8 | 90.87 GB | 4680 | $0.3561 |
| GPT-OSS 20B (MoE) | 20.91B | fp8 | 22.55 GB | 26000 | $0.0641 |
| Codestral 25.08 | 22B | fp8 | 37.03 GB | 4255 | $0.3917 |
| Gemma 2 27B | 27B | fp8 | 51.70 GB | 3467 | $0.4808 |
| Qwen3.8 27B (VLM) | 27.78B | fp8 | 33.28 GB | 3369 | $0.4947 |
| Qwen 3 30B-A3B (MoE) | 30B | fp8 | 36.44 GB | 31200 | $0.0534 |
| Qwen 3 32B | 32B | fp8 | 49.18 GB | 2925 | $0.5698 |
| Mixtral 8x7B (MoE) | 46.70B | fp8 | 55.29 GB | 7256 | $0.2297 |
| Llama 3.3 70B | 70.60B | fp8 | 92.07 GB | 1326 | $1.26 |
| Llama 3 70B | 70.60B | fp8 | 92.07 GB | 1326 | $1.26 |
| Qwen 2.5-VL 72B (VLM) | 72B | fp8 | 93.47 GB | 1300 | $1.28 |
| Qwen 2.5 72B | 72.70B | fp8 | 94.17 GB | 1287 | $1.29 |
| Qwen2 72B | 72.70B | fp8 | 94.17 GB | 1287 | $1.29 |
| Llama 4 Scout 17B-16E (MoE, VLM) | 109B | awq4 | 72.83 GB | 5873 | $0.2838 |
| GPT-OSS 120B (MoE) | 116.83B | awq4 | 66.71 GB | 19576 | $0.0851 |
| Mixtral 8x22B (MoE) | 141B | awq4 | 92.58 GB | 2560 | $0.6510 |
| Mistral Large 3 (256K) | 235B | awq4 | 150.19 GB | 1406 | $1.19 |
| Qwen 3 235B-A22B (MoE) | 235B | awq4 | 141.87 GB | 4538 | $0.3673 |
| DeepSeek Coder V2 236B (MoE) | 236B | awq4 | 142.42 GB | 4754 | $0.3506 |
| GPU | Aggregate tok/s | Cost / 1M tok | $/hr |
|---|---|---|---|
| Cerebras CS-3 (WSE-3) | 45076 | — | — |
| RTX 4080 16GB | 6464 | $0.1031 | $0.3 |
| RTX A4000 16GB | 4039 | $0.1651 | $0.3 |
| RTX 5090 32GB | 4039 | $0.1376 | $0.5 |
| A100 40GB SXM4 | 3493 | $0.2863 | $0.9 |
| RTX 4090 24GB | 2272 | $0.1956 | $0.4 |
| V100 SXM2 32GB | 2028 | $0.2739 | $0.5 |
| RTX 3090 24GB | 2017 | $0.1377 | $0.25 |
| H100 SXM5 80GB | 1888 | $0.7358 | $2.5 |
| TPU v6e Trillium (32GB) | 1846 | $0.4816 | $0.8 |
| T4 16GB | 1836 | $0.2421 | $0.2 |
| A10G 24GB | 1352 | $0.2958 | $0.36 |
B200 SXM 192GB is a datacenter accelerator from NVIDIA with 192 GB of VRAM and 8,000 GB/s of memory bandwidth and 1800 GB/s of NVLink, typically around $6/hr on cloud rental. FP4/FP8 specs only; FP16 dense not publicly reported. It is aimed at production LLM serving.
38 models in the tokcalc catalog fit on one B200 SXM 192GB, up to DeepSeek Coder V2 236B (MoE) (236B params) at awq4. Below that, throughput and cost per million tokens improve as the model gets smaller.
At fp8 with 8 concurrent users, 1× B200 SXM 192GB serves 1326 tokens/sec aggregate (110.5 tok/s per stream), with a 1.58 s time to first token. That works out to $1.26 per 1M output tokens.
Around $6/hr for on-demand cloud rental (a typical 2025–2026 estimate across RunPod, Lambda, Modal, AWS, GCP and similar providers). Actual pricing varies by region, commitment, and spot availability — the Build vs Buy tab in the calculator pulls live quotes from several providers.
Memory bandwidth drives decode speed and VRAM drives capacity. B200 SXM 192GB has 8,000 GB/s of bandwidth and 192 GB of VRAM. The comparison table on this page ranks every accelerator in the catalog on the same reference workload so you can see where it lands.
Pick your model, context length, and concurrency — the calculator computes the rest with the same formulas.