llamaperf
Submit

AMD Threadripper 256GB vs H100 80GB

For running local LLMs · 4 reports across 3 models

Side A
AMD Threadripper 256GB
Vendor
amd
VRAM
256GB
Memory
Unified
Side B
H100 80GB
Vendor
nvidia
VRAM
80GB
Memory
Discrete

Tokens per second by model

ModelAMD Threadripper 256GBH100 80GB
Gemma 4up to 31B7.5n=1125.3n=1
Qwen3.5up to 27B——n=1
Qwen3.6up to 35B—45.0n=1

More comparisons