llamaperf
Calculator
Submit
Sign in
Submit
llamaperf
/
compare
/
a100-80gb-vs-h100-80gb
A100 80GB vs H100 80GB
For running local LLMs · 3 reports across 3 models
Side A
A100 80GB
Vendor
nvidia
VRAM
80GB
Memory
Discrete
Side B
H100 80GB
Vendor
nvidia
VRAM
80GB
Memory
Discrete
Tokens per second by model
Model
A100 80GB
H100 80GB
Gemma 4
up to 31B
—
125.3
n=1
Qwen3.5
up to 27B
—
—
n=1
Qwen3.6
up to 35B
—
45.0
n=1
More comparisons
A100 80GB
vs
RTX 5090
H100 80GB
vs
RTX 5090
A100 80GB
vs
RTX 3090
H100 80GB
vs
RTX 3090
A100 80GB
vs
M5 Max 128GB
A100 80GB
vs
RTX 3060 12GB