Calculator SubmitSign in

llamaperf/A100 40GB

A100 40GB

NVIDIA · 40GB · 0 reports

See what fits on this GPU →

No reports yet for the A100 40GB.

Be the first to submit

Featured in

Best GPUs for running local LLMs
Best NVIDIA GPUs for local LLMs
Best GPUs for 70B local LLMs
Best GPUs for 30B local LLMs

Compare with

A100 40GB vs RTX 5090
A100 40GB vs RTX 3090
A100 40GB vs RTX 4090
A100 40GB vs RTX A6000 48GB
A100 40GB vs RTX 3090 Ti

Browse

All GPUs
All models
All engines
Calculator
Compare GPUs
Leaderboard
Best
Guides
Calculator
News
Discussions

Best of

GPUs for running local LLMs
Mac for running local LLMs
NVIDIA GPUs for local LLMs
GPUs for 70B local LLMs
GPUs for 30B local LLMs
Mac for 70B local LLMs

Popular GPUs

M1 8GB
RTX 3060 12GB
RTX 4070
RTX 4070 Ti Super
RTX 5060 Ti 16GB
RTX 5080
RX 9070
RTX 3090

Popular models

Qwen3.6
Gemma 4
GLM-5.1
Kimi K2.6
Llama 3.1
Llama 3.3
Qwen2.5
Qwen3.5

Engines

llama.cpp
vLLM
Ollama
MLX
LM Studio

llamaperf · community-sourced local LLM performance reports

Submit a report Contact