llamaperf
Submit

RTX 4070

NVIDIA · 12GB · 1 report

See what fits on this GPU →
This page is thin (1 of 3 reports needed for indexing). Help fill it in.
LatestMost reportedFastest t/s
Tone: positive
throughput:
55.0 t/s gen
quant:
Q4_K_M (gguf)
text-generation

~55 tok/s on RTX 4070 12GB. Ada Lovelace efficiency. Source: estimated from compute-market tiers