AMD Threadripper 256GB vs RTX 4070
For running local LLMs · 2 reports across 1 model
Tokens per second by model
| Model | AMD Threadripper 256GB | RTX 4070 |
|---|---|---|
| Gemma 4up to 31B | 7.5n=1 | 55.0n=1 |
For running local LLMs · 2 reports across 1 model
| Model | AMD Threadripper 256GB | RTX 4070 |
|---|---|---|
| Gemma 4up to 31B | 7.5n=1 | 55.0n=1 |