AMD Threadripper 256GB vs Instinct MI300X 192GB
For running local LLMs · 1 report across 1 model
Tokens per second by model
| Model | AMD Threadripper 256GB | Instinct MI300X 192GB |
|---|---|---|
| Gemma 4up to 31B | 7.5n=1 | — |
For running local LLMs · 1 report across 1 model
| Model | AMD Threadripper 256GB | Instinct MI300X 192GB |
|---|---|---|
| Gemma 4up to 31B | 7.5n=1 | — |