TOOLS / MODEL-TO-COMPUTE
Find a home for your model.
Estimate memory requirements before comparing real hardware offers.
Market pulseLoading observations
Model requirements
ESTIMATED VRAM REQUIRED51.4GiB
Weights 32.6 GiBKV cache estimate 10.2 GiB
Assumptions, in the open.
Weights + 20% inference overhead (6× for training) + heuristic KV cache + 2 GiB runtime. KV depends on architecture, layers and batching; validate against your model.
Recommendations include 15% headroom. This is a memory estimate, not a performance or deployability guarantee. Multi-GPU models require compatible software and interconnects.
Hardware candidates
| HARDWARE | REFERENCE VRAM | MINIMUM GPUS | WITH HEADROOM | |
|---|---|---|---|---|
| 80 GB | 1 | 1 | Configure ↗ | |
| 141 GB | 1 | 1 | Configure ↗ | |
| 192 GB | 1 | 1 | Configure ↗ | |
| 180 GB | 1 | 1 | Configure ↗ | |
| 80 GB | 1 | 1 | Configure ↗ | |
| 192 GB | 1 | 1 | Configure ↗ | |
| 256 GB | 1 | 1 | Configure ↗ | |
| 48 GB | 2 | 2 | Configure ↗ | |
| 32 GB | 2 | 2 | Configure ↗ | |
| 24 GB | 3 | 3 | Configure ↗ | |
| 24 GB | 3 | 3 | Configure ↗ |