Fit is always evaluated when model sizing is available. GPU rent, paid idle capacity, API crossover, and measured optimization appear only when their required evidence exists. When the API wins, the page says so.
Fit is always evaluated when model sizing is available. GPU rent, paid idle capacity, API crossover, and measured optimization appear only when their required evidence exists. When the API wins, the page says so.
Fit is always evaluated when model sizing is available. GPU rent, paid idle capacity, API crossover, and measured optimization appear only when their required evidence exists. When the API wins, the page says so.
Model
Qwen/Qwen2.5-32B-Instruct
GPU
NVIDIA RTX PRO 6000 Blackwell Server Edition 96 GB
Requests/day
50,000
GPU count
1
Quantization
FP16
Tokens/request
500 in, 500 out
Estimated memory fit
No complete throughput evidence can price this configuration. Memory fit and provenance remain available while money and comparisons stay absent.
Model
Qwen/Qwen2.5-32B-Instruct
Hardware
1 x NVIDIA RTX PRO 6000 Blackwell Server Edition 96 GB, FP16
Weights and KV cache stay separate so the fit is reproducible.
A physics bound, not an expected throughput result.
24 output tok/sCeiling
Bandwidth decode CEILING, not expected throughput. Ideal tensor-parallel scaling is assumed. Real decode throughput is lower.
Decode ceiling derived from GPU memory bandwidth and model weight bytes, as of 2026-08-08
Dated GPU-hour rental prices for this hardware. They are not monthly serving totals because throughput evidence is missing.
Scroll horizontally to read every chart label and value.
AWS, US East (N. Virginia): $3.3631, on demand GPU-hour rate, captured 2026-08-08 (1 day ago). Google Cloud, Iowa us-central1: $4.4999, on demand GPU-hour rate, captured 2026-08-08 (1 day ago). Cheapest: Hyperstack: $1.85, on demand GPU-hour rate, captured 2026-08-08 (1 day ago). Microsoft Azure, East US 2: $5.50, on demand GPU-hour rate, captured 2026-08-08 (1 day ago).
These are GPU-hour rental prices only. A monthly serving total requires throughput evidence and remains absent.
This line starts the selected vLLM shape. It is not a throughput reproduction claim.
vllm serve 'Qwen/Qwen2.5-32B-Instruct' --dtype float16 --tensor-parallel-size 1 --max-model-len 8192 --gpu-memory-utilization 0.9No site-wide multiplier is applied. Run the exact configuration to create a receipt before comparing its measured baseline with RunInfra.
Run this configurationEvery published number keeps its source and date.
As of 2026-08-08
As of 2026-08-08
As of 2026-08-08
As of 2026-08-08
As of 2026-08-08
As of 2026-08-08
RunInfra Engine feasibility runtime-overhead policy
As of 2026-08-09
As of 2026-08-08
As of 2026-08-08
As of 2026-08-08
As of 2026-08-08
As of 2026-08-09
As of 2026-08-08
Embed code appears only when the calculator can publish a sourced cost for a fitting configuration.
Badge unavailable for this configuration
The calculator does not have a complete throughput source for this workload, so it withheld the cost and does not generate embed code.
RunInfraby RightNow© 2026 RunInfra. All rights reserved.
