Fit is always evaluated when model sizing is available. GPU rent, paid idle capacity, API crossover, and measured optimization appear only when their required evidence exists. When the API wins, the page says so.
Fit is always evaluated when model sizing is available. GPU rent, paid idle capacity, API crossover, and measured optimization appear only when their required evidence exists. When the API wins, the page says so.
Model
microsoft/Phi-3.5-mini-instruct
GPU
NVIDIA B200 180 GB
Requests/day
50,000
GPU count
1
Quantization
FP16
Tokens/request
500 in, 500 out
Priced configuration
No comparable dated API rate is available for this model. The self-host bill remains reproducible without inventing an API baseline.
Model
microsoft/Phi-3.5-mini-instruct
Hardware
1 x NVIDIA B200 180 GB, FP16
Weights and KV cache stay separate so the fit is reproducible.
The exact command attached to this result.
vllm serve 'microsoft/Phi-3.5-mini-instruct' --dtype float16 --tensor-parallel-size 1 --max-model-len 8192 --gpu-memory-utilization 0.9Utilization and idle share are shown before the token price.
Paid idle capacity
72.3%
527.9 of 730.5 billed GPU-hours sit idle. The provider still charges every hour.
Busy GPU-hours
202.6
Useful work and paid idle time sum to the billed total above.
CEILING at 100% unit utilisation, not expected throughput. Decode is bounded by memory bandwidth and prefill by dense compute. Ideal tensor-parallel scaling is assumed for both. Real decode and prefill throughput are lower.
Decode and prefill ceilings derived from GPU memory bandwidth, dense compute, and model parameters, captured 2026-08-08
$5.89/GPU-hour, RunPod, Community Cloud, on demand
Captured 2026-08-08 (1 day ago)
At configured-shape saturation, 500 input / 500 output tokens
$1.57 / 1M output tokens
At actual utilization
$5.65 / 1M output tokens
Memory-fit rental floors
72.3% of billed GPU-hours are idle. The list shows smaller memory-fitting rental floors without claiming equivalent serving capacity.
On-demand rates are preferred for each GPU; when none is captured, the lowest dated captured tier is used. The rentable GPU catalog is ranked by one-deployment monthly rent over the contract's 730.5-hour month, rounded to cents. Equal displayed prices share a rank. These are arithmetic floors, not provider offers. Throughput, replica demand, traffic capacity, topology support, and current availability are not established.
12.5 GB required, 14.4 GB available inside the engine memory budget.
Current result memory total, Ampere, 448 GB/s memory bandwidth
One-deployment monthly rent floor
$109.58
Hyperstack, on demand
Captured 2026-08-08
Arithmetic floor for 1 GPU over the contract's 730.5-hour month. This is not a provider offer.
Open rental source12.5 GB required, 21.6 GB available inside the engine memory budget.
Current result memory total, Ampere, 768 GB/s memory bandwidth
One-deployment monthly rent floor
$116.88
RunPod, Community Cloud, on demand
Captured 2026-08-08
Arithmetic floor for 1 GPU over the contract's 730.5-hour month. This is not a provider offer.
Open rental source12.5 GB required, 43.2 GB available inside the engine memory budget.
Current result memory total, Ampere, 768 GB/s memory bandwidth
One-deployment monthly rent floor
$241.07
RunPod, Community Cloud, on demand
Captured 2026-08-08
Arithmetic floor for 1 GPU over the contract's 730.5-hour month. This is not a provider offer.
Open rental sourceComputed actions and cost signals appear only when the result supports them.
72.3% of 730.5 billed GPU-hours are idle at 27.7% derived utilization. This establishes paid idle capacity only. Throughput has not been recomputed for fewer replicas or a different GPU, so validate a measured alternative before changing serving topology.
Each available view stays on its own evidence-backed scale. Missing rows remain visibly absent.
Each marker is a full engine recomputation. Self-host prices are never connected or interpolated.
Scroll horizontally to read every volume point.
500 requests per day, 7,609,375 output tokens per month: self-host $4,302.64, no comparable API bill. 1,500 requests per day, 22,828,125 output tokens per month: self-host $4,302.64, no comparable API bill. 5,000 requests per day, 76,093,750 output tokens per month: self-host $4,302.64, no comparable API bill. 15,000 requests per day, 228,281,250 output tokens per month: self-host $4,302.64, no comparable API bill. 50,000 requests per day, 760,937,500 output tokens per month: self-host $4,302.64, no comparable API bill. 150,000 requests per day, 2,282,812,500 output tokens per month: self-host $4,302.64, no comparable API bill. 178,448 requests per day, 2,715,753,876 output tokens per month: self-host $4,302.64, no comparable API bill. 182,053 requests per day, 2,770,617,590 output tokens per month: self-host $8,605.29, no comparable API bill. 500,000 requests per day, 7,609,375,000 output tokens per month: self-host $12,907.94, no comparable API bill. 1,500,000 requests per day, 22,828,125,000 output tokens per month: self-host $38,723.81, no comparable API bill. 5,000,000 requests per day, 76,093,750,000 output tokens per month: self-host $120,474.06, no comparable API bill.
Replica counts change in whole units. Isolated self-host markers preserve each emitted price without drawing a smooth, straight, or step transition at a volume the engine did not emit. Missing API values produce no marker.
730.5 billed GPU-hours, split by the engine into useful work and paid idle capacity.
Scroll horizontally to read every chart label and value.
Busy GPU-hours: 202.6, Engine-reported share doing token work. Idle GPU-hours billed: 527.9, Engine-reported share paid while idle.
Busy and idle hours are emitted by the engine and sum to the billed GPU-hours. The provider charges both, so the idle share remains visible beside the monthly rent.
USD per GPU-hour. Cheapest captured offers and the rate used in this calculation are marked separately.
Scroll horizontally to read every chart label and value.
Lambda Cloud: $6.99, on demand GPU-hour rate, captured 2026-08-08 (1 day ago). Lambda Cloud: $6.69, on demand GPU-hour rate, captured 2026-08-09 (today). Nebius: $7.15, on demand GPU-hour rate, captured 2026-08-08 (1 day ago). Cheapest + Used: RunPod, Community Cloud: $5.89, on demand GPU-hour rate, captured 2026-08-08 (1 day ago), used by the engine for this calculation. Cheapest: RunPod, Secure Cloud: $5.89, on demand GPU-hour rate, captured 2026-08-08 (1 day ago). Verda: $6.11, on demand GPU-hour rate, captured 2026-08-08 (1 day ago).
Every rate is for the selected GPU and keeps its provider, tier, source, capture date, and age. A price without a date is not included.
No site-wide multiplier is applied. Run the exact configuration to create a receipt before comparing its measured baseline with RunInfra.
Run this configurationEvery published number keeps its source and date.
As of 2026-08-08
As of 2026-08-08
As of 2026-08-08
As of 2026-08-08
As of 2026-08-08
As of 2026-08-08
RunInfra Engine feasibility runtime-overhead policy
As of 2026-08-09
As of 2026-08-08
As of 2026-08-08
As of 2026-08-08
As of 2026-08-08
As of 2026-08-08
As of 2026-08-08
As of 2026-08-08
Priced configuration
No comparable dated API rate is available for this model. The self-host bill remains reproducible without inventing an API baseline.
Model
microsoft/Phi-3.5-mini-instruct
Hardware
1 x NVIDIA B200 180 GB, FP16
Weights and KV cache stay separate so the fit is reproducible.
The exact command attached to this result.
vllm serve 'microsoft/Phi-3.5-mini-instruct' --dtype float16 --tensor-parallel-size 1 --max-model-len 8192 --gpu-memory-utilization 0.9Utilization and idle share are shown before the token price.
Paid idle capacity
72.3%
527.9 of 730.5 billed GPU-hours sit idle. The provider still charges every hour.
Busy GPU-hours
202.6
Useful work and paid idle time sum to the billed total above.
CEILING at 100% unit utilisation, not expected throughput. Decode is bounded by memory bandwidth and prefill by dense compute. Ideal tensor-parallel scaling is assumed for both. Real decode and prefill throughput are lower.
Decode and prefill ceilings derived from GPU memory bandwidth, dense compute, and model parameters, captured 2026-08-08
$5.89/GPU-hour, RunPod, Community Cloud, on demand
Captured 2026-08-08 (1 day ago)
At configured-shape saturation, 500 input / 500 output tokens
$1.57 / 1M output tokens
At actual utilization
$5.65 / 1M output tokens
Memory-fit rental floors
72.3% of billed GPU-hours are idle. The list shows smaller memory-fitting rental floors without claiming equivalent serving capacity.
On-demand rates are preferred for each GPU; when none is captured, the lowest dated captured tier is used. The rentable GPU catalog is ranked by one-deployment monthly rent over the contract's 730.5-hour month, rounded to cents. Equal displayed prices share a rank. These are arithmetic floors, not provider offers. Throughput, replica demand, traffic capacity, topology support, and current availability are not established.
12.5 GB required, 14.4 GB available inside the engine memory budget.
Current result memory total, Ampere, 448 GB/s memory bandwidth
One-deployment monthly rent floor
$109.58
Hyperstack, on demand
Captured 2026-08-08
Arithmetic floor for 1 GPU over the contract's 730.5-hour month. This is not a provider offer.
Open rental source12.5 GB required, 21.6 GB available inside the engine memory budget.
Current result memory total, Ampere, 768 GB/s memory bandwidth
One-deployment monthly rent floor
$116.88
RunPod, Community Cloud, on demand
Captured 2026-08-08
Arithmetic floor for 1 GPU over the contract's 730.5-hour month. This is not a provider offer.
Open rental source12.5 GB required, 43.2 GB available inside the engine memory budget.
Current result memory total, Ampere, 768 GB/s memory bandwidth
One-deployment monthly rent floor
$241.07
RunPod, Community Cloud, on demand
Captured 2026-08-08
Arithmetic floor for 1 GPU over the contract's 730.5-hour month. This is not a provider offer.
Open rental sourceComputed actions and cost signals appear only when the result supports them.
72.3% of 730.5 billed GPU-hours are idle at 27.7% derived utilization. This establishes paid idle capacity only. Throughput has not been recomputed for fewer replicas or a different GPU, so validate a measured alternative before changing serving topology.
Each available view stays on its own evidence-backed scale. Missing rows remain visibly absent.
Each marker is a full engine recomputation. Self-host prices are never connected or interpolated.
Scroll horizontally to read every volume point.
500 requests per day, 7,609,375 output tokens per month: self-host $4,302.64, no comparable API bill. 1,500 requests per day, 22,828,125 output tokens per month: self-host $4,302.64, no comparable API bill. 5,000 requests per day, 76,093,750 output tokens per month: self-host $4,302.64, no comparable API bill. 15,000 requests per day, 228,281,250 output tokens per month: self-host $4,302.64, no comparable API bill. 50,000 requests per day, 760,937,500 output tokens per month: self-host $4,302.64, no comparable API bill. 150,000 requests per day, 2,282,812,500 output tokens per month: self-host $4,302.64, no comparable API bill. 178,448 requests per day, 2,715,753,876 output tokens per month: self-host $4,302.64, no comparable API bill. 182,053 requests per day, 2,770,617,590 output tokens per month: self-host $8,605.29, no comparable API bill. 500,000 requests per day, 7,609,375,000 output tokens per month: self-host $12,907.94, no comparable API bill. 1,500,000 requests per day, 22,828,125,000 output tokens per month: self-host $38,723.81, no comparable API bill. 5,000,000 requests per day, 76,093,750,000 output tokens per month: self-host $120,474.06, no comparable API bill.
Replica counts change in whole units. Isolated self-host markers preserve each emitted price without drawing a smooth, straight, or step transition at a volume the engine did not emit. Missing API values produce no marker.
730.5 billed GPU-hours, split by the engine into useful work and paid idle capacity.
Scroll horizontally to read every chart label and value.
Busy GPU-hours: 202.6, Engine-reported share doing token work. Idle GPU-hours billed: 527.9, Engine-reported share paid while idle.
Busy and idle hours are emitted by the engine and sum to the billed GPU-hours. The provider charges both, so the idle share remains visible beside the monthly rent.
USD per GPU-hour. Cheapest captured offers and the rate used in this calculation are marked separately.
Scroll horizontally to read every chart label and value.
Lambda Cloud: $6.99, on demand GPU-hour rate, captured 2026-08-08 (1 day ago). Lambda Cloud: $6.69, on demand GPU-hour rate, captured 2026-08-09 (today). Nebius: $7.15, on demand GPU-hour rate, captured 2026-08-08 (1 day ago). Cheapest + Used: RunPod, Community Cloud: $5.89, on demand GPU-hour rate, captured 2026-08-08 (1 day ago), used by the engine for this calculation. Cheapest: RunPod, Secure Cloud: $5.89, on demand GPU-hour rate, captured 2026-08-08 (1 day ago). Verda: $6.11, on demand GPU-hour rate, captured 2026-08-08 (1 day ago).
Every rate is for the selected GPU and keeps its provider, tier, source, capture date, and age. A price without a date is not included.
No site-wide multiplier is applied. Run the exact configuration to create a receipt before comparing its measured baseline with RunInfra.
Run this configurationEvery published number keeps its source and date.
As of 2026-08-08
As of 2026-08-08
As of 2026-08-08
As of 2026-08-08
As of 2026-08-08
As of 2026-08-08
RunInfra Engine feasibility runtime-overhead policy
As of 2026-08-09
As of 2026-08-08
As of 2026-08-08
As of 2026-08-08
As of 2026-08-08
As of 2026-08-08
As of 2026-08-08
As of 2026-08-08
Priced configuration
No comparable dated API rate is available for this model. The self-host bill remains reproducible without inventing an API baseline.
Model
microsoft/Phi-3.5-mini-instruct
Hardware
1 x NVIDIA B200 180 GB, FP16
Weights and KV cache stay separate so the fit is reproducible.
The exact command attached to this result.
vllm serve 'microsoft/Phi-3.5-mini-instruct' --dtype float16 --tensor-parallel-size 1 --max-model-len 8192 --gpu-memory-utilization 0.9Utilization and idle share are shown before the token price.
Paid idle capacity
72.3%
527.9 of 730.5 billed GPU-hours sit idle. The provider still charges every hour.
Busy GPU-hours
202.6
Useful work and paid idle time sum to the billed total above.
CEILING at 100% unit utilisation, not expected throughput. Decode is bounded by memory bandwidth and prefill by dense compute. Ideal tensor-parallel scaling is assumed for both. Real decode and prefill throughput are lower.
Decode and prefill ceilings derived from GPU memory bandwidth, dense compute, and model parameters, captured 2026-08-08
$5.89/GPU-hour, RunPod, Community Cloud, on demand
Captured 2026-08-08 (1 day ago)
At configured-shape saturation, 500 input / 500 output tokens
$1.57 / 1M output tokens
At actual utilization
$5.65 / 1M output tokens
Memory-fit rental floors
72.3% of billed GPU-hours are idle. The list shows smaller memory-fitting rental floors without claiming equivalent serving capacity.
On-demand rates are preferred for each GPU; when none is captured, the lowest dated captured tier is used. The rentable GPU catalog is ranked by one-deployment monthly rent over the contract's 730.5-hour month, rounded to cents. Equal displayed prices share a rank. These are arithmetic floors, not provider offers. Throughput, replica demand, traffic capacity, topology support, and current availability are not established.
12.5 GB required, 14.4 GB available inside the engine memory budget.
Current result memory total, Ampere, 448 GB/s memory bandwidth
One-deployment monthly rent floor
$109.58
Hyperstack, on demand
Captured 2026-08-08
Arithmetic floor for 1 GPU over the contract's 730.5-hour month. This is not a provider offer.
Open rental source12.5 GB required, 21.6 GB available inside the engine memory budget.
Current result memory total, Ampere, 768 GB/s memory bandwidth
One-deployment monthly rent floor
$116.88
RunPod, Community Cloud, on demand
Captured 2026-08-08
Arithmetic floor for 1 GPU over the contract's 730.5-hour month. This is not a provider offer.
Open rental source12.5 GB required, 43.2 GB available inside the engine memory budget.
Current result memory total, Ampere, 768 GB/s memory bandwidth
One-deployment monthly rent floor
$241.07
RunPod, Community Cloud, on demand
Captured 2026-08-08
Arithmetic floor for 1 GPU over the contract's 730.5-hour month. This is not a provider offer.
Open rental sourceComputed actions and cost signals appear only when the result supports them.
72.3% of 730.5 billed GPU-hours are idle at 27.7% derived utilization. This establishes paid idle capacity only. Throughput has not been recomputed for fewer replicas or a different GPU, so validate a measured alternative before changing serving topology.
Each available view stays on its own evidence-backed scale. Missing rows remain visibly absent.
Each marker is a full engine recomputation. Self-host prices are never connected or interpolated.
Scroll horizontally to read every volume point.
500 requests per day, 7,609,375 output tokens per month: self-host $4,302.64, no comparable API bill. 1,500 requests per day, 22,828,125 output tokens per month: self-host $4,302.64, no comparable API bill. 5,000 requests per day, 76,093,750 output tokens per month: self-host $4,302.64, no comparable API bill. 15,000 requests per day, 228,281,250 output tokens per month: self-host $4,302.64, no comparable API bill. 50,000 requests per day, 760,937,500 output tokens per month: self-host $4,302.64, no comparable API bill. 150,000 requests per day, 2,282,812,500 output tokens per month: self-host $4,302.64, no comparable API bill. 178,448 requests per day, 2,715,753,876 output tokens per month: self-host $4,302.64, no comparable API bill. 182,053 requests per day, 2,770,617,590 output tokens per month: self-host $8,605.29, no comparable API bill. 500,000 requests per day, 7,609,375,000 output tokens per month: self-host $12,907.94, no comparable API bill. 1,500,000 requests per day, 22,828,125,000 output tokens per month: self-host $38,723.81, no comparable API bill. 5,000,000 requests per day, 76,093,750,000 output tokens per month: self-host $120,474.06, no comparable API bill.
Replica counts change in whole units. Isolated self-host markers preserve each emitted price without drawing a smooth, straight, or step transition at a volume the engine did not emit. Missing API values produce no marker.
730.5 billed GPU-hours, split by the engine into useful work and paid idle capacity.
Scroll horizontally to read every chart label and value.
Busy GPU-hours: 202.6, Engine-reported share doing token work. Idle GPU-hours billed: 527.9, Engine-reported share paid while idle.
Busy and idle hours are emitted by the engine and sum to the billed GPU-hours. The provider charges both, so the idle share remains visible beside the monthly rent.
USD per GPU-hour. Cheapest captured offers and the rate used in this calculation are marked separately.
Scroll horizontally to read every chart label and value.
Lambda Cloud: $6.99, on demand GPU-hour rate, captured 2026-08-08 (1 day ago). Lambda Cloud: $6.69, on demand GPU-hour rate, captured 2026-08-09 (today). Nebius: $7.15, on demand GPU-hour rate, captured 2026-08-08 (1 day ago). Cheapest + Used: RunPod, Community Cloud: $5.89, on demand GPU-hour rate, captured 2026-08-08 (1 day ago), used by the engine for this calculation. Cheapest: RunPod, Secure Cloud: $5.89, on demand GPU-hour rate, captured 2026-08-08 (1 day ago). Verda: $6.11, on demand GPU-hour rate, captured 2026-08-08 (1 day ago).
Every rate is for the selected GPU and keeps its provider, tier, source, capture date, and age. A price without a date is not included.
No site-wide multiplier is applied. Run the exact configuration to create a receipt before comparing its measured baseline with RunInfra.
Run this configurationEvery published number keeps its source and date.
As of 2026-08-08
As of 2026-08-08
As of 2026-08-08
As of 2026-08-08
As of 2026-08-08
As of 2026-08-08
RunInfra Engine feasibility runtime-overhead policy
As of 2026-08-09
As of 2026-08-08
As of 2026-08-08
As of 2026-08-08
As of 2026-08-08
As of 2026-08-08
As of 2026-08-08
As of 2026-08-08
Priced configuration
No comparable dated API rate is available for this model. The self-host bill remains reproducible without inventing an API baseline.
Model
microsoft/Phi-3.5-mini-instruct
Hardware
1 x NVIDIA B200 180 GB, FP16
Weights and KV cache stay separate so the fit is reproducible.
The exact command attached to this result.
vllm serve 'microsoft/Phi-3.5-mini-instruct' --dtype float16 --tensor-parallel-size 1 --max-model-len 8192 --gpu-memory-utilization 0.9Utilization and idle share are shown before the token price.
Paid idle capacity
72.3%
527.9 of 730.5 billed GPU-hours sit idle. The provider still charges every hour.
Busy GPU-hours
202.6
Useful work and paid idle time sum to the billed total above.
CEILING at 100% unit utilisation, not expected throughput. Decode is bounded by memory bandwidth and prefill by dense compute. Ideal tensor-parallel scaling is assumed for both. Real decode and prefill throughput are lower.
Decode and prefill ceilings derived from GPU memory bandwidth, dense compute, and model parameters, captured 2026-08-08
$5.89/GPU-hour, RunPod, Community Cloud, on demand
Captured 2026-08-08 (1 day ago)
At configured-shape saturation, 500 input / 500 output tokens
$1.57 / 1M output tokens
At actual utilization
$5.65 / 1M output tokens
Memory-fit rental floors
72.3% of billed GPU-hours are idle. The list shows smaller memory-fitting rental floors without claiming equivalent serving capacity.
On-demand rates are preferred for each GPU; when none is captured, the lowest dated captured tier is used. The rentable GPU catalog is ranked by one-deployment monthly rent over the contract's 730.5-hour month, rounded to cents. Equal displayed prices share a rank. These are arithmetic floors, not provider offers. Throughput, replica demand, traffic capacity, topology support, and current availability are not established.
12.5 GB required, 14.4 GB available inside the engine memory budget.
Current result memory total, Ampere, 448 GB/s memory bandwidth
One-deployment monthly rent floor
$109.58
Hyperstack, on demand
Captured 2026-08-08
Arithmetic floor for 1 GPU over the contract's 730.5-hour month. This is not a provider offer.
Open rental source12.5 GB required, 21.6 GB available inside the engine memory budget.
Current result memory total, Ampere, 768 GB/s memory bandwidth
One-deployment monthly rent floor
$116.88
RunPod, Community Cloud, on demand
Captured 2026-08-08
Arithmetic floor for 1 GPU over the contract's 730.5-hour month. This is not a provider offer.
Open rental source12.5 GB required, 43.2 GB available inside the engine memory budget.
Current result memory total, Ampere, 768 GB/s memory bandwidth
One-deployment monthly rent floor
$241.07
RunPod, Community Cloud, on demand
Captured 2026-08-08
Arithmetic floor for 1 GPU over the contract's 730.5-hour month. This is not a provider offer.
Open rental sourceComputed actions and cost signals appear only when the result supports them.
72.3% of 730.5 billed GPU-hours are idle at 27.7% derived utilization. This establishes paid idle capacity only. Throughput has not been recomputed for fewer replicas or a different GPU, so validate a measured alternative before changing serving topology.
Each available view stays on its own evidence-backed scale. Missing rows remain visibly absent.
Each marker is a full engine recomputation. Self-host prices are never connected or interpolated.
Scroll horizontally to read every volume point.
500 requests per day, 7,609,375 output tokens per month: self-host $4,302.64, no comparable API bill. 1,500 requests per day, 22,828,125 output tokens per month: self-host $4,302.64, no comparable API bill. 5,000 requests per day, 76,093,750 output tokens per month: self-host $4,302.64, no comparable API bill. 15,000 requests per day, 228,281,250 output tokens per month: self-host $4,302.64, no comparable API bill. 50,000 requests per day, 760,937,500 output tokens per month: self-host $4,302.64, no comparable API bill. 150,000 requests per day, 2,282,812,500 output tokens per month: self-host $4,302.64, no comparable API bill. 178,448 requests per day, 2,715,753,876 output tokens per month: self-host $4,302.64, no comparable API bill. 182,053 requests per day, 2,770,617,590 output tokens per month: self-host $8,605.29, no comparable API bill. 500,000 requests per day, 7,609,375,000 output tokens per month: self-host $12,907.94, no comparable API bill. 1,500,000 requests per day, 22,828,125,000 output tokens per month: self-host $38,723.81, no comparable API bill. 5,000,000 requests per day, 76,093,750,000 output tokens per month: self-host $120,474.06, no comparable API bill.
Replica counts change in whole units. Isolated self-host markers preserve each emitted price without drawing a smooth, straight, or step transition at a volume the engine did not emit. Missing API values produce no marker.
730.5 billed GPU-hours, split by the engine into useful work and paid idle capacity.
Scroll horizontally to read every chart label and value.
Busy GPU-hours: 202.6, Engine-reported share doing token work. Idle GPU-hours billed: 527.9, Engine-reported share paid while idle.
Busy and idle hours are emitted by the engine and sum to the billed GPU-hours. The provider charges both, so the idle share remains visible beside the monthly rent.
USD per GPU-hour. Cheapest captured offers and the rate used in this calculation are marked separately.
Scroll horizontally to read every chart label and value.
Lambda Cloud: $6.99, on demand GPU-hour rate, captured 2026-08-08 (1 day ago). Lambda Cloud: $6.69, on demand GPU-hour rate, captured 2026-08-09 (today). Nebius: $7.15, on demand GPU-hour rate, captured 2026-08-08 (1 day ago). Cheapest + Used: RunPod, Community Cloud: $5.89, on demand GPU-hour rate, captured 2026-08-08 (1 day ago), used by the engine for this calculation. Cheapest: RunPod, Secure Cloud: $5.89, on demand GPU-hour rate, captured 2026-08-08 (1 day ago). Verda: $6.11, on demand GPU-hour rate, captured 2026-08-08 (1 day ago).
Every rate is for the selected GPU and keeps its provider, tier, source, capture date, and age. A price without a date is not included.
No site-wide multiplier is applied. Run the exact configuration to create a receipt before comparing its measured baseline with RunInfra.
Run this configurationEvery published number keeps its source and date.
As of 2026-08-08
As of 2026-08-08
As of 2026-08-08
As of 2026-08-08
As of 2026-08-08
As of 2026-08-08
RunInfra Engine feasibility runtime-overhead policy
As of 2026-08-09
As of 2026-08-08
As of 2026-08-08
As of 2026-08-08
As of 2026-08-08
As of 2026-08-08
As of 2026-08-08
As of 2026-08-08
The badge keeps its evidence label and links to the full result, sources, and caveats.
HTML
<a href="https://runinfra.ai/calc/phi-3.5-mini/b200/50k-req-day?context=8192"><img src="https://runinfra.ai/api/calc/badge?hfId=microsoft%2FPhi-3.5-mini-instruct&gpuId=B200&gpuCount=1&requestsPerDay=50000&avgInputTokens=500&avgOutputTokens=500&utilization=0.3&quantization=fp16" alt="Calculated by RunInfra"></a>Markdown
[](https://runinfra.ai/calc/phi-3.5-mini/b200/50k-req-day?context=8192)© 2026 RunInfra. All rights reserved.
