Skip to content

RunInfraby RightNow

Optimization
Pricing
Research
Contact

Dashboard Sign in Get started

Optimization

Measured optimization techniques for open model inference

The published catalog currently carries 2 measured techniques across 3 published packages.

Channelwise FP8 weights, dynamic per-token activations
2 published packages
Measured models
AREX-Turbo and Qwythos-9B-Claude-Mythos-5-1M
Accuracy recovery
99.35% to 107.14%
Channelwise FP8, measured selective-layer recipe
1 published package
Measured models
Qwen3.6 27B
Accuracy recovery
99.87%

Call Nemotron 3.5 Lightning 30B with Model APIs

Use a workspace API key and pay for input, cached input, and output tokens.

View Model APIs

End-to-end encryption

Isolated GPU infrastructure

No training on your data

SOC 2 Type II

RunInfraby RightNow

© 2026 RunInfra. All rights reserved.

Join the community System status

Optimization agent Model APIs Pricing Startups Benchmarks Docs Research News Contact

Backed by

Combinator

NVIDIA Inception Program

Ask AI about RunInfra

Part of RightNow

Security DPA AUP Cookies Terms Privacy