RunInfraby RightNow

Pricing
Research
Contact

Dashboard Sign in Get started

Home/Glossary/Hardware

Glossary category

Hardware glossary

Definitions for inference serving terms in the hardware category.

Terms in this category

HBMHigh-bandwidth memory is stacked device memory placed close to an accelerator's compute package.
NVLinkNVLink is a high-bandwidth connection used between supported accelerators in the same system or fabric.

Related glossary categories

Batching glossary
Memory glossary
Quantization glossary
Latency glossary
Parallelism glossary
Serving glossary

RunInfraby RightNow

© 2026 RunInfra. All rights reserved.

Pipeline Builder Model APIs Cost Calculator Pricing Startups Benchmarks Docs Research News Contact

Backed by

Combinator

NVIDIA Inception Program

Ask AI about RunInfra

Part of RightNow

Security DPA AUP Cookies Terms Privacy