Glossary category
Parallelism glossary
Definitions for inference serving terms in the parallelism category.
Terms in this category
- Tensor parallelismTensor parallelism shards weight matrices and their computation across multiple accelerators within each model layer.
- Pipeline parallelismPipeline parallelism divides consecutive model layers into stages placed on different devices.
- Tensor versus pipeline parallelismTensor parallelism splits work within model layers and exchanges partial results during those layers.
- Expert parallelismExpert parallelism places mixture-of-experts feed-forward experts on different devices.
- Data-parallel servingData-parallel serving runs independent model replicas and routes different requests to each replica.
Related glossary categories
RunInfraby RightNow© 2026 RunInfra. All rights reserved.
Ask AI about RunInfra
