Equation 13 · Part 2 · The Network Is the Computer Again
subtraction
subtraction
What this part means
Subtract the following term or group from the preceding one. A leading minus marks a negative quantity.
Its job in the formula
Subtract the following term or group from the preceding one. A leading minus marks a negative quantity.
Full expression→subtraction→Article meaning
The passage around this formula
Consider the two canonical all-reduce algorithms. A ring arranges participants in a cycle and performs a reduce-scatter followed by an all-gather, each in p-1 steps carrying n/p bytes:
Learn the underlying idea
Addition combines quantities; subtraction measures the signed difference between them. Parentheses show what is combined before the rest of the expression is evaluated.
Open the illustrated addition and subtraction in an equation guide →
Sources cited in the article section
- [2] Collective communication: theory, practice, and experience ↗
- [3] NCCL Tests — Performance Reporting and Bus Bandwidth ↗
- [1] Optimization of Collective Communication Operations in MPICH ↗
These citations provide research context; check each source for the exact claim it supports.