Compound Capacity
The Worst-Case Channel Model Behind Compound Capacity
A compound channel formalizes the common situation where a designer knows the family of channels a link might experience but not which member is in force during any given transmission. Formally, a set S of conditional distributions Ws(y|x) is fixed and made known to both encoder and decoder, but the index s is selected once, held constant for the whole codeword, and never revealed. A rate is achievable only if the same codebook decodes with vanishing error for every s in S simultaneously. This is fundamentally stricter than fading models that permit averaging, because there is no statistical prior over s to lean on and no opportunity to interleave across many independent channel draws.
The capacity of this setup, proven by Blackwell, Breiman, and Thomasian and independently by Wolfowitz, is the maximin of the mutual information. The transmitter picks a single input distribution P(x) that performs as well as possible against the least favorable channel, and nature responds by minimizing over s. A universal decoder, such as maximum mutual information or minimum-distance decoding, achieves this rate without knowing s, so robustness costs nothing beyond the worst-case rate penalty. Because the maximin is dominated by the minimax, designers often verify whether a saddle point exists; for convex, compact sets the two values coincide and the least-favorable channel is well defined.
Relationship to SNR Uncertainty
For an additive white Gaussian noise link whose received SNR is known only to lie in an interval, the set S is parameterized by signal-to-noise ratio and the worst member is simply the lowest SNR. The compound capacity then collapses to the Shannon formula evaluated at that minimum SNR. This explains why fade-margin budgeting and conservative channel capacity targets are, in effect, compound-channel reasoning: the engineer trades peak throughput for a rate that the lowest expected operating point still supports without retransmission.
Governing Relations
Ccomp = maxP(x) mins ∈ S I(X; Y | s) bits per channel use
Minimax upper bound (saddle point when sets are convex):
Ccomp ≤ mins ∈ S maxP(x) I(X; Y | s)
AWGN interval, SNR ∈ [γmin, γmax]:
Ccomp = log2(1 + γmin)
Where I(X;Y|s) is the mutual information under channel s, P(x) is the input distribution, and γmin is the worst-case linear SNR. Example: a set spanning 12 to 18 dB has γmin ≈ 15.8, giving Ccomp ≈ 4.07 bit per channel use, versus 6.00 at 18 dB.
Capacity Notions Under Channel Uncertainty
| Capacity notion | Channel behavior per block | Knowledge of state | Error criterion | Formula core |
|---|---|---|---|---|
| Compound | Fixed, unknown, from set S | Set known, index unknown | Zero, uniform over S | maxP mins I |
| Ergodic | Varies fast over codeword | Distribution known | Zero, averaged | E[ I ] |
| Outage | Fixed random realization | Distribution known | Allows p outage | max R : Pr(I < R) ≤ p |
| Arbitrarily varying | Adversarial, can change per symbol | Set known | Zero, worst sequence | Random-code maximin |
| Shannon (single channel) | One fixed known channel | Fully known | Zero | maxP I(X;Y) |
Frequently Asked Questions
How does compound capacity differ from ergodic and outage capacity?
Ergodic capacity averages mutual information over a known fading distribution, assuming each codeword sees many independent realizations. Outage capacity fixes one realization per block and tolerates a small failure probability p. Compound capacity is strictest: the channel is fixed for the whole block, drawn from a known set S, and zero error is demanded uniformly over every member. It equals maxP mins ∈ S I(X;Y|s), so it is typically below the ergodic average but needs no prior over the set.
Why is the compound capacity a maximin rather than a max of an average?
The transmitter is given no statistical prior over the set S, so averaging is meaningless; the only useful guarantee is worst-case. A single input distribution P(x) is optimized against the least favorable channel, giving maxP mins I(X;Y|s). One universal codebook with a maximum-likelihood or minimum-distance decoder achieves this without knowing s. The maximin is bounded above by the minimax, and for convex, compact sets the two coincide through a saddle-point argument.
How does compound capacity apply to a millimeter-wave link with pointing or phase-noise uncertainty?
A 71 to 86 GHz E-band backhaul radio seldom knows its exact channel: residual LO phase noise, 1 to 3 dB antenna-misalignment loss, and atmospheric variation shift the effective SNR within a bounded interval. Treating the operating point as a compound set, say SNR between 12 and 18 dB, the robust rate is fixed by the worst member, log2(1 + γmin). This is why conservative MCS selection and fade-margin budgeting in fixed wireless mirror compound-channel reasoning even when the term is not named.