Compound Poisson distribution

In probability theory, a compound Poisson distribution is the probability distribution of the sum of a number of independent identically-distributed random variables, where the number of terms to be added is itself a Poisson-distributed variable. In the simplest cases, the result can be either a continuous or a discrete distribution.

Definition

Suppose that

$N\sim\operatorname{Poisson}(\lambda),$

i.e., N is a random variable whose distribution is a Poisson distribution with expected value λ, and that

$X_1, X_2, X_3, \dots$

are identically distributed random variables that are mutually independent and also independent of N. Then the probability distribution of the sum of $N$ i.i.d. random variables conditioned on the number of these variables ($N$):

$Y \mid N=\sum_{n=1}^N X_n$

has a well-defined distribution. In the case N = 0, then the value of Y is 0, so that then Y | N = 0 has a degenerate distribution.

The compound Poisson distribution is obtained by marginalising the joint distribution of (Y,N) over N, where this joint distribution is obtained by combining the conditional distribution Y | N with the marginal distribution of N.

Properties

Mean and variance of the compound distribution derive in a simple way from law of total expectation and the law of total variance. Thus

$\operatorname{E}_Y(Y)= \operatorname{E}_N\left[\operatorname{E}_{Y\mid N}(Y)\right]= \operatorname{E}_N\left[N \operatorname{E}_X(X)\right]= \operatorname{E}_N(N)\operatorname{E}_X(X) ,$

$\operatorname{Var}_Y(Y) = E_N\left[\operatorname{Var}_{Y\mid N}(Y)\right] + \operatorname{Var}_N\left[E_{Y\mid N}(Y)\right] =\operatorname{E}_N\left[N\operatorname{Var}_X(X)\right] + \operatorname{Var}_N\left[N\operatorname{E}_X(X)\right] ,$

giving

$\operatorname{Var}_Y(Y) = \operatorname{E}_N(N)\operatorname{Var}_X(X) + \left(\operatorname{E}_X(X)\right)^2\operatorname{Var}_N(N) .$

Then, since E(N)=Var(N) if N is Poisson, and dropping the unnecessary subscripts, these formulae can be reduced to

$\operatorname{E}(Y)= \operatorname{E}(N)\operatorname{E}(X) ,$

$\operatorname{Var}(Y) = E(N)(\operatorname{Var}(X) + {E(X)}^2 )= E(N){E(X^2)}.$

The probability distribution of Y can be determined in terms of characteristic functions:

$\varphi_Y(t) = \operatorname{E}(e^{itY})= \operatorname{E}_N ( \left(\operatorname{E} (e^{itX}) )^N \right)= \operatorname{E}_N ((\varphi_X(t))^N), \,$

and hence, using the probability-generating function of the Poisson distribution, we have

$\varphi_Y(t) = \textrm{e}^{\lambda(\varphi_X(t) - 1)}.\,$

An alternative approach is via cumulant generating functions:

$K_Y(t)=\ln E[e^{tY}]=\ln E[E[e^{tY}\mid N]]=\ln E[e^{NK_X(t)}]=K_N(K_X(t)) . \,$

Via the law of total cumulance it can be shown that, if the mean of the Poisson distribution λ = 1, the cumulants of Y are the same as the moments of X₁.

It can be shown that every infinitely divisible probability distribution is a limit of compound Poisson distributions. And compound Poisson distributions is infinitely divisible by the definition.

Discrete compound Poisson distribution

When $X_1, X_2, X_3, \dots$ are non-negative discrete i.i.d random variables with $P(X_1 = k) = \alpha_k,\ (k = 0,1, \ldots )$, then this compound Poisson distribution is named discrete compound Poisson distribution (or stuttering-Poisson distribution) . We say that the discrete random variable $Y$ satisfying probability generating function characterization

$P_Y(z) = \sum\limits_{i = 0}^\infty P(Y = i)z^i = \exp\left(\sum\limits_{k = 1}^\infty \alpha_k \lambda (z^k - 1)\right), \quad (|z| \le 1)$

has a discrete compound Poisson(DCP) distribution with parameters $(\alpha_1 \lambda,\alpha_2 \lambda, \ldots ) \in \mathbb{R}^\infty \left(\sum_{i = 1}^\infty \alpha_i = 1, \alpha_i \ge 0,\lambda > 0 \right)$, which is denoted by

$X \sim CP(\alpha_1 \lambda,\alpha_2\lambda, \ldots ).$

Moreover, if $X \sim CP(\alpha_1\lambda,\alpha_2\lambda, \ldots ,\alpha_r\lambda)$, we say $X$ has a discrete compound Poisson distribution of order $r$ . When $r = 1,2$, DCP becomes Poisson distribution and Hermite distribution, respectively. When $r = 3,4$, DCP becomes triple stuttering-Poisson distribution and quadruple stuttering-Poisson distribution, respectively.

Feller's characterization of the compound Poisson distribution states that a non-negative integer valued r.v. $X$ is infinitely divisible if and only if its distribution is a discrete compound Poisson distribution. It can be shown that the negative binomial distribution is discrete infinitely divisible, i.e., if X has a negative binomial distribution, then for any positive integer n, there exist discrete i.i.d. random variables X₁, ..., X_n whose sum has the same distribution that X has. As a trivial case of negative binomial distribution, so geometric distribution is discrete compound Poisson distribution.

For more special case of DCP, see the reviews paper and references therein. For example, the Luria–Delbrück distribution in Luria–Delbrück experiment.

This distribution can model batch arrivals (such as in a bulk queue. The discrete compound Poisson distribution is also widely used in actuarial science for modelling the distribution of the total claim amount.

When some $\alpha_k$ are non-negative, it is the discrete pseudo compound Poisson distribution.

Other special cases

If the distribution of X is either an exponential distribution or a gamma distribution, then the conditional distributions of Y | N are gamma distributions in which the shape parameters are proportional to N. This shows that the formulation of the "compound Poisson distribution" outlined above is essentially the same as the more general class of compound probability distributions. However, the properties outlined above do depend on its formulation as the sum of a Poisson-distributed number of random variables. The distribution of Y in the case of the compound Poisson distribution with exponentially-distributed summands can be written in an form.

Compound Poisson processes

A compound Poisson process with rate $\lambda>0$ and jump size distribution G is a continuous-time stochastic process $\{\,Y(t) : t \geq 0 \,\}$ given by

$Y(t) = \sum_{i=1}^{N(t)} D_i,$

where the sum is by convention equal to zero as long as N(t)=0. Here, $\{\,N(t) : t \geq 0\,\}$ is a Poisson process with rate $\lambda$, and $\{\,D_i : i \geq 1\,\}$ are independent and identically distributed random variables, with distribution function G, which are also independent of $\{\,N(t) : t \geq 0\,\}.\,$

For the discrete version of compound Poisson process, it can be used in survival analysis for the frailty models.

Applications

A compound Poisson distribution, in which the summands have an exponential distribution, was used by Revfeim to model the distribution of the total rainfall in a day, where each day contains a Poisson-distributed number of events each of which provides an amount of rainfall which has an exponential distribution. Thompson applied the same model to monthly total rainfalls.

See also

• Compound Poisson process
• Hermite distribution
• Negative binomial distribution
• Geometric distribution
• Gamma distribution
• Poisson distribution
• Zero-inflated model