Truncated normal distribution

Information from Wikipedia, the free encyclopedia—a reliable source for your research. Click to cite:
Jump to: navigation, search
Probability density function
Probability density function for the truncated normal distribution for different sets of parameters. In all cases, a = −10 and b = 10. For the black: μ = −8, σ = 2; blue: μ = 0, σ = 2; red: μ = 9, σ = 10; orange: μ = 0, σ = 10.
Cumulative distribution function
Cumulative distribution function for the truncated normal distribution for different sets of parameters. In all cases, a = −10 and b = 10. For the black: μ = −8, σ = 2; blue: μ = 0, σ = 2; red: μ = 9, σ = 10; orange: μ = 0, σ = 10.
Notation \xi=\frac{x-\mu}{\sigma},\ \alpha=\frac{a-\mu}{\sigma},\ \beta=\frac{b-\mu}{\sigma}
Z=\Phi(\beta)-\Phi(\alpha)
Parameters μR — mean (location)
σ2 ≥ 0 — variance (squared scale)
a ∈ R — minimum value
b ∈ R — maximum value
Support xa,b
pdf f(x;\mu,\sigma, a,b) = \frac{1}{\sigma Z}\phi(\xi)
CDF F(x;\mu,\sigma, a,b) = \frac{\Phi(\xi) - \Phi(\alpha)}{Z}
Mean \mu +  \frac{\phi(\alpha)-\phi(\beta)}{Z}\sigma
Mode \left\{\begin{array}{ll}a, & \mathrm{if}\ \mu<a \\ \mu, & \mathrm{if}\ a\le\mu\le b\\ b, & \mathrm{if}\ \mu>b\end{array}\right.
Variance \sigma^2\left[1+\frac{\alpha\phi(\alpha)-\beta\phi(\beta)}{Z}
-\left(\frac{\phi(\alpha)-\phi(\beta)}{Z}\right)^2\right]
Entropy \ln(\sqrt{2 \pi e} \sigma Z)+ \dots
\dots + \frac{\alpha\phi(\alpha)-\beta\phi(\beta)}{2Z}-\frac{(\phi(\alpha)-\phi(\beta))^2}{2Z^2}

In probability and statistics, the truncated normal distribution is the probability distribution of a normally distributed random variable whose value is either bounded below or above (or both). The truncated normal distribution has wide applications in statistics and econometrics. For example, it is used to model the probabilities of the binary outcomes in the probit model and to model censored data in the Tobit model.

Contents

Definition

Suppose  X \sim N(\mu, \sigma^{2}) \! has a normal distribution and lies within the interval  X \in (a,b), \; -\infty \leq a < b \leq \infty . Then X conditional on  a < X < b has a truncated normal distribution.

Its probability density function, ƒ, for axb, is given by


f(x;\mu,\sigma,a,b) = \frac{\frac{1}{\sigma}\phi(\frac{x - \mu}{\sigma})}{\Phi(\frac{b - \mu}{\sigma}) - \Phi(\frac{a - \mu}{\sigma}) }

and by ƒ=0 otherwise.

Here,  \scriptstyle{\phi(\xi)=\frac{1}{\sqrt{2 \pi}}\exp{(-\frac{1}{2}\xi^2})} \ is the probability density function of the standard normal distribution and  \scriptstyle{\Phi(\cdot)} \ is its cumulative distribution function. There is an understanding that if  \scriptstyle{b=\infty} \ , then  \scriptstyle{\Phi(\frac{b - \mu}{\sigma}) =1}, and similarly, if  \scriptstyle{a=-\infty} \ , then  \scriptstyle{\Phi(\frac{a - \mu}{\sigma}) =0}.

Moments

Two sided truncation:1

 \operatorname{E}(X \mid a<X<b) = \mu +  \frac{\phi(\frac{a-\mu}{\sigma})-\phi(\frac{b-\mu}{\sigma})}{\Phi(\frac{b-\mu}{\sigma})-\Phi(\frac{a-\mu}{\sigma})}\sigma\!
 \operatorname{Var}(X \mid a<X<b) = \sigma^2\left[1+\frac{\frac{a-\mu}{\sigma}\phi(\frac{a-\mu}{\sigma})-\frac{b-\mu}{\sigma}\phi(\frac{b-\mu}{\sigma})}{\Phi(\frac{b-\mu}{\sigma})-\Phi(\frac{a-\mu}{\sigma})}
-\left(\frac{\phi(\frac{a-\mu}{\sigma})-\phi(\frac{b-\mu}{\sigma})}{\Phi(\frac{b-\mu}{\sigma})-\Phi(\frac{a-\mu}{\sigma})}\right)^2\right]\!

One sided truncation (upper tail):2

 \operatorname{E}(X \mid X>a) = \mu +\sigma\lambda(\alpha) \!
 \operatorname{Var}(X \mid X>a) = \sigma^2[1-\delta(\alpha)],\!

where \alpha=(a-\mu)/\sigma,\; \lambda(\alpha)=\phi(\alpha)/[1-\Phi(\alpha)]\; and  \; \delta(\alpha) = \lambda(\alpha)[\lambda(\alpha)-\alpha].

One sided truncation (lower tail):

 \operatorname{E}(X \mid X<b) = \mu -\sigma\frac{\phi(\beta)}{\Phi(\beta)} \!
 \operatorname{Var}(X \mid X<b) = \sigma^2\left[1-\beta \frac{\phi(\beta)}{\Phi(\beta)}- \left(\frac{\phi(\beta)}{\Phi(\beta)} \right)^2\right],\!

where \beta=(b-\mu)/\sigma.

Simulating

A random variate x defined as  x = \Phi^{-1}( \Phi(\alpha) + U * (\Phi(\beta)-\Phi(\alpha)))\sigma + \mu with \Phi the cumulative distribution function and \Phi^{-1} its inverse, U a uniform random number on (0, 1), follows the distribution truncated to the range (a, b).

For more on simulating a draw from the truncated normal distribution, see Robert (1995), Lynch (2007) Section 8.1.3 (pages 200–206), Devroye (1986). The MSM package in R has a function, rtnorm, that calculates draws from a truncated normal. The truncnorm package in R also has functions to draw from a truncated normal.

See also

References

  1. ^ Johnson, N.L., Kotz, S., Balakrishnan, N. (1994) Continuous Univariate Distributions, Volume 1, Wiley. ISBN 0-471-58495-9 (Section 10.1)
  2. ^ Greene, William H. (2003). Econometric Analysis (5th ed.). Prentice Hall. ISBN 0-13-066189-9. 


Content from Wikipedia, the Free Encyclopedia

What Is This Site? The Ultimate Study Guide is a mirror of English Wikipedia. It exists in order to provide Wikipedia content to those who are unable to access the main Wikipedia site due to draconian government, employer, or school restrictions. The site displays all the text content from Wikipedia. Our sponsors generously cover part of the cost of hosting this site, and their ads are shown as part of this agreement. We regret that we are unable to display certain controversial images on some pages the site at the request of the sponsors. If you need to see images which we are unable to show, we encourage you to view Wikipedia directly if possible, and apologize for this inconvenience.

A product of XPR Content Systems. 47 Union St #9K, Grand Falls-Windsor NL A2A 2C9 CANADA