Probability distribution

Probability distribution
From Wikipedia, the free encyclopedia
Jump to: navigation, search

In probability theory, every random variable is a function defined on a state space equipped with a probability distribution that assigns a probability to every subset (more precisely every measurable subset) of its state space in such a way that the probability axioms are satisfied. That is, probability distributions are probability measures defined over a state space instead of the sample space. A random variable then defines a probability measure on the sample space by assigning a subset of the sample space the probability of its inverse image in the state space. In other words the probability distribution of a random variable is the push forward measure of the probability distribution on the state space.
Contents
[hide]

* 1 Probability distributions of real-valued random variables
o 1.1 Discrete probability distribution
o 1.2 Continuous probability distribution
* 2 Terminology
* 3 List of important probability distributions
o 3.1 Discrete distributions
+ 3.1.1 With finite support
+ 3.1.2 With infinite support
o 3.2 Continuous distributions
+ 3.2.1 Supported on a bounded interval
+ 3.2.2 Supported on semi-infinite intervals, usually [0,∞)
+ 3.2.3 Supported on the whole real line
o 3.3 Joint distributions
+ 3.3.1 Two or more random variables on the same sample space
+ 3.3.2 Matrix-valued distributions
o 3.4 Miscellaneous distributions
* 4 Demonstrations and activities
* 5 See also
* 6 External links

[edit] Probability distributions of real-valued random variables

Because a probability distribution Pr on the real line is determined by the probability of being in a half-open interval Pr(a, b], the probability distribution of a real-valued random variable X is completely characterized by its cumulative distribution function:

F(x) = \Pr \left[ X \le x \right] \qquad \forall x \in \mathbb{R}.

[edit] Discrete probability distribution

Main article: Discrete probability distribution

A probability distribution is called discrete if its cumulative distribution function only increases in jumps.

The set of all values that a discrete random variable can assume with non-zero probability is either finite or countably infinite because the sum of uncountably many positive real numbers (which is the smallest upper bound of the set of all finite partial sums) always diverges to infinity. Typically, the set of possible values is topologically discrete in the sense that all its points are isolated points. But, there are discrete random variables for which this countable set is dense on the real line.

Discrete distributions are characterized by a probability mass function, p such that

F(x) = \Pr \left[X \le x \right] = \sum_{x_i \le x} p(x_i).

[edit] Continuous probability distribution

Main article: Continuous probability distribution

By one convention, a probability distribution is called continuous if its cumulative distribution function is continuous, which means that it belongs to a random variable X for which Pr[ X = x ] = 0 for all x in R.

Another convention reserves the term continuous probability distribution for absolutely continuous distributions. These distributions can be characterized by a probability density function: a non-negative Lebesgue integrable function f defined on the real numbers such that

F(x) = \Pr \left[ X \le x \right] = \int_{-\infty}^x f(t)\,dt

Discrete distributions and some continuous distributions (like the devil's staircase) do not admit such a density.

[edit] Terminology

The support of a distribution is the smallest closed set whose complement has probability zero.

The probability distribution of the sum of two independent random variables is the convolution of each of their distributions.

The probability distribution of the difference of two random variables is the cross-correlation of each of their distributions.

A discrete random variable is a random variable whose probability distribution is discrete. Similarly, a continuous random variable is a random variable whose probability distribution is continuous.

[edit] List of important probability distributions

Certain random variables occur very often in probability theory, in some cases due to their application to many natural and physical processes, and in some cases due to theoretical reasons such as the central limit theorem, the Poisson limit theorem, or properties such as memorylessness or other characterizations. Their distributions therefore have gained special importance in probability theory.

[edit] Discrete distributions

[edit] With finite support

* The Bernoulli distribution, which takes value 1 with probability p and value 0 with probability q = 1 − p.
* The Rademacher distribution, which takes value 1 with probability 1/2 and value −1 with probability 1/2.
* The binomial distribution describes the number of successes in a series of independent Yes/No experiments.
* The degenerate distribution at x0, where X is certain to take the value x0. This does not look random, but it satisfies the definition of random variable because although its output is determinate, its input is random. This is useful because it puts deterministic variables and random variables in the same formalism.
* The discrete uniform distribution, where all elements of a finite set are equally likely. This is supposed to be the distribution of a balanced coin, an unbiased die, a casino roulette or a well-shuffled deck. Also, one can use measurements of quantum states to generate uniform random variables. All these are "physical" or "mechanical" devices, subject to design flaws or perturbations, so the uniform distribution is only an approximation of their behaviour. In digital computers, pseudo-random number generators are used to produce a statistically random discrete uniform distribution.
* The hypergeometric distribution, which describes the number of successes in the first m of a series of n Yes/No experiments, if the total number of successes is known.
* Zipf's law or the Zipf distribution. A discrete power-law distribution, the most famous example of which is the description of the frequency of words in the English language.
* The Zipf-Mandelbrot law is a discrete power law distribution which is a generalization of the Zipf distribution.

[edit] With infinite support

* The Boltzmann distribution, a discrete distribution important in statistical physics which describes the probabilities of the various discrete energy levels of a system in thermal equilibrium. It has a continuous analogue. Special cases include:
o The Gibbs distribution
o The Maxwell-Boltzmann distribution
o The Bose-Einstein distribution
o The Fermi-Dirac distribution
* The geometric distribution, a discrete distribution which describes the number of attempts needed to get the first success in a series of independent Yes/No experiments.

Poisson distribution
Poisson distribution

* The logarithmic (series) distribution
* The negative binomial distribution, a generalization of the geometric distribution to the nth success.
* The parabolic fractal distribution
* The Poisson distribution, which describes a very large number of individually unlikely events that happen in a certain time interval.

Skellam distribution
Skellam distribution

* The Skellam distribution, the distribution of the difference between two independent Poisson-distributed random variables.
* The Yule-Simon distribution
* The zeta distribution has uses in applied statistics and statistical mechanics, and perhaps may be of interest to number theorists. It is the Zipf distribution for an infinite number of elements.

[edit] Continuous distributions

[edit] Supported on a bounded interval
Beta distribution
Beta distribution

* The Beta distribution on [0,1], of which the uniform distribution is a special case, and which is useful in estimating success probabilities.

continuous uniform distribution
continuous uniform distribution

* The continuous uniform distribution on [a,b], where all points in a finite interval are equally likely.
o The rectangular distribution is a uniform distribution on [-1/2,1/2].
* The Dirac delta function although not strictly a function, is a limiting form of many continuous probability functions. It represents a discrete probability distribution concentrated at 0 — a degenerate distribution — but the notation treats it as if it were a continuous distribution.
* The Kumaraswamy distribution is as versatile as the Beta distribution but has simple closed forms for both the cdf and the pdf.
* The logarithmic distribution (continuous)
* The triangular distribution on [a, b], a special case of which is the distribution of the sum of two uniformly distributed random variables (the convolution of two uniform distributions).
* The truncated normal distribution on [a, b].
* The von Mises distribution on the circle.
* The von Mises-Fisher distribution on the N-dimensional sphere has the von Mises distribution as a special case.
* The Kent distribution on the three-dimensional sphere.
* The Wigner semicircle distribution is important in the theory of random matrices.

[edit] Supported on semi-infinite intervals, usually [0,∞)
chi-square distribution
chi-square distribution

* The chi distribution
* The noncentral chi distribution
* The chi-square distribution, which is the sum of the squares of n independent Gaussian random variables. It is a special case of the Gamma distribution, and it is used in goodness-of-fit tests in statistics.
o The inverse-chi-square distribution
o The noncentral chi-square distribution
o The scale-inverse-chi-square distribution

Exponential distribution
Exponential distribution

* The exponential distribution, which describes the time between consecutive rare random events in a process with no memory.
* The F-distribution, which is the distribution of the ratio of two (normalized) chi-square distributed random variables, used in the analysis of variance. (Called the beta prime distribution when it is the ratio of two chi-square variates which are not normalized by dividing them by their numbers of degrees of freedom.)
o The noncentral F-distribution

Gamma distribution
Gamma distribution

* The Gamma distribution, which describes the time until n consecutive rare random events occur in a process with no memory.
o The Erlang distribution, which is a special case of the gamma distribution with integral shape parameter, developed to predict waiting times in queuing systems.
o The inverse-gamma distribution
* The half-normal distribution
* The folded normal distribution
* The Lévy distribution
* The log-logistic distribution
* The log-normal distribution, describing variables which can be modelled as the product of many small independent positive variables.

Pareto distribution
Pareto distribution

* The Pareto distribution, or "power law" distribution, used in the analysis of financial data and critical behavior.
* The Pearson Type III distribution (see Pearson distributions)
* The Rayleigh distribution
* The Rayleigh mixture distribution
* The Rice distribution
* The type-2 Gumbel distribution
* The Wald distribution
* The Weibull distribution, of which the exponential distribution is a special case, is used to model the lifetime of technical devices.

[edit] Supported on the whole real line
Cauchy distribution
Cauchy distribution
Laplace distribution
Laplace distribution
Levy distribution
Levy distribution
Normal distribution
Normal distribution

* The Cauchy distribution, an example of a distribution which does not have an expected value or a variance. In physics it is usually called a Lorentzian profile, and is associated with many processes, including resonance energy distribution, impact and natural spectral line broadening and quadratic stark line broadening.
* The Fisher-Tippett, extreme value, or log-Weibull distribution
o The Gumbel distribution, a special case of the Fisher-Tippett distribution
* Fisher's z-distribution
* The generalized extreme value distribution
* The hyperbolic distribution
* The hyperbolic secant distribution
* The Landau distribution
* The Laplace distribution
* The Lévy skew alpha-stable distribution is often used to characterize financial data and critical behavior.
* The map-Airy distribution
* The normal distribution, also called the Gaussian or the bell curve. It is ubiquitous in nature and statistics due to the central limit theorem: every variable that can be modelled as a sum of many small independent variables is approximately normal.
* The Pearson Type IV distribution (see Pearson distributions)
* Student's t-distribution, useful for estimating unknown means of Gaussian populations.
o The noncentral t-distribution
* The type-1 Gumbel distribution
* The Voigt distribution, or Voigt profile, is the convolution of a normal distribution and a Cauchy distribution. It is found in spectroscopy when spectral line profiles are broadened by a mixture of Lorentzian and Doppler broadening mechanisms.

[edit] Joint distributions

For any set of independent random variables the probability density function of their joint distribution is the product of their individual density functions.

[edit] Two or more random variables on the same sample space

* Dirichlet distribution, a generalization of the beta distribution.
* The Ewens's sampling formula is a probability distribution on the set of all partitions of an integer n, arising in population genetics.
* Balding-Nichols Model
* multinomial distribution, a generalization of the binomial distribution.
* multivariate normal distribution, a generalization of the normal distribution.

[edit] Matrix-valued distributions

* Wishart distribution
* matrix normal distribution
* matrix t-distribution
* Hotelling's T-square distribution

[edit] Miscellaneous distributions

* The Cantor distribution
* Phase-type distribution
* Truncated distribution

[edit] Demonstrations and activities

The SOCR resource provides web-based tools (applets) for sampling from and interacting with many of these discrete and continuous distributions. Also, a number of distribution-specific activities are provided that demonstrate the utilization of general probability distributions.

[edit] See also

* copula (statistics)
* cumulative distribution function
* likelihood function
* list of statistical topics
* probability density function
* histogram
* Riemann-Stieltjes integral: Application to probability theory

Image:Bvn-small.png Probability distributions [ view • talk • edit ]
Univariate Multivariate
Discrete: Benford • Bernoulli • binomial • Boltzmann • categorical • compound Poisson • discrete phase-type • degenerate • Gauss-Kuzmin • geometric • hypergeometric • logarithmic • negative binomial • parabolic fractal • Poisson • Rademacher • Skellam • uniform • Yule-Simon • zeta • Zipf • Zipf-Mandelbrot Ewens • multinomial • multivariate Polya
Continuous: Beta • Beta prime • Cauchy • chi-square • Dirac delta function • Coxian • Erlang • exponential • exponential power • F • fading • Fermi-Dirac • Fisher's z • Fisher-Tippett • Gamma • generalized extreme value • generalized hyperbolic • generalized inverse Gaussian • Half-Logistic • Hotelling's T-square • hyperbolic secant • hyper-exponential • hypoexponential • inverse chi-square (scaled inverse chi-square) • inverse Gaussian • inverse gamma (scaled inverse gamma) • Kumaraswamy • Landau • Laplace • Lévy • Lévy skew alpha-stable • logistic • log-normal • Maxwell-Boltzmann • Maxwell speed • Nakagami • normal (Gaussian) • normal-gamma • normal inverse Gaussian • Pareto • Pearson • phase-type • polar • raised cosine • Rayleigh • relativistic Breit-Wigner • Rice • shifted Gompertz • Student's t • triangular • truncated normal • type-1 Gumbel • type-2 Gumbel • uniform • Variance-Gamma • Voigt • von Mises • Weibull • Wigner semicircle • Wilks' lambda Dirichlet • Generalized Dirichlet distribution . inverse-Wishart • Kent • matrix normal • multivariate normal • multivariate Student • von Mises-Fisher • Wigner quasi • Wishart
Miscellaneous: Cantor • conditional • equilibrium • exponential family • infinitely divisible • location-scale family • marginal • maximum entropy • posterior • prior • quasi • sampling • singular

[edit] External links
Wikimedia Commons has media related to:
Probability distribution

* Interactive Discrete and Continuous Probability Distributions
* A Compendium of Common Probability Distributions
* Statistical Distributions - Overview
* Probability Distributions in Quant Equation Archive, sitmo
* A Probability Distribution Calculator

Retrieved from "http://en.wikipedia.org/wiki/Probability_distribution"

Categories: Probability and statistics | Probability distributions
Views

* Article
* Discussion
* Edit this page
* History

Personal tools

* Sign in / create account

Navigation

* Main page
* Contents
* Featured content
* Current events
* Random article

interaction

* About Wikipedia
* Community portal
* Recent changes
* Contact Wikipedia
* Donate to Wikipedia
* Help

Search

Toolbox

* What links here
* Related changes
* Upload file
* Special pages
* Printable version
* Permanent link
* Cite this article

In other languages

* العربية
* Deutsch
* Español
* Français
* Galego
* Italiano
* עברית
* Lietuvių
* Nederlands
* 日本語
* Polski
* Português
* Русский
* Basa Sunda
* Svenska
* Tiếng Việt
* 中文

Powered by MediaWiki
Wikimedia Foundation

* This page was last modified 20:09, 21 August 2007.
* All text is available under the terms of the GNU Free Documentation License. (See Copyrights for details.)
Wikipedia® is a registered trademark of the Wikimedia Foundation, Inc., a US-registered 501(c)(3) tax-deductible nonprofit charity.
* Privacy policy
* About Wikipedia
* Disclaimers