Common Probability Distributions
1. Normal (Gaussian) Distribution
The normal distribution is a continuous probability distribution that is symmetric about the mean, showing that data near the mean are more frequent in occurrence than data far from the mean. It is described by the probability density function (PDF):
Applications: Heights, blood pressure, measurement errors, IQ scores, and any naturally occurring phenomenon influenced by many small independent factors (Central Limit Theorem).
2. Binomial Distribution
A discrete probability distribution describing the number of successes in a fixed number of independent Bernoulli trials, each with the same probability of success p.
- Quality control inspection (pass/fail testing)
- Clinical trial success rates
- Survey response modeling (yes/no questions)
3. Poisson Distribution
A discrete distribution that expresses the probability of a given number of events occurring in a fixed interval of time or space, assuming these events occur with a known constant mean rate and independently of the time since the last event.
- Call center arrival rates
- Radiation decay counts
- Network packet arrivals in fixed windows
4. Exponential Distribution
A continuous distribution that models the time between events in a Poisson process. It is memoryless, meaning the probability of an event occurring in the next time interval is independent of how much time has already elapsed.
- Component failure times (reliability engineering)
- Inter-arrival times in queueing systems
- Radioactive decay intervals
5. Uniform Distribution
A family of probability distributions characterized by maximum entropy. In the continuous case, all intervals of the same length on the distribution's support are equally probable.
- Random number generation
- Measurement rounding errors
- Simulations requiring unbiased inputs
6. Summary Comparison
| Distribution | Type | Parameters | Mean | Variance |
|---|---|---|---|---|
| Normal | Continuous | μ, σ² |
μ |
σ² |
| Binomial | Discrete | n, p |
np |
np(1−p) |
| Poisson | Discrete | λ |
λ |
λ |
| Exponential | Continuous | λ |
1/λ |
1/λ² |
| Uniform | Continuous | a, b |
(a+b)/2 |
(b−a)²/12 |
References & Further Reading
- Feller, W. (1968). An Introduction to Probability Theory and Its Applications (Vol. 1, 3rd ed.). Wiley.
- Montgomery, D. C., & Runger, G. C. (2018). Applied Statistics and Probability for Engineers (7th ed.). Wiley.
- Casella, G., & Berger, R. L. (2002). Statistical Inference (2nd ed.). Duxbury Press.
- NIST/SEMATECH e-Handbook of Statistical Methods. Retrieved from www.itl.nist.gov