Abstract
The “density estimation” article highlights the dual roles of the graphical exploration of data as well as the nonparametric estimation of probabilities. Estimators described in detail include the histogram, frequency polygon, averaged shifted histogram, and kernel method. The basic theory of estimation is outlined. Data-based calibration by cross-validation is described. Several concrete examples are given.
References
- 1 Bowman, A. W. (1984). An alternative method of cross-validation for the smoothing of density estimates, Biometrika 71, 353–360.
- 2 Devroye, L. (1987). A Course in Density Estimation. Birkhäuser, Boston.
- 3 Donoho, D. L., Johnstone, I. M., Kerkyacharian, G. & Picard, D. (1996). Density estimation by wavelet thresholding, Annals of Statistics 24, 508–539.
- 4 Fan, J. & Gijbels, I. (1996). Local Polynomial Modeling and Its Applications. Chapman & Hall, New York.
- 5 Fix, E. & Hodges, J. L. (1951). Nonparametric discrimination: consistency properties, Reprinted by Silverman, B.W. & Jones, M.C. (1989). International Statistical Review 57, 233–247.
- 6 Freedman, D. & Diaconis, P. (1981). On the histogram as a density estimator: L2 theory, Zeitschrift für Wahrscheinlichkeitstheorie und verwandte Gebiete 57, 453–476.
- 7
Härdle, W.
(1991).
Smoothing Techniques with Implementation in S.
Springer-Verlag,
New York.
10.1007/978-1-4612-4432-5 Google Scholar
- 8 Hjort, N. L. & Jones, M. C. (1996). Locally parametric nonparametric density estimation, Annals of Statistics 24, 1619–1647.
- 9 Kooperberg, C. & Stone, C. J. (1991). A study of logspline density estimation, Computational Statistics and Data Analysis 12, 327–347.
- 10 Loader, C. R. (1996). Local likelihood density estimation, Annals of Statistics 24, 1602–1618.
- 11 Parzen, E. (1962). On estimation of probability density function and mode, Annals of Mathematical Statistics 33, 1065–1076.
- 12 Rosenblatt, M. (1956). Remarks on some nonparametric estimates of a density function, Annals of Mathematical Statistics 27, 832–837.
- 13 Rudemo, M. (1982). Empirical choice of histograms and kernel density estimators, Scandinavian Journal of Statistics 9, 65–78.
- 14 Sain, S. R., Baggerly, K. A. & Scott, D. W. (1994). Cross-validation of multivariate densities, Journal of the American Statistical Association 89, 807–817.
- 15 Sain, S. R. & Scott, D. W. (1996). On locally adaptive density estimation, Journal of the American Statistical Association 91, 1525–1534.
- 16 Schucany, W. R. (1989). Locally optimal window widths for kernel density estimation with large samples, Statistics and Probability Letters 7, 401–405.
- 17 Scott, D. W. (1979). On optimal and data-based histograms, Biometrika 66, 605–610.
- 18 Scott, D. W. (1985). Frequency polygons: theory and application, Journal of the American Statistical Association 80, 348–354.
- 19 Scott, D. W. (1985). Averaged shifted histograms: effective nonparametric density estimators in several dimensions, Annals of Statistics 13, 1024–1040.
- 20
Scott, D. W.
(1992).
Multivariate Density Estimation.
Wiley,
New York.
10.1002/9780470316849 Google Scholar
- 21 Scott, D. W., Gotto, A. M., Cole, J. S. & Gorry, G. A. (1978). Plasma lipids as collateral risk factors in coronary artery disease: a study of 371 males with chest pain, Journal of Chronic Diseases 31, 337–345.
- 22 Silverman, B. W. (1982). Algorithm AS176. Kernel density estimation using the fast Fourier transform, Applied Statistics 31, 93–99.
- 23 Silverman, B. W. (1986). Density Estimation for Statistics and Data Analysis. Chapman & Hall, London.
- 24
Simonoff, J. S.
(1996).
Smoothing Methods in Statistics.
Springer-Verlag,
New York.
10.1007/978-1-4612-4026-6 Google Scholar
- 25 Tapia, R. A. & Thompson, J. R. (1978). Nonparametric Probability Density Estimation. Hopkins Press, Baltimore.
- 26 Tarter, M. E. & Lock, M. D. (1993). Model-Free Curve Estimation. Chapman & Hall, New York.
- 27 Terrell, G. R. & Scott, D. W. (1985). Oversmoothed nonparametric density estimates, Journal of the American Statistical Association 80, 209–214.
- 28 Wand, M. P. & Jones, M. C. (1993). Comparison of smoothing parameterizations in bivariate kernel density estimation, Journal of the American Statistical Association 88, 520–528.
- 29
Wand, M. P. &
Jones, M. C.
(1995).
Kernel Smoothing.
Chapman & Hall,
London.
10.1007/978-1-4899-4493-1 Google Scholar
- 30 Wand, M. P., Marron, J. S. & Ruppert, D. (1991). Transformations in density estimation. Journal of the American Statistical Association 86, 343–361.