False Discovery Rate Estimation for Frequentist Pharmacovigilance Signal Detection Methods
Corresponding Author
I. Ahmed
Inserm U780, Villejuif, F-94807, France
Univ Paris-Sud, IFR69, Villejuif, F-94807, France
email: [email protected]Search for more papers by this authorC. Dalmasso
JE2492, Faculty of Medicine Paris-Sud, Univ Paris-Sud, Villejuif, F-94807, France
Search for more papers by this authorF. Haramburu
Inserm U657, Bordeaux, F-33076, France
Pellegrin Hospital, Bordeaux, F-33076, France
Search for more papers by this authorF. Thiessard
Pellegrin Hospital, Bordeaux, F-33076, France
LESIM, Univ Victor Segalen Bordeaux 2, Bordeaux, F-33076, France
Inserm U897, Bordeaux, F-33076, France
Search for more papers by this authorP. Broët
JE2492, Faculty of Medicine Paris-Sud, Univ Paris-Sud, Villejuif, F-94807, France
Search for more papers by this authorP. Tubert-Bitter
Inserm U780, Villejuif, F-94807, France
Univ Paris-Sud, IFR69, Villejuif, F-94807, France
Search for more papers by this authorCorresponding Author
I. Ahmed
Inserm U780, Villejuif, F-94807, France
Univ Paris-Sud, IFR69, Villejuif, F-94807, France
email: [email protected]Search for more papers by this authorC. Dalmasso
JE2492, Faculty of Medicine Paris-Sud, Univ Paris-Sud, Villejuif, F-94807, France
Search for more papers by this authorF. Haramburu
Inserm U657, Bordeaux, F-33076, France
Pellegrin Hospital, Bordeaux, F-33076, France
Search for more papers by this authorF. Thiessard
Pellegrin Hospital, Bordeaux, F-33076, France
LESIM, Univ Victor Segalen Bordeaux 2, Bordeaux, F-33076, France
Inserm U897, Bordeaux, F-33076, France
Search for more papers by this authorP. Broët
JE2492, Faculty of Medicine Paris-Sud, Univ Paris-Sud, Villejuif, F-94807, France
Search for more papers by this authorP. Tubert-Bitter
Inserm U780, Villejuif, F-94807, France
Univ Paris-Sud, IFR69, Villejuif, F-94807, France
Search for more papers by this authorAbstract
Summary Pharmacovigilance systems aim at early detection of adverse effects of marketed drugs. They maintain large spontaneous reporting databases for which several automatic signaling methods have been developed. One limit of those methods is that the decision rules for the signal generation are based on arbitrary thresholds. In this article, we propose a new signal-generation procedure. The decision criterion is formulated in terms of a critical region for the P-values resulting from the reporting odds ratio method as well as from the Fisher's exact test. For the latter, we also study the use of mid-P-values. The critical region is defined by the false discovery rate, which can be estimated by adapting the P-values mixture model based procedures to one-sided tests. The methodology is mainly illustrated with the location-based estimator procedure. It is studied through a large simulation study and applied to the French pharmacovigilance database.
References
-
Agresti, A. (2002). Categorical Data Analysis.
Hoboken
,
New Jersey
: Wiley Interscience.
10.1002/0471249688 Google Scholar
- Almenoff, J. S., Tonning, J. M., Gould, A. L., Szarfman, A., Hauben, M., Ouellet-Hellstrom, R., Ball, R., Hornbuckle, K., Walsh, L., Yee, C., Sacks, S. T., Yuen, N. A., Patadia, V., Blum, M., Johnston, M., Gerrits, C., Seifert, H., and LaCroix, K. K. (2005). Perspectives on the use of data mining in pharmacovigilance. Drug Safety 28, 981–1007.
- Bate, A., Lindquist, M., Edwards, I. R., Olsson, S., Orre, R., Lansner, A., and De Freitas, R. M. (1998). A Bayesian neural network method for adverse drug reaction signal generation. European Journal of Clinical Pharmacology 54, 315–321.
- Benjamini, Y. and Hochberg, Y. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society, Series B 57, 289–300.
- Benjamini, Y., Krieger, A. M., and Yekulti, D. (2006). Adaptive linear step-up procedures that control the false discovery rate. Biometrika 93, 491–507.
- Brown, E. G., Wood, L., and Wood, S. (1999). The medical dictionary for regulatory activities (MedDRA). Drug Safety 20, 109–117.
- Dalmasso, C., Broët, P., and Moreau, T. (2005). A simple procedure for estimating the false discovery rate. Bioinformatics 21, 660–668.
- DuMouchel, W. (1999). Bayesian data mining in large frequency tables, with an application to the FDA spontaneous reporting system. The American Statistician 53, 177–190.
-
DuMouchel, W. and
Pregibon, D. (2001). Empirical Bayes screening for multi-item associations. In
KDD'01: Proceedings of the Seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 67–76,
San Francisco
,
California
.
10.1145/502512.502526 Google Scholar
- Efron, B. (2007). Correlation and large-scale simultaneous significance testing. Journal of the American Statistical Association 102, 93–103.
- Evans, S. J., Waller, P. C., and Davis, S. (2001). Use of proportional reporting ratios (PRRs) for signal generation from spontaneous adverse drug reaction reports. Pharmacoepidemiology and Drug Safety 10, 483–486.
- Gordon, A., Glazko, G., Qiu, X., and Yakovlev, A. (2007). Control of the mean number of false discoveries, Bonferroni and stability of multiple testing. Annals of Applied Statistics 1, 179–190.
-
Hochberg, Y. and
Tamhane, A. C. (1987). Multiple Comparison Procedures.
New York
: Wiley.
10.1002/9780470316672 Google Scholar
- Lai, Y. (2007). A moment-based method for estimating the proportion of true null hypotheses and its application to microarray gene expression data. Biostatistics 8, 744–755.
- Leek, J. T. and Storey, J. (2007). Capturing heterogeneity in gene expression studies by surrogate variable analysis. PLoS Genet 3, 1724–1735.
- Miller, G. C. and Britt, H. (1995). A new drug classification for computer systems: The ATC extension code. International Journal of Bio-Medical Computing 40, 121–124.
- Norén, G. N., Bate, A., Orre, R., and Edwards, I. R. (2006). Extending the methods used to screen the WHO drug safety database towards analysis of complex associations and improved accuracy for rare events. Statistics in Medicine 25, 3740–3757.
- Pounds, S. and Cheng, C. (2004). Improving false discovery rate estimation. Bioinformatics 20, 1737–1745.
- Pounds, P. and Cheng, C. (2006). Robust estimation of the false discovery rate. Bioinformatics 22, 1979–1987.
- Pounds, S. and Morris, S. W. (2003). Estimating the occurrence of false positives and false negatives in microarray studies by approximating and partitioning the empirical distribution of p-values. Bioinformatics 19, 1236–1242.
-
R Development Core Team (2008).
R: A Language and Environment for Statistical Computing.
Vienna
,
Austria
:
R Foundation for Statistical Computing
. ISBN 3-900051-07-0.
10.1890/0012-9658(2002)083[3097:CFHIWS]2.0.CO;2 Google Scholar
- Roux, E., Thiessard, F., Fourrier, A., Bégaud, B., and Tubert-Bitter, P. (2005). Evaluation of statistical association measures for the automatic signal generation in pharmacovigilance. IEEE Transactions on Information Technology in Biomedicine 9, 518–527.
- Storey, J. D. (2002). A direct approach to false discovery rates. Journal of the Royal Statistical Society, Series B 64, 479–498.
- Storey, J. D. and Tibshirani, R. (2003). Statistical significance for genome-wide studies. Proceedings of the National Academy of Sciences 100, 9440–9445.
- Thiessard, F., Roux, E., Miremont-Salamé, G., Fourrier-Réglat, A., Haramburu, F., Tubert-Bitter, P., and Bégaud, B. (2005). Trends in spontaneous adverse drug reaction reports to the French pharmacovigilance system (1986-2001). Drug Safety 28, 731–740.
- van Puijenbroek, E. P., Bate, A., Leufkens, H. G., Lindquist, M., Orre, R., and Egberts, A. C. (2002). A comparison of measures of disproportionality for signal detection in spontaneous reporting systems for adverse drug reactions. Pharmacoepidemiology and Drug Safety 11, 3–10.
- Waller, P., van Puijenbroek, E., Egberts, A., and Evans, S. (2004). The reporting odds ratio versus the proportional reporting ratio: Deuce. Pharmacoepidemiology and Drug Safety 13, 525–526.