The Repeatability of Uncertainty and Sensitivity Analyses for Complex Probabilistic Risk Assessments
Ronald L. Iman
Manufacturing Systems Reliability Modeling, Sandia National Laboratories, Division 6613, Albuquerque, New Mexico 87185.
Search for more papers by this authorJon C. Helton
Department of Mathematics, Arizona State University, Tempe, Arizona 85287.
Search for more papers by this authorRonald L. Iman
Manufacturing Systems Reliability Modeling, Sandia National Laboratories, Division 6613, Albuquerque, New Mexico 87185.
Search for more papers by this authorJon C. Helton
Department of Mathematics, Arizona State University, Tempe, Arizona 85287.
Search for more papers by this authorAbstract
The performance of a probabilistic risk assessment (PRA) for a nuclear power plant is a complex undertaking, involving the assembly of an accident frequency analysis, an accident progression analysis, a source term analysis, and a consequence analysis. Each of these analyses is, in itself, quite complex. Uncertainties enter into a PRA from each of these analyses. An important focus in recent PRAs has been to incorporate these uncertainties at each stage of the analysis, propagate the subsequent uncertainties through the entire analysis, and include uncertainty in the final results. Monte Carlo procedures based on Latin hypercube sampling provide one way to perform propagations of this type. In this paper, the results of two complete and independent Monte Carlo calculations for a recently completed PRA for a nuclear power plant are compared as a means of providing empirical evidence on the repeatability of uncertainty and sensitivity analyses for large-scale PRA calculations. These calculations use the same variables and analysis structure with two independently generated Latin hypercube samples. The results of the two calculations show a high degree of repeatability for the analysis of a very complex system.
REFERENCES
- 1 U. S. Nuclear Regulatory Commission, “ Severe Accident Risks: An Assessment for Five U. S. Nuclear Power Plants” ( NUREG-1150, Washington , D.C. , 1990).
- 2 R. L. Iman and S. C. Hora, “Bayesian Methods for Modeling Recovery Times with an Application to the Loss of Offsite Power at Nuclear Power Plants,” Risk Analysis 9, 25–36 (1989).
- 3 S. C. Hora and R. L. Iman, “Bayesian Modeling of Initiating Event Frequencies at Nuclear Power Plants,” Risk Analysis 10, 103–109 (1990).
- 4 S. C. Hora and R. L. Iman, “Expert Opinion in Risk Analysis: The NUREG-1150 Methodology,” Nuclear Science and Engineering 102, 323–331 (1989).
- 5 T. A. Wheeler et al., “ Analysis of Core Damage Frequency: Expert Judgment Elicitation” (NUREG/CR-4550, SAND86-2084, Vol. 2, Rev. 1, Sandia National Laboratories, Albuquerque , New Mexico , 1989).
- 6 F. T. Harper et al., “Evaluation of Severe Accident Risks: Quantification of Major Input Parameters; Experts' Determination of In-Vessel Issues” (NUREG/CR-4551, SAND86-1309, Vol. 2, Part 1, Rev. 1, Sandia National Laboratories, Albuquerque, New Mexico, 1990).
- 7 F. T. Harper et al, “Evaluation of Severe Accident Risks: Quantification of Major Input Parameters; Experts' Determination of Containment Loads and Molten Core-Concrete Issues” (NUREG/ CR-4551, SAND86-1309, Vol 2, Part 2, Rev. 1, Sandia National Laboratories, Albuquerque, New Mexico, in preparation.).
- 8 R. J. Breeding et al, “ Evaluation of Severe Accident Risks: Quantification of Major Input Parameters; Experts' Determination of Structural Response Issues” (NUREG/CR-4551, SAND86-1309, Vol. 2, Part 3, Rev. 1, Sandia National Laboratories, Albuquerque , New Mexico , in preparation).
- 9 F. T. Harper et al, “ Evaluation of Severe Accident Risks: Quantification of Major Input Parameters; Experts' Determination of Source Term Issues” (NUREG/CR-4551, SAND86-1309, Vol. 2, Part 4, Rev. 1, Sandia National Laboratories, Albuquerque , New Mexico , in preparation).
- 10 F. T. Harper et al, “ Evaluation of Severe Accident Risks: Quantification of Major Input Parameters; Supporting Material” (NUREG/CR-4551, SAND86-1309, Vol. 2, Part 5, Rev. 1, Sandia National Laboratories, Albuquerque New Mexico , in preparation).
- 11 F. T. Harper et al, “ Evaluation of Severe Accident Risks: Quantification of Major Input Parameters; Determination of Parameter Values Not Quantified by Expert Panels” (NUREG/CR-4551, SAND86-1309, Vol. 2, Part 6, Rev. 1, Sandia National Laboratories, Albuquerque , New Mexico , in preparation).
- 12
J. L. Sprung
et al, “ Evaluation of Severe Accident Risks: Quantification of Major Input Parameters; MACCS Input” (NUREG/ CR-4551, SAND86-1309, Vol. 2, Part 7, Rev. 1, Sandia National Laboratories,
Albuquerque
,
New Mexico
, 1990).
10.2172/6360728 Google Scholar
- 13 R. L. Iman, J. D. Johnson, and J. C. Helton, “ PRAMIS: Probabilistic Risk Assessment Model Integration System” (NUREG/ CR-5262, SAND88-3093, Sandia National Laboratories, Albuquerque , New Mexico , 1990).
- 14 E. D. Gorham et al, “ Evaluation of Severe Accident Risks: Methodology for the Containment, Source Term, Consequence and Risk Integration Analyses” (NUREG/CR-4551, SAND86-1309, Vol. 1, Rev. 1, Sandia National Laboratories, Albuquerque , New Mexico , in preparation).
- 15 J. C. Helton, J. M. Griesmeyer, F. E. Haskin, R. L. Iman, C. N. Amos, and W. B. Murfin, “ Integration of the NUREG-1150 Analyses: Calculation of Risk and Propagation of Uncertainties,” Proceedings of the U. S. Nuclear Regulatory Commission Fifteenth Water Reactor Safety Research Information Meeting, Vol. 1, U. S. Nuclear Regulatory Commission, Washington , D.C. (1988), pp. 151–176.
- 16 R. C. Bertucio et al, “ Analysis of Core Damage Frequency: Surry Unit 1” (NUREG/CR-4550, SAND86-2084, Vol. 3, Rev. 1, Sandia National Laboratories, Albuquerque , New Mexico , 1989).
- 17 R. J. Breeding et al, “ Evaluation of Severe Accident Risks: Surry Unit 1” (NUREG/CR-4551, SAND86-1309, Vol. 3, Rev. 1, Sandia National Laboratories, Albuquerque , New Mexico , 1990).
- 18 R. C. Bertucio et al, “ Analysis of Core Damage Frequency: Sequoyah Unit 1” (NUREG/CR-4550, SAND86-2084, Vol. 5, Rev. 1, Sandia National Laboratories, Albuquerque , New Mexico , 1989).
- 19 J. J. Gregory et al, “ Evaluation of Severe Accident Risks: Sequoyah Unit 1” (NUREG/CR-4551, SAND86-1309, Vol. 5, Rev. 1, Sandia National Laboratories, Albuquerque , New Mexico , 1990).
- 20 A. M. Kolaczkowski et al, “ Analysis of Core Damage Frequency: Peach Bottom Unit 2” (NUREG/CR-4550, SAND86-2084, Vol. 4, Rev. 1, Sandia National Laboratories, Albuquerque , New Mexico , 1989).
- 21
A. C. Payne
et al, “ Evaluation of Severe Accident Risks: Peach Bottom Unit 2” (NUREG/CR-4551, SAND86-1309, Vol. 4, Rev. 1, Sandia National Laboratories,
Albuquerque
,
New Mexico
, 1990).
10.2172/6188992 Google Scholar
- 22 M. T. Drouin et al, “ Analysis of Core Damage Frequency: Grand Gulf Unit 1” (NUREG/CR-4550, SAND86-2084, Vol. 6, Rev. 1, Sandia National Laboratories, Albuquerque , New Mexico , 1989).
- 23 T. D. Brown et al, “ Evaluation of Severe Accident Risks: Grand Gulf Unit 1” (NUREG/CR-4551, SAND86-1309, Vol. 6, Rev. 1, Sandia National Laboratories, Albuquerque , New Mexico , 1990).
- 24 T. A. Wheeler et al, “ Analysis of Core Damage Frequency: Zion Unit 1” (NUREG/CR-4550, SAND86-2084, Vol. 7, Rev. 1, Sandia National Laboratories, Albuquerque , New Mexico , 1989).
- 25 C. K. Park, “ Evaluation of Severe Accident Risks: Zion Unit 1” (NUREG/CR-4551, Vol. 7, Rev. 1, BNL/NUREG-5209, Brookhaven National Laboratory, Upton , New York , in preparation).
- 26 M. D. McKay, W. J. Conover, and R. J. Beckman, “A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output from a Computer Code,” Technometrics 21, 239–245 (1979).
- 27 R. L. Iman and M. J. Shortencarier, “ A FORTRAN 77 Program and User's Guide for the Generation of Latin Hypercube and Random Samples for Use with Computer Models” (NUREG/CR-3624, SAND83-2365, Sandia National Laboratories, Albuquerque , New Mexico , 1984).
- 28 R. L. Iman and W. J. Conover, “A Distribution-Free Approach to Inducing Rank Correlation Among Input Variables,” Communications in Statistics B11, 311–334 (1982).
- 29 W. J. Conover, Practical Nonparametric Statistics, 2nd ed. (Wiley, New York , 1980).
- 30 R. L. Iman and M. J. Shortencarier, “ A User's Guide for the Top Event Matrix Analysis Code (TEMAC)” (NUREG/CR-4598, SAND86-0960, Sandia National Laboratories, Albuquerque , New Mexico , 1986).
- 31 R. L. Iman, “A Matrix-Based Approach to Uncertainty and Sensitivity Analysis for Fault Trees,” Risk Analysis 7, 21–33 (1987).
- 32 J. M. Griesmeyer and L. N. Smith, “ A Reference Manual for the Event Progression Analysis Code (EVNTRE)” (NUREG/CR-5174, SAND88-1607, Sandia National Laboratories, Albuquerque , New Mexico , 1989).
- 33 H.-N. Jow, W. B. Murfin, and J. D. Johnson, “ XSOR Codes User's Manual” (NUREG/CR-5360, SAND89-0943, Sandia National Laboratories, Albuquerque , New Mexico , in preparation).
- 34 R. L. Iman, J. C. Helton, and J. D. Johnson, “ PARTITION: A Program for Defining the Source Term/Consequence Analysis Interface in the NUREG-1150 Probabilistic Risk Assessments” (NUREG/CR-5253, SAND88-2940, Sandia National Laboratories, Albuquerque , New Mexico , 1990).
- 35
D. I. Chanin,
J. L. Sprung,
L. T. Ritchie, and
H.-N. Jow, “ MEL-COR Accident Consequence Code System (MACCS): User's Guide” (NUREG/CR-4691, SAND86-1562, Vol. 1, Sandia National Laboratories,
Albuquerque
,
New Mexico
, 1990).
10.2172/7038439 Google Scholar
- 36
H.-N. Jow,
J. L. Sprung,
J. A. Rollstin,
L. T. Ritchie, and
D. I. Chanin, “ MELCOR Accident Consequence Code System (MACCS): Model Description” (NUREG/CR-4691, SAND86-1562, Vol. 2, Sandia National Laboratories,
Albuquerque
,
New Mexico
, 1990).
10.2172/7247757 Google Scholar
- 37
J. A. Rollstin,
D. I. Chanin, and
H.-N. Jow, “ MELCOR Accident Consequence Code System (MACCS): Programmer's Reference Manual” (NUREG/CR-1562, SAND86-1562, Vol. 3, Sandia National Laboratories,
Albuquerque
,
New Mexico
, 1990).
10.2172/7172209 Google Scholar
- 38 D. M. Ericson et al, “ Analysis of Core Damage Frequency: Methodology” (NUREG/CR-4550, SAND86-2084, Vol. 1, Rev. 1, Sandia National Laboratories, Albuquerque , New Mexico , 1989).
- 39 R. L. Iman and J. C. Helton, “An Investigation of Uncertainty and Sensitivity Analysis Techniques for Computer Models,” Risk Analysis 8, 71–90 (1988).
- 40 R. L. Iman and J. C. Helton, “ A Comparison of Uncertainty and Sensitivity Analysis Techniques for Computer Models” (NUREG/ CR-3904, SAND84-1461, Sandia National Laboratories, Albuquerque , New Mexico , 1985).
- 41 R. L. Iman, M. J. Shortencarier, and J. D. Johnson, “ A FORTRAN 77 Program and User's Guide for the Calculation of Partial Correlation and Standardized Regression Coefficients” (NUREG/ CR-4122, SAND85-0044, Sandia National Laboratories, Albuquerque , New Mexico , 1985).
- 42 R. L. Iman, J. C. Helton, and J. E. Campbell, “An Approach to Sensitivity Analysis of Computer Models, Part 1. Introduction, Input Variable Selection and Preliminary Variable Assessment,” Journal of Quality Technology 13, 174–183 (1981).
- 43 R. L. Iman, J. C. Helton, and J. E. Campbell, “An Approach to Sensitivity Analysis of Computer Models, Part 2. Ranking of Input Variables, Response Surface Validation, Distribution Effect and Technique Synopsis,” Journal of Quality Technology 13, 232–240 (1981).
- 44 R. L. Iman and W. J. Conover, Modern Business Statistics, 2nd ed. (Wiley, New York , 1989).
- 45 R. L. Iman and W. J. Conover, “The Use of the Rank Transform in Regression,” Technometrics 21, 499–509 (1979).
- 46 D. M. Allen, “ The Prediction Sum of Squares as a Criterion for Selecting Predictor Variables” (Report No. 23, Department of Statistics, University of Kentucky, Lexington , 1971).
- 47
H. W. Lewis
et al, “ Risk Assessment Review Group Report to the U. S. Nuclear Regulatory Commission” (NUREG/CR-0400, U. S. Nuclear Regulatory Commission,
Washington
,
D.C.
, 1978).
10.2172/6489792 Google Scholar
- 48 U. S. Nuclear Regulatory Commission, “ Reactor Safety Study – An Assessment of Accident Risks in U.S. Commercial Nuclear Power Plants” ( WASH-1400, NUREG-75.014, Washington, D.C., 1975).
- 49 Commonwealth Edison Company, “ Zion Probabilistic Safety Study” (1981).
- 50 Power Authority of the State of New York and Consolidated Edison Company of New York, “ Indian Point Probabilistic Safety Study” (1982).
- 51 Public Service Company of New Hampshire and Yankee Atomic Electric Company, “ Seabrook Station Probabilistic Safety Assessment” (1983).
- 52
S. Kaplan, “On the Method of Discrete Probability Distributions in Risk and Reliability Calculations – Applications to Seismic Risk Assessment,”
Risk Analysis
1, 189–196 (1981).
10.1111/j.1539-6924.1981.tb01415.x Google Scholar
- 53
S. Kaplan, “Matrix Theory Formalism for Event Tree Analysis: Application to Nuclear Risk Analysis,”
Risk Analysis
2, 9–18 (1982).
10.1111/j.1539-6924.1982.tb01398.x Google Scholar