Skip to main content Accessibility help
×
Hostname: page-component-78c5997874-8bhkd Total loading time: 0 Render date: 2024-11-08T08:19:12.496Z Has data issue: false hasContentIssue false

7 - Verification, Validation, and Uncertainty Quantification for Coarse Grained Simulation

from Part II - Challenges

Published online by Cambridge University Press:  05 June 2016

Fernando F. Grinstein
Affiliation:
Los Alamos National Laboratory
Get access

Summary

Image of the first page of this content. For PDF version, please use the ‘Save PDF’ preceeding this image.'
Type
Chapter
Information
Publisher: Cambridge University Press
Print publication year: 2016

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

AIAA, Guide for the Verification and Validation of Computational Fluid Dynamics Simulations, American Institute of Aeronautics and Astronautics, Reston, VA, AIAA-G-077–1998 (1998).Google Scholar
ASME, V&V 10 - 2006 Guide for Verification and Validation in Computational Solid Mechanics, American Society of Mechanical Engineers, New York (2006).Google Scholar
Brock, J.S., Kamm, J.R., Rider, W.J., Brandon, S.T., Woodward, C., Knupp, P., and Trucano, T.G., Verification Test Suite for Physics Simulation Codes, Los Alamos National Laboratory report LA-UR-06–8421 (2006).CrossRefGoogle Scholar
Boyack, B.E., “Quantifying reactor safety margins Part 1: An overview of the code scaling, applicability, and uncertainty evaluation methodology,” Nucl. Engrng Design, 119, 115 (1990).CrossRefGoogle Scholar
Hanson, K.M. and Hemez, F.M., “A framework for assessing confidence in computational predictions,” Exp. Tech., 25, 5055 (2001).CrossRefGoogle Scholar
Helton, J., Conceptual and Computational Basis for the Quantification of Margins and Uncertainty, Sandia National Laboratories report SAND2009-3055 (2009).CrossRefGoogle Scholar
Hills, R., Witkowski, W., Rider, W., Trucano, T., and Urbina, A., “Development of a fourth generation predictive capability maturity model,” Sandia National Laboratories report SAND2013-8051 (2013).CrossRefGoogle Scholar
Hemez, F.M., Non-Linear Error Ansatz Models for Solution Verification in Computational Physics, Los Alamos National Laboratory report LA-UR-05–8228 (2005).Google Scholar
Kamm, J.R., Brock, J.S., Brandon, S.T., Cotrell, D.L., Johnson, B., Knupp, P., Rider, W.J., Trucano, T.G., and Weirs, V.G., Enhanced Verification Test Suite for Physics Simulation Codes, Los Alamos National Laboratory report LA-14379, Lawrence Livermore National Laboratory report LLNL-TR-411291, Sandia National Laboratories report SAND2008-7813 (2008).Google Scholar
Knupp, P. and Salari, K., Verification of Computer Codes in Computational Science and Engineering, Chapman & Hall/CRC, Boca Raton, FL (2003).Google Scholar
Knupp, P., Ober, C., and Bond, R., “Measuring progress in order-verification within software development projects,” Engrng. Comp., 23, 283294 (2007).Google Scholar
Mahadevan, S. and Rebba, R., “Validation of reliability computational models using Bayes networks,” Reliability Engineering & System Safety 87(2), 223232 (2005).CrossRefGoogle Scholar
Nelson, R., Unal, C., Stewart, J., and Williams, B., Using Error and Uncertainty Quantification to Verify and Validation Modeling and Simulation, Los Alamos National Laboratories report LA-UR-10-06125 (2010).Google Scholar
Oberkampf, W.L., “What are validation experiments?,” Exp. Tech., 25, 3540 (2001).CrossRefGoogle Scholar
Oberkampf, W.L. and Trucano, T.G., “Verification and validation in computational fluid dynamics,” Prog. Aerospace Sci., 38, 209272 (2002).CrossRefGoogle Scholar
Oberkampf, W.L., Trucano, T.G., and Hirsch, C., “Verification, validation, and predictive capability in computational engineering and physics,” Appl. Mech. Rev., 57, 345384 (2004).CrossRefGoogle Scholar
Oberkampf, W.L. and Trucano, T.G., “Verification and validation benchmarks,” Nucl. Design Engrng, 23, 716743 (2007); also available as Sandia National Laboratories report SAND2007-0853 (2007).Google Scholar
Oberkampf, W. L., Pilch, M., and Trucano, T. G., Predictive Capability Maturity Model for Computational Modeling and Simulation, Sandia National Laboratories report SAND 2007–5948 (2007).CrossRefGoogle Scholar
Oberkampf, W.L. and Roy, C.J., Verification and Validation in Scientific Computing, Cambridge University Press, New York (2010).CrossRefGoogle Scholar
Oberkamf, W.L. and Smith, B., Assessment criteria for computational fluid dynamic validation benchmark experiments, 52nd Aerospace Sciences Meeting, AIAA 2014-0205, January 2014.CrossRefGoogle Scholar
Pilch, M., Trucano, T.G., and Helton, J.C., Ideas Underlying Quantification of Margins and Uncertainties (QMU): A White Paper, Sandia National Laboratories report SAND2006-5001 (2006).Google Scholar
Rider, W.J., Kamm, J.R., and Weirs, V.G., Code Verification Workflow in CASL, Sandia National Laboratories report SAND2010-7060P (2010).Google Scholar
Roache, P., “Code verification by the method of manufactured solutions,” J. Fluids Engrng, 124, 410 (2002).CrossRefGoogle Scholar
Roache, P., “Building PDE Codes to be verifiable and validatable,” Comput. Sci. Engrng., 6, 3038 (2004).CrossRefGoogle Scholar
Roache, P., Fundamentals of Verification and Validation, Hermosa Publishers, Albuquerque, NM (2009).Google Scholar
Roy, C.J., “Review of code and solution verification procedures for computational simulation,” J. Comput. Phys., 205, 131156 (2005).CrossRefGoogle Scholar
Roy, C.J. and Oberkampf, W.L., “A comprehensive framework for verification, validation, and uncertainty quantification in scientific computing,” submitted to Comp. Meth. Appl. Mech. Engrng. (2010).CrossRefGoogle Scholar
Salari, K. and Knupp, P., Code Verification by the Method of Manufactured Solutions, Sandia National Laboratories report SAND2000-14444 (2000).CrossRefGoogle Scholar
Sargent, R.G., “Verification and validation of simulation models,” in Proceedings of the 1998 Winter Simulation Conference, ed. by Medeiros, D.J., Watson, E.F., Carson, J.S., and Manivannan, M.S., 121–130 (1998).Google Scholar
Sargent, R.G., “Some approaches and pardigms for verifying and validation simulation models,” in Proceedings of the 2001 Winter Simulation Conference, ed. by Peters, B.A., Smith, J.S., Medeiros, D.J., and Rohrer, M.W., 106–114 (2001).Google Scholar
Schwer, L.E., “An overview of the PTC 60 / V&V 10 guide for verification and validation in computational solid mechanics,” Reprint by ASME, available at http://cstools.asme.org/csconnect/pdf/CommitteeFiles/24816.pdf (2006).CrossRefGoogle Scholar
Sornette, D., Davis, A.B., Ide, K., Vixie, K.R., Pisarenko, V., and Kamm, J. R., “Algorithm for model validation: Theory and applications,” Proc. Nat. Acad. Sci. USA 104, 65626567 (2007).CrossRefGoogle ScholarPubMed
Stern, F., Wilson, R.V., Coleman, H.W., Paterson, E.G., “Comprehensive approach to verification and validation of CFD simulations—Part 1: Methodology and procedures,” J. Fluids Engrng, 123, 793802 (2001).CrossRefGoogle Scholar
Stern, F., Wilson, R.V., and Shao, J., “Quantitative V&V of CFD simulations and certification Of CFD codes,” Int. J. Num. Meth. Fluids, 50, 13351355 (2005).CrossRefGoogle Scholar
Stewart, J.W., Measures of Progress in Verification, Sandia National Laboratories report SAND2005-4021P (2005).Google Scholar
Szilard, R., Zhang, H., Kothe, D., and Turinsky, P., The Consortium for Advanced Simulation of Light Water Reactors, Idaho National Laboratory (United States): Funding organization: DOE-NE (United States) (2011).Google Scholar
Trucano, T.G., Pilch, M., and Oberkampf, W.L., General Concepts for Experimental Validation of ASCI Code Applications, Sandia National Laboratories report SAND2002-0341 (2002).CrossRefGoogle Scholar
Trucano, T.G., Pilch, M., and Oberkampf, W.L., On the Role of Code Comparisons in Verification and Validation, Sandia National Laboratories report SAND2003-2752 (2003).Google Scholar
Trucano, T.G., Swiler, L.P., Igusa, T., Oberkampf, W.L., and Pilch, M., “Calibration, validation, and sensitivity analysis: What’s what,” Reliab. Engrng. Syst. Safety, 92, 13311357 (2006).CrossRefGoogle Scholar
Zhang, R. and Mahadevan, S., “Bayesian methodology for reliability model acceptance,” Reliability Engineering & System Safety 80(10, 95103 (2003).CrossRefGoogle Scholar

Save book to Kindle

To save this book to your Kindle, first ensure [email protected] is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×