Transport Codes
Presented by:
Bernie Kirk
Director, Radiation Safety Information
Computational Center (RSICC)
Nuclear Science and Technology Division
SUMMARY
BACKGROUND
DETERMINISTIC SOFTWARE
CONCLUSION
2 Managed by UT-Battelle
for the U.S. Department of Energy
Science News
ScienceDaily Oct. 1, 2009
Stochastic Method
(Monte Carlo)
Deterministic Method
1
r, E, S r, E, S f r, E t r, E r, E,
4
s r, E' E, ' r , E ' , ' dE ' d '
'E'
5 Managed by UT-Battelle
for the U.S. Department of Energy
Non-commercial Software
MONTE CARLO SOFTWARE DETERMINISTIC
SOFTWARE
NEUTRON Transport
NEUTRON Transport
SCALE – MONACO, MAVRIC, KENO
MCNP/MCNPX SCALE - DENOVO
TRIPOLI PARTISN
VIM PENTRAN
TART
SERPENT
Electron/Photon High
Transport Energy
EGS5 Transport
PENELOPE
EgsNRC PHITS
GEANT4
FLUKA
MCNPX
SHIELD
6 Managed by UT-Battelle
for the U.S. Department of Energy
SCALE
http://www.ornl.gov/sci/scale/
Developed at Oak Ridge National Laboratory
Available:
RSICC http://rsicc.ornl.gov
NEADB http://www.nea.fr/html/databank/welcome.html
7 Managed by UT-Battelle
for the U.S. Department of Energy
SCALE Standardized Computer Analyses for
Licensing Evaluation
• SCALE is a modular code system that uses automated sequences
to provide:
– Problem-dependent cross-section processing
– Reactor / lattice physics analysis
– Criticality safety analysis
– Sensitivity/uncertainty analysis
– Radiation shielding analysis
– Spent fuel and HLW characterization
– Advanced 3-D visualization and automated user interface
• Distributed and used worldwide for > 25 years
• Developed at Oak Ridge National Laboratory
8 Managed by UT-Battelle
for the U.S. Department of Energy
Material processing and fabrication Commercial and
research reactors
SCALE is used
worldwide (~30
nations) by
regulators,
vendors, utilities,
SCALE provides mature and cask designers,
flexible software for nuclear R&D labs,
analysis of nearly any application safeguard
within the nuclear fuel cycle agencies
Recycling
D&D
9 Managed by UT-Battelle Transport Storage
for the U.S. Department of Energy
MONACO/MAVRIC (SCALE)
10 Managed by UT-Battelle
for the U.S. Department of Energy
Monaco – Multigroup Monte Carlo
• Neutron/Photon
• general-purpose, fixed source, multigroup Monte
Carlo shielding
• multigroup transport methods are inherited from
Monaco’s predecessor, MORSE
11 Managed by UT-Battelle
for the U.S. Department of Energy
Monaco – Multigroup Monte Carlo
• geometry data as sets of quadratic equations -
same geometry package as KENO-VI
• Flexible, friendly user input
– Source description is separable:
space, energy, direction
– Region tallies, mesh tallies, point detector
tallies
– Integrates fluxes with response functions
(dose)
• Variance Reduction capabilities
– Weight windows based on region/energy
– Mesh-based weight windows
• MeshView plotting software
– Plot calculated responses on mesh grid
12 Managed by UT-Battelle
for the U.S. Department of Energy
MAVRIC – Monaco with Automated
Variance Reduction using Importance
Calculations
• Intended for challenging, deep-penetration problems
• CADIS (Consistent Adjoint Driven Importance Sampling)
– Denovo is used to calculate the coarse-mesh adjoint flux for a specific tally
– Creates importance map (space, energy) and biased source
– Monaco is then optimized for that specific tally
• Forward Weighted CADIS
– Denovo estimates forward fluxes, used in the adjoint source
– Helps balance relative uncertainties across multiple tallies or large mesh
tallies
13 Managed by UT-Battelle
for the U.S. Department of Energy
CADIS Methodology for
Automated Variance Reduction
Example: PWR Ex-Vessel Thermal (10B) Detector Response
300
Concrete shield
adjoint
5.00E+30
7.46E+29
Cavity Pressure vessel 250 1.11E+29
1.66E+28
2.48E+27
3.70E+26
5.51E+25
Detector 200
y-dimension (cm)
8.23E+24
1.23E+24
1.83E+23
2.73E+22
Downcomer 150 4.07E+21
6.08E+20
9.07E+19
Neutron pads 1.35E+19
2.02E+18
100 3.01E+17
Core barrel 4.49E+16
6.70E+15
1.00E+15
Flow channel 50
Baffle plates
Core 50 100 150 200 250 300
x-dimension (cm)
y-distance (cm)
5.2E-05
No VR 8.86E+4 (10.1 yrs) 1 100 2.3E-05
1.0E-05
40
Analog calculation:
560 hours, poor resolution in mesh tally
15 Managed by UT-Battelle
for the U.S. Department of Energy
KENO (SCALE)
16 Managed by UT-Battelle
for the U.S. Department of Energy
KENO Multigroup Monte Carlo Code
for Criticality Calculations
• KENO was first developed during 1960’s and is
internationally accepted tool for criticality safety analysis
• SCALE has two versions
– KENO.Va: restricted geometries, but faster
– KENO-VI: general geometry; rotations; intersections
• Multigroup method runs much faster than continuous
energy, but requires self-shielding corrections to XS’s
17 Managed by UT-Battelle
for the U.S. Department of Energy
SCALE 6: Criticality LEU
• Continuous energy
2.0
1 1.5
capability incorporated in
(C-B)/B%
1.0
0.99
Keff
0.5
KENO
0.98
0.0
0.97 -0.5
-1.0
0.95
-1.5
-2.0
CE vs. Multigroup
18 Managed by UT-Battelle
for the U.S. Department of Energy
continuous-energy
or
neutron flux
multi-group
Explicit 3D neutron
transport model of
application
reaction rates
keff,
EALF,
etc.
19 Managed by UT-Battelle
for the U.S. Department of Energy
SCALE: KENO-VI and MAVRIC Coupling
West wing of the ORCEF,
building 9213
Step 1:
• Use KENO-VI to model the
criticality accident and save the
fission distribution as a mesh
source
layers of UF4
Step 2:
• Use MAVRIC to model particle transport
• Use KENO-VI fission distribution as the
source for MAVRIC
• Calculate detector responses, dose rates
at specific points or mesh tallies of dose
rates
Available:
RSICC http://rsicc.ornl.gov
NEADB http://www.nea.fr/html/databank/welcome.html
21 Managed by UT-Battelle
for the U.S. Department of Energy
MCNP/MCNPX
neutron, photon, electron, or coupled neutron/photon/electron
transport
22 Managed by UT-Battelle
for the U.S. Department of Energy
MCNP History
23 Managed by UT-Battelle
for the U.S. Department of Energy
MCNP / MCNPX Teams
• MCNP • MCNPX
• Deputy Group Leader: Jeremy Sweezy • Team Lead: Gregg McKinney
• Project Lead: Tim Goorley • Project Lead: Laurie Waters
• Tom Booth • Joe Durkee
• Forrest Brown • Jay Elson
• Jeff Bull • Michael Fensin (N-4)
• Art Forster • John Hendricks (X-3)
• John Hendricks • Shannon Holloway (T-2 CINDER)
• Grady Hughes • Michael James
• Roger Martz • Russell Johns
• Stepan Mashnik • William Johnson
• Avneet Sood • Toshihiko Kawano (T-2 CGM)
• Tony Zukaitis • Denise Pelowitz
24 Managed by UT-Battelle
for the U.S. Department of Energy
MCNP/X Present
Simulated Radiographs
27 Managed by UT-Battelle
for the U.S. Department of Energy
Monte Carlo Applications Tool Kit
(MCATK)
• From scratch Monte Carlo radiation transport code in C++, using Agile-like processes,
unit testing, pair programming, modular design
• Driven by desire to utilize GPUs & new hardware (which doesn’t always have a
FORTAN 90 compiler), as well as maintain MC expertise in new staff
• Intended to replace portions of MCNP
• Leverages Commercial + Open Source Software
– Eclipse Development Environment
– Unit Test++
GUI tool to view geometry
– QT
– Doxygen
– Boost
28 Managed by UT-Battelle
for the U.S. Department of Energy
MCNP Unstructured Mesh
29 Managed by UT-Battelle
Energy
for the U.S. Department of Energy
Deposition
Low Energy Threshold R&D Topics!
30 Managed by UT-Battelle
for the U.S. Department of Energy
Improved Variance Reduction R&D Topics!
31 Managed by UT-Battelle
for the U.S. Department of Energy
Criticality Efforts R&D Topics!
Perturbations 6 cm
Effects on perturbation
Exact, 2
Reactivity ( k/kk')
0.12
• Probability of Initiation Perturbed MCNP
0.10 region runs
0.08
0.06
0.04 Standard
2 MCNP MCNP,
runs
2ndMCNP
order perturbation
2nd-order
0.02
2nd+PS(5-cycle)
0.00
0.00 0.10 0.20 0.30 0.40 0.50
Fractional density change
32 Managed by UT-Battelle
for the U.S. Department of Energy
TRIPOLI
Available:
RSICC http://rsicc.ornl.gov
NEADB http://www.nea.fr/html/databank/welcome.html
33 Managed by UT-Battelle
for the U.S. Department of Energy
TRIPOLI
34 Managed by UT-Battelle
for the U.S. Department of Energy
TRIPOLI-4: a reference tool for radioprotection and
shielding, core physics, and criticality studies
CEA (core physics, radioprotection, criticality studies
through the CRISTAL package)
www.nuresim.com
35 Managed by UT-Battelle
for the U.S. Department of Energy
TRIPOLI-4 : main characteristics
3D, Monte-Carlo code to compute transport related
quantities (flux, current, reaction rate, keff etc.)
Reactor simulation
36 Managed by UT-Battelle
for the U.S. Department of Energy
TRIPOLI-4 : some technical features
Mainly written in C++
37 Managed by UT-Battelle
for the U.S. Department of Energy
TRIPOLI-4 : a focus on nuclear data
management
TRIPOLI-4 directly reads pendf files from various
evaluations
Presently, evaluations from JEF2.2, JEFF3.0 3.1 3.2,
ENDF/B-VI.4 B-VI.8, B-VII.0, JENDL33 may be used
(available from NEADB and RSICC)
39 Managed by UT-Battelle
for the U.S. Department of Energy
TRIPOLI-4 : a focus on geometry description
2D cut
User friendly interface
Or definition by surfaces :
40 Managed by UT-Battelle
for the U.S. Department of Energy
VIM
http://www.vim.anl.gov/
Available:
RSICC http://rsicc.ornl.gov
NEADB http://www.nea.fr/html/databank/welcome.html
41 Managed by UT-Battelle
for the U.S. Department of Energy
VIM
•Continuous Energy Neutron/Photon
Transport Code System for criticality, reactor
physics, and shielding
•Geometry options are infinite medium,
combinatorial geometry, and hexagonal or
rectangular lattices of combinatorial
geometry unit cells, and rectangular lattices
of cells of assembled plates
•Variance reduction using splitting/Russian
roulette, non-terminating absorption with
nonanalog weight cutoff energy
42 Managed by UT-Battelle
for the U.S. Department of Energy
VIM Background
•Developed to analyze ANL critical experiments and
benchmark ANL diffusion, transport, and spectrum
analytical tools
•Nuclear data processed using ANL codes independent of
others:
–Not NJOY
–Some other codes use ANL-developed methods (e.g.,
URR probability tables in MCNP)
•Earlier VIM verification & validation:
–Extensive benchmarking with ZPR/ZPPR criticals and
ICSBEP
–Earlier libraries verified by inter-code comparisons with
MC2-2 fast reactor spectrum code in great detail, MCNP,
etc.
43 Managed by UT-Battelle
for the U.S. Department of Energy
Recent VIM Enhancements
CODE
• FORTRAN 95, with nuclear data in
structures
• Eliminated archaic memory
management routines
• Improved input diagnostics
• Slicer geometry input color display
• Enhanced precision to reduce tracking
Data Library
errors and differences between
platforms • Eliminated intermediate codes previously
used to access processed nuclear data
libraries
• Default libraries now ASCII, with
provenance information in header
records
• Increased angular distribution detail and
accuracy
• Total fission spectra used, not prompt
only
• ENDF/B-VII.0, tested on fast and
44 Managed by UT-Battelle
for the U.S. Department of Energy
intermediate systems
45
k(VIM) - k(MCNP) (pcm)
Managed by UT-Battelle
-100
-50
50
100
150
012
013
014
015
018
021
022
027
ICSBEP HEU-MET Benchmark
028
061
065
HMI001
TART
http://home.comcast.net/~redcullen1/speed.htm
Available:
RSICC http://rsicc.ornl.gov
NEADB http://www.nea.fr/html/databank/welcome.html
46 Managed by UT-Battelle
for the U.S. Department of Energy
Pedigree of TART
•TART2000
• Coupled Neutron-Photon
• 3-D Combinatorial Geometry
• Time Dependent
• Energy Range: Very Low up to 1 GeV
47 Managed by UT-Battelle
for the U.S. Department of Energy
TART Features
• Very fast
•Uses Latest ENDF/B data
• neutrons & photons
• Runs on ANY computer
•UNIX Workstations
•Windows/Linux PC
• Power MAC
•Very user friendly
•Only about 15-20 % is the Monte Carlo code
•The remainder is tools to make your job easier
48 Managed by UT-Battelle
for the U.S. Department of Energy
TART Features
•The TART System is a complete
system
•It helps you prepare and check
input
•Runs your Monte Carlo
calculations
•Source and criticality problems
49 Managed by UT-Battelle
for the U.S. Department of Energy
TART Features
•A well known advantage of Monte
Carlo is its ability to handle
complicated geometry.
Example of a complete
seven story building
50 Managed by UT-Battelle
for the U.S. Department of Energy
TART Features
51 Managed by UT-Battelle
for the U.S. Department of Energy
SERPENT
http://montecarlo.vtt.fi
Available:
RSICC http://rsicc.ornl.gov
NEADB http://www.nea.fr/html/databank/welcome.html
52 Managed by UT-Battelle
for the U.S. Department of Energy
The Serpent Computer Code
http://montecarlo.vtt.fi
− Continuous-energy cross sections read from ACE format data libraries and
reconstructed on a unionized energy grid
− Neutron interactions modeled using classical collision kinematics and ENDF reaction
laws
− Unresolved resonance cross sections sampled from probability tables
• Tracking:
• Burnup calculation:
• Main limitations:
Availability
RSICC http://rsicc.ornl.gov
NEADB http://www.nea.fr/html/databank/welcome.html
57 Managed by UT-Battelle
for the U.S. Department of Energy
Denovo
• State of the Art Transport Methods
massively parallel deterministic radiation transport
code
–3-D regular grid, Discrete Ordinates (SN)
–Multigroup energy, anisotropic PN scattering
–6 spatial discretization algorithms (linear & tri-linear discontinuous FE,
Step-characteristics, theta-weighted diamond, diamond difference + fixup)
• High Performance, Modern, Innovative Solvers
–GMRES, BiCGStab. or Source Iteration options on within-group solves
–DSA-preconditioning (SuperLU/ML-preconditioned CG)
–Transport Two-Grid upscatter acceleration of Gauss-Seidel MG iteration
–Parallel first collision approximation
–Eigenvalue (keff) and fixed-source problem modes
–Krylov solvers provided by Trilinos Library
58 Managed by UT-Battelle
for the U.S. Department of Energy
58
DENOVO APPLICATIONS
Fusion:
ITER analyses
59 Managed by UT-Battelle
for the U.S. Department of Energy
59
DENOVO
• Parallel Algorithms
–Koch-Baker-Alcouffe (KBA) wavefront solve
–Domain replicated & decomposed options for
parallel first-collision source
–Multi-level decompositions in energy and angle
under development
–Parallel I/O for massive problems
60 Managed by UT-Battelle
for the U.S. Department of Energy
60
Denovo Weak Scaling
• Advanced Methods Denovo is designed to run
high resolution problems
– GMRES (with DSA preconditioning) within-group scaled to thousands of cores.
solver
– Transport, Two-Grid accelerated Gauss-Seidel for
multi-group
– Koch-Baker-Alcouffe (KBA) parallel domain-
decomposition
– Trilinos parallel solver package for highly efficient
Krylov solvers and as an interface to the SuperLU
direct solver library
– Parallel first-collision source
– 5 different spatial differencing schemes Strong Scaling
– Multiple input front-ends including Python
– High-performance parallel I/O using HDF5 Denovo’s parallel algorithms
are very efficient on cluster-
level platforms as well.
61 Managed by UT-Battelle
for the U.S. Department of Energy
Cancer Therapy Planning with Denovo
62 Managed by UT-Battelle
for the U.S. Department of Energy
Therapy Plan
contours at 80, 70, 50, 30, and 10%
63 Managed by UT-Battelle
for the U.S. Department of Energy
Denovo Capabilities for Treatment
Planning
64 Managed by UT-Battelle
for the U.S. Department of Energy
PENTRAN
http://www.hswtech.com/
65 Managed by UT-Battelle
for the U.S. Department of Energy
PENTRANTM (Parallel Environment Neutral-particle TRANsport)
Code System
Pre-processing
PENMSH-XP (prepares mesh/material/source distributions &
PENTRAN input file)
Post-processing
PENDATA (prepares tables of flux, source, and material distributions by
processing parallel-partitioned output files)
66 Managed by UT-Battelle
for the U.S. Department of Energy
• PENTRAN code system was developed by Glenn Sjoden and
Alireza Haghighat in 1996.
• ANSI FORTRAN F77/f90 with MPI library, over 37,000 lines
• Industry standard FIDO input
• Licensed via HSW Technologies LLC
67 Managed by UT-Battelle
for the U.S. Department of Energy
Numerical formulations
– Adaptive Differencing Strategy
DZ DTW EDI
Upgrade condition: Negative solution w ≥ .96
Diamond Zero Fixup (DZ); Directional Theta-Weighted (DTW); Exponential-Directional Iterative (EDI)
– Acceleration
• Coarse-mesh Rebalance (CMR) techniques; multi-grid (MG);
Combined CMR & MG; Synthetic Even Parity Simplified Sn (EP-SSn);
Preconditioned EP-SSn/Sn
68 Managed by UT-Battelle
for the U.S. Department of Energy
Numerical formulations (cont.)
– Iterative
• Multigroup & One-level Source Iteration (SI)
• Red-Black and Block Jacobi iteration
– Anisotropic scattering with arbitrary order,
– Angular quadrature set:
• Level symmetric (up to S20) with ordinate splitting (OS)
• Pn-Tn (arbitrary order) with OS
– Vacuum, reflective, and albedo boundaries
– Volumetric & planar angular sources
Other versions
– Medical Application:
– PENTRAN-MP (Radiation dose – photon & electron);
– PENTRAN-CRT (Hybrid Sn & Characteristic Ray Trace) (under
testing & evaluation)
– Core physics: PENTRAN with PENBURN (3-D fuel burnup)
69 Managed by UT-Battelle
for the U.S. Department of Energy
Benchmarking: VENUS-3 benchmark facility, Kobayashi 3-D benchmarks,
C5G7 MOX Criticality benchmark, Ganapol TIEL benchmarks
Applications
– BWR Core-Shroud
– Pulsed Gamma Neutron Activation
Analysis (PGNAA) device
– X-Ray room
– Time-of-Flight (TOF)
– Spent fuel storage cask
– UF Training Reactor (UFTR) - Water tank Characterization
– UFTR - Thermal column optimization
– SNM Detection optimization
– Whole body Medical Phantom dosimetry (PENTRAN-MP)
– SiC Power Monitoring Assessment
– LWR 3-D fuel burnup calculation for whole core (PENTRAN with PENBURN)
– Full-core PWR (IBM blueGene/P) (tested on 4096 cores)
– Development of Spent fuel pool monitoring tool
– Cargo Monitoring Assessments
Availability:
RSICC http://rsicc.ornl.gov
NEADB http://www.nea.fr/html/databank/welcome.html
71 Managed by UT-Battelle
for the U.S. Department of Energy
PARTISN
PARallel, TIme-Dependent SN
Evolutionary successor to DANTSYS (ONEDANT, TWODANT,
THREEDANT)
72 Managed by UT-Battelle
for the U.S. Department of Energy
PARTISN
73 Managed by UT-Battelle
for the U.S. Department of Energy
Supercomputers Today
Million-fold increase in computing and data
capabilities
75 Managed by UT-Battelle
for the U.S. Department of Energy
Computational Medical Physics Working Group
http://cmpwg.ans.org
76 Managed by UT-Battelle
for the U.S. Department of Energy
Monte Carlo 2010 and Supercomputing 2010
http://sna-mc-2010.org/
October 17-20, 2010
Tokyo, Japan
77 Managed by UT-Battelle
for the U.S. Department of Energy