WRF   2.5 Kilometer CONUS Benchmarks

July 2009 edition.  Click here for previous.

Scroll down for additional information.

 

 

2.5 KM CONUS Benchmark

The domain is 2.5KM horizontal resolution on a 1500 by 1200 grid with 35 vertical levels, with a time step of 15 seconds. The benchmark is restarted on June 4, 2008 06Z and run for 3 hours and then the time per timestep is averaged over all but the first time step, which is discarded.  The average time per time step is divided by the operation count for an average time step, 411.7 billion floating point operations, to determine floating point rate.  Return to the WRF V3 Benchmarks Page for additional information. Operation count determined on Cray X1E by Peter Johnsen, Cray Inc., November, 2008.

System Descriptions

IBM Power6 (bluefire.ucar.edu)

Results submitted by Davide Del Vento, NCAR.  April, 2009

1.       Name of system (product name, hostname, institution): IBM SP Power 6, bluefire.ucar.edu, NCAR

2.       Model version of WRF: 3.0.1

3.       Operating system and version: AIX

4.       Compiler and version: IBM XLF Fortran 11

5.       Processor manufacturer, type, and speed: IBM Power 6, 4.7 GHz, 4MB L2 (per core), 32 MB (per 2 cores)

6.       Cores per socket and sockets per node: 2/16

7.       Main memory per core: 4 or 2 GB per core

8.       Interconnect type, product name, topology: Infiniband

9.       Other information:

a.       Additional system specs at: http://www.cisl.ucar.edu/computers/bluefire

b.  Compile time settings: -O3 -qhot -qarch=auto -qtune=auto -qcache=auto

c.       Run time settings: Large (64KB) pages, processor binding, SMT

d.       For additional information see: http://www.cisl.ucar.edu/docs/bluefire/wrf.html

Endeavor Cluster (Intel)

Results submitted by Roman S. Dubtsov, Intel Corp.  February, 2009

1.       Name of system (product name, hostname, institution): Endeavor, Intel

2.       Model version of WRF: 3.0.1

3.       Operating system and version: RHEL 4U5

4.       Compiler and version: Intel Fortran Compiler 11.1.xx

5.       Processor manufacturer, type, and speed: Intel Xeon X5560 (Nehalem), 2.8 GHz 12MB L3 cache, HT (some on some off), Turbo on

6.       Cores per socket and sockets per node: 4/2

7.       Main memory per core: 3 GB buffered DDR3, 1333 MHz

8.       Interconnect type, product name, topology: DDR Infiniband, fat tree, OFED 1.3.x

9.       Other information: Intel Xeon 55xx chipset, 6.4 GT/s QPI

Cray XT5

Results submitted by Peter Johnsen, Cray Inc.  July, 2009

1.       Name of system (product name, hostname, institution): Cray XT5, internal, Cray Inc.

2.       Model version of WRF: 3.0.1.1

3.       Operating system and version: Cray CLE 2.2.32

4.       Compiler and version: PGI 8.0.6

5.       Processor manufacturer, type, and speed: AMD Opteron quad-core (Shanghai), 2.4 GHz

6.       Cores per socket and sockets per node: 4/2

7.       Main memory per core: 2GB and 4GB

8.       Interconnect type, product name, topology: Cray SeaStar 2.1

Ranger

Results submitted by Raffaele Montuoro, Texas A & M University Supercomputing Facility, May 2009

1.       Name of system (product name, hostname, institution): Sun Constellation Linux Cluster, ranger.tacc.utexas.edu, TACC, U. Texas

2.       Model version of WRF: 3.0.1.1

3.       Operating system and version: Linux

4.       Compiler and version: Portland Group 7.2-5 64-bit

5.       Processor manufacturer, type, and speed: AMD Quad-core AMD Opteron (Barcelona), 2.3 GHz

6.       Cores per socket and sockets per node: 4/4

7.       Main memory per core: 2GB

8.       Interconnect type, product name, topology: Infiniband, 1 GB/second unidirectional point-to-point bandwidth

9.       Other information: http://www.tacc.utexas.edu/resources/hpcsystems

SGI ICE 8200 EX (NASA)

Results submitted by Gerardo Cisneros, SGI Corp., Summer 2008

1.       Name of system (product name, hostname, institution): SGI ICE 8200 EX, pleiades, NASA Ames

2.       Model version of WRF: 3.0

3.       Operating system and version: SUSE Enterprise Linux 10.

4.       Compiler and version: Intel Fortran and C/C++ Compilers, version 10.1.017.

5.       Processor manufacturer, type, and speed: Xeon E5472 (Harpertown) 3GHz quad-cores with 6MB L2 per core pair, Intel 5400 series chipset (Seaburg)

6.       Cores per socket and sockets per node: 4/2

7.       Main memory per core: 2 GB

8.       Interconnect type, product name, topology: Infiniband, ConnectX HCAs, hypercube

9.       Other information:

Blue Gene/P (Surveyor)

Results submitted by John Michalakes, NCAR, June 2009

1.       Name of system (product name, hostname, institution): Blue Gene/P, surveyor.alcf.anl.gov, Argonne NL

2.       Model version of WRF: 3.1

3.       Operating system and version: Compute Node Kernel (Linux variant)

4.       Compiler and version: IBM Fortran, optimization: -O3 -qnoipa -qarch=auto -qcache=auto -qtune=auto

5.       Processor manufacturer, type, and speed: PowerPC 450, 850 MHz

6.       Cores per socket and sockets per node: 4/1

7.       Main memory per core: 1 GB (in co-processor mode, using 1 core per node)

8.       Interconnect type, product name, topology: Proprietary, 3D-Torus

9.       Sources: http://www.alcf.anl.gov/resources/storage.php , http://en.wikipedia.org/wiki/Blue_Gene

Blue Gene/L (NY Blue)

Results submitted by Andrew Vogelmann, Brookhaven National Laboratory, July 2008

10.   Name of system (product name, hostname, institution): Blue Gene/L, NY Blue, Brookhaven NL/SUNY Stonybrook

11.   Model version of WRF: 3.0

12.   Operating system and version: SUSE Linux Enterprise Server 9 (Front End), Compute Node Kernel (Compute Nodes)

13.   Compiler and version: IBM Fortran, -O2 optimization

14.   Processor manufacturer, type, and speed: PowerPC 440, 700 MHz

15.   Cores per socket and sockets per node: 1/2

16.   Main memory per core: 1 GB (in co-processor mode, using 1 core per node)

17.   Interconnect type, product name, topology: Proprietary, 3D-Torus

18.   Other information: run in co-processor mode so only 1 core used per node

 

Created Nov. 9, 2008. John Michalakes, NCAR.  michalak@ucar.edu

Updated May 8, 2009 to add Power 6 and Nehalem plots.

Updated May 18, 2009 to add Ranger plots.

Updated July 24, 2009 to update Power6, update Nehalem, add Cray XT5