WRF   2.5 Kilometer CONUS Benchmarks

May 2009 edition.  Click here for previous.

Scroll down for additional information.

2.5 KM CONUS Benchmark

The domain is 2.5KM horizontal resolution on a 1500 by 1200 grid with 35 vertical levels, with a time step of 15 seconds. The benchmark is restarted on June 4, 2008 06Z and run for 3 hours and then the time per timestep is averaged over all but the first time step, which is discarded.  The average time per time step is divided by the operation count for an average time step, 411.7 billion floating point operations, to determine floating point rate.  Return to the WRF V3 Benchmarks Page for additional information. Operation count determined on Cray X1E by Peter Johnsen, Cray Inc., November, 2008.

System Descriptions

IBM Power6 (bluefire.ucar.edu)

Results submitted by Davide Del Vento, NCAR.  April, 2009

1.       Name of system (product name, hostname, institution): IBM SP Power 6, bluefire.ucar.edu, NCAR

2.       Model version of WRF: 3.0.1

3.       Operating system and version: AIX

4.       Compiler and version: IBM XLF Fortran 11

5.       Processor manufacturer, type, and speed: IBM Power 6, 4.7 GHz, 4MB L2 (per core), 32 MB (per 2 cores)

6.       Cores per socket and sockets per node: 2/16

7.       Main memory per core: 4 or 2 GB per core

8.       Interconnect type, product name, topology: Infiniband

9.       Other information:

a.       Additional system specs at: http://www.cisl.ucar.edu/computers/bluefire

b.  Compile time settings: -O3 -qhot -qarch=auto -qtune=auto -qcache=auto

c.       Run time settings: Large (64KB) pages, processor binding, SMT

d.       For additional information see: http://www.cisl.ucar.edu/docs/bluefire/wrf.html

Endeavor Cluster (Intel)

Results submitted by Roman S. Dubtsov, Intel Corp.  February, 2009

1.       Name of system (product name, hostname, institution): Endeavor, Intel

2.       Model version of WRF: 3.0.1

3.       Operating system and version: RHEL 4U5

4.       Compiler and version: Intel Fortran Compiler 11.0.59

5.       Processor manufacturer, type, and speed: Intel Xeon X5560 (Nehalem), 2.8 GHz 12MB L3 cache, HT off, Turbo off

6.       Cores per socket and sockets per node: 4/2

7.       Main memory per core: 2.25 GB DDR3, 1066 MHz FB

8.       Interconnect type, product name, topology: DDR Infiniband, fat tree, OFED 1.3.x

9.       Other information: Intel Xeon 55xx chipset, 6.4 GT/s QPI

Ranger

Results submitted by Raffaele Montuoro, Texas A & M University Supercomputing Facility, May 2009

1.       Name of system (product name, hostname, institution): Sun Constellation Linux Cluster, ranger.tacc.utexas.edu, TACC, U. Texas

2.       Model version of WRF: 3.0.1.1

3.       Operating system and version: Linux

4.       Compiler and version: Portland Group 7.2-5 64-bit

5.       Processor manufacturer, type, and speed: AMD Quad-core AMD Opteron (Barcelona), 2.3 GHz

6.       Cores per socket and sockets per node: 4/4

7.       Main memory per core: 2GB

8.       Interconnect type, product name, topology: Infiniband, 1 GB/second unidirectional point-to-point bandwidth

9.       Other information: http://www.tacc.utexas.edu/resources/hpcsystems

SGI ICE 8200 EX (NASA)

Results submitted by Gerardo Cisneros, SGI Corp., Summer 2008

1.       Name of system (product name, hostname, institution): SGI ICE 8200 EX, pleiades, NASA Ames

2.       Model version of WRF: 3.0

3.       Operating system and version: SUSE Enterprise Linux 10.

4.       Compiler and version: Intel Fortran and C/C++ Compilers, version 10.1.017.

5.       Processor manufacturer, type, and speed: Xeon E5472 (Harpertown) 3GHz quad-cores with 6MB L2 per core pair, Intel 5400 series chipset (Seaburg)

6.       Cores per socket and sockets per node: 4/2

7.       Main memory per core: 2 GB

8.       Interconnect type, product name, topology: Infiniband, ConnectX HCAs, hypercube

9.       Other information:

Blue Gene/L (NY Blue)

Results submitted by Andrew Vogelmann, Brookhaven National Laboratory, July 2008

1.       Name of system (product name, hostname, institution): Blue Gene/L, NY Blue, Brookhaven NL/SUNY Stonybrook

2.       Model version of WRF: 3.0

3.       Operating system and version: SUSE Linux Enterprise Server 9 (Front End), Compute Node Kernel (Compute Nodes)

4.       Compiler and version: IBM Fortran, -O2 optimization

5.       Processor manufacturer, type, and speed: PowerPC 440, 700 MHz

6.       Cores per socket and sockets per node: 1/2

7.       Main memory per core: 1 GB (in co-processor mode, using 1 core per node)

8.       Interconnect type, product name, topology: Proprietary, 3D-Torus

9.       Other information: run in co-processor mode so only 1 core used per node

 

Created Nov. 9, 2008. John Michalakes, NCAR.  michalak@ucar.edu

Updated May 8, 2009 to add Power 6 and Nehalem plots.

Updated May 18, 2009 to add Ranger plots.