IBM Blue Gene/P - JUGENE

JUGENE - Hardware Characteristics

  • 72 racks (9x8) - 73728 nodes (294912 cores)
    • Rack: 2 midplanes a 16 nodeboards (4096 cores)
    • 2304 Nodeboards a 32 compute nodes (128 cores)
  • Overall peak performance: 1 Petaflops
  • Linpack: 825.5 Teraflops
  • Main memory: 144 TB
  • I/O Nodes: 600 (Connected to FORCE10 Switch)
  • Compute Card/Processor:
    • Power PC 450, 32-bit, 850 MHz, 4-way SMP
    • L3 Cache: shared, 8 MB
    • Main Memory: 2 GB, 13.6 GB/s bandwidth
    • Peak performance: 13.6 GFlops
  • Networks:
    • Three-dimensonal torus (compute nodes),
      bandwidth per link: 425 MB/s (total: 5.1 GB/s), hardware latency: 100ns - 800ns
    • Global tree and collective (compute nodes, I/O nodes),
      bandwidth per link: 850 MB/s (total 1.7 GB/s)
    • Barrier low latency and interrupt network
    • External: 10 GigE / Functional network (I/O Nodes)

Network Switches

  • 4 Force 10 E1200i Switches
  • Total ports: 896

Infrastructure Nodes

  • 2 Service nodes IBM p6 550:
    • Total number of processors: 8
    • Processortype: Power6 4.2 GHz
    • Total amount of memory: 128 GB
    • Operating System: SuSE Linux Enterprise (SLES 10)

  • 2 Login nodes IBM p6 550:
    • Total number of processors: 8
    • Processortype: Power6 4.2 GHz
    • Total amount of memory: 32 GB
    • Operating System: SuSE Linux Enterprise (SLES 10)
    • Internet address: jugene.fz-juelich.de

Position in Top 500 - History

  • June 2009: 3 (Europe: 1) June 2010: 5 (Europe: 1)
  • Nov. 2009: 4 (Europe: 1) Nov. 2010: 9 (Europe: 2)

Environment

  • Power Consumption: max. 35 kW per rack (total 2.2 - 2.5 MW) + 20% for cooling
  • Average application: 23.9 KW, idle 9.9 KW
  • Power cables: 72 x 35m, three-phase, 125A, total 2.5 km
  • Foot print: 130 m², incl. service area: 160 m² (240 tiles with 576 holes)
  • Weight per rack: 770-900 kg
  • Cables: 4352 datacables (23 km copper), 288 x 1GigE cables (7.5 km copper),
    600 x 10GigE cables (21 km fibre optics), total ca. 50 km
  • Air Cooling: 60.000 m³/h, temperature: 16°C, fans per rack: 69 (total 4968)
  • Water Cooling: 300m tubes, ca. 360 m³/h,
    temperature: max. 17°C inlet, 24-27°C outlet,
    use warm water to generate inlet temperature from 6°C cold water of cold water supply
  • Noise: 85 - 105 dB
========================================================

The IBM Blue Gene/P is available for selected projects which run massively parallel application codes scaling up to several thousands of processors.

Projects/applications that may be selected must meet the demands described in

Further information about allocation of computing time and how to get an account can be found at

For more system specific information refer to publications and JSC documentation about


last change 01.02.2011 | | Print