HP High Performance Clusters LC 1000 Series Design and Configuration Guide March 2004 Part Number 359449-001 359449-001 1
Table Of Contents Titles Introduction Design and Configuration Matrix Myrinet Reference Designs Myrinet Order Worksheet GigE Reference Designs GigE Order Worksheet Fast Ethernet Reference Designs Fast Ethernet Order Worksheet DL380 and DL140 Options Software Options Storage Subsystems Storage Subsystem Options Myrinet Upgrade Worksheet GigE Upgrade Worksheet Fast Ethernet Upgrade Worksheet 359449-001 Pages 3-4 5 6-9 10 11 - 15 16 17- 21 22 23 24 25 - 29 30 31 32 33 2
Introduction Summary: The LC 1000 Series Design and Configuration Guide provides an easy and flexible way to design High Performance Computing (HPC) clusters. It is easy to design an HPC cluster with this guide because everything needed for the cluster is specified through Reference Designs.
Software Options: Software options such as operating system media and licenses are available. Please refer to the LC 1000 Series Software Options worksheet for part numbers and quantities. The operating system options available with the LC 1000 Series Clusters include Red Hat 3 one year and three year licenses, SLES 8 one year and three year licenses, and Microsoft Windows Server 2003. Separate part numbers are provided for Control and Compute nodes.
LC 1000 Series Design and Configuration Matrix Select Cluster Interconnect Network # of Compute Nodes 1 - 32 Result Maximum Reference Future Design Expansion 32 16 Node Myrinet 1 - 64 64 32 Node Myrinet 29 - 128 128 64 Node Myrinet 1 - 22 1 - 36 22 36 16 Node GigE 24 Node GigE 1 - 64 64 32 Node GigE 29 - 128 128 64 Node GigE 1 - 22 1 - 36 1 - 32 22 36 72 16 Node FE 24 Node FE 32 Node FE 33 - 192 192 64 Node FE Myrinet GigE Fast Ethernet 359449-001 Reference Parts List Pages 1 -
359449-001 LC 1000 Series 16 Node Myrinet DL140 Cluster Reference Design Myrinet (expandable to 32 nodes) Rack 1 DL140 Compute Node DL140 Compute Node DL380 Control Node Part Numbers Myr NIC1 NIC2 Serial ATA 2 ATA 1 Myr NIC1 NIC2 Serial ATA 2 ATA 1 iLO NIC2 NIC1 Serial SCSI 2 SCSI 1 325733-888 359578-B21 Public LAN 333705-XXX 333704-XXX 310587-XXX 349201-XXX SW1 Myricom w/Myrinet Line Cards (Cluster Interconnect Switch) SW2 ProCurve 2848 10/100/1000 (IB Management Switch) Notes: 1.
359449-001 LC 1000 Series 32 Node Myrinet DL140 Cluster Reference Design Notes: 1. # represents the number of compute nodes. 2. Please refer to the server options table for adding processors, memory, disks, network adapters, ...
Myrinet (expandable to 128 nodes) Rack 1 Rack 3 Rack 2 Rack 4 DL140 Compute Node SW2 ProCurve 2848 10/100/1000 (IB Management Switch) SW1 ProCurve 2848 10/100/1000 (IB Management Switch) SW3 Cyclades (OOB Management Switch) SW2 Cyclades (OOB Management Switch) 4x 4x Optional Storage Solution 8 S 40 S 39 S 38 S 37 S 36 S 35 S 34 S 33 S 32 S 31 S 30 S 29 S 28 S 27 S 26 S 25 S 24 S 23 S 22 S 21 SW 2 SW 1 S 20 S 19 S 18 S 17 S 16 S 15 S 14 S 13 S 12 S 11 S 10 S 9 S 8 S 7 S 6 S 5 S 4 S 3 S 2 S 1 Exp
359449-001 LC 1000 Series 64 Node Myrinet DL140 Cluster Reference Design Notes: 1. # represents the number of compute nodes. 2. Please refer to the server options table for adding processors, memory, disks, network adapters, ...
LC 1000 Series Myrinet DL140 Cluster Order Worksheet Note: Please make multiple copies for future use.
359449-001 LC 1000 Series 16 Node GigE DL140 Cluster Reference Design GigE (expandable to 22 nodes) Rack 1 DL140 Compute Node DL140 Compute Node DL380 Control Node NIC1 NIC2 Serial ATA 2 ATA 1 NIC1 NIC2 Serial ATA 2 ATA 1 iLO NIC2 NIC1 Serial SCSI 2 SCSI 1 LC 1000 Series Parts List GigE 1 - 22 Nodes (22 Node Max) Quantity 1 1 Quantity 245161-B22 221546-YYY 169989-001 Factory Integration Level 4 Factory Integration Configuration Resource Kit DL380G3 Control Node DL380G3 1P-3.
359449-001 LC 1000 Series 24 Node GigE DL140 Cluster Reference Design Notes: 1. # represents the number of compute nodes. 2. Please refer to the server options table for adding processors, memory, disks, network adapters, ...
359449-001 LC 1000 Series 32 Node GigE DL140 Cluster Reference Design Notes: 1. # represents the number of compute nodes. 2. Please refer to the server options table for adding processors, memory, disks, network adapters, ...
359449-001 LC 1000 Series 64 Node GigE DL140 Cluster Reference Design GigE (expandable to 128 nodes) Rack 1 Rack 2 Rack 4 Rack 3 DL140 Compute Node NIC1 NIC2 Serial ATA 2 ATA 1 SW2 Cyclades (OOB Management Switch) SW2 ProCurve 2848 10/100/1000 (IB Management Switch) SW3 Cyclades (OOB Management Switch) SW1 ProCurve 2848 10/100/1000 (IB Management Switch) SW2 Cyclades (OOB Management Switch) 4x 4x 4x Optional Storage Solution 14 U NIC1 NIC2 Serial ATA 2 ATA 1 NIC1 NIC2 Serial ATA 2 ATA 1 N
359449-001 LC 1000 Series 64 Node GigE DL140 Cluster Reference Design Notes: 1. # represents the number of compute nodes. 2. Please refer to the server options table for adding processors, memory, disks, network adapters, ... Part Numbers 245161-B22 221546-YYY 169989-001 Factory Integration Level 4 Factory Integration Configuration Resource Kit DL380G3 Control Node DL380G3 1P-3.2GHz 1MB Cache 533MHz FSB, 2X512MB RAM DL380G3 1P-3.06GHz 1MB Cache 533MHz FSB, 2X512MB RAM DL380G3 1P-3.
LC 1000 Series GigE DL140 Cluster Order Worksheet Note: Please make multiple copies for future use.
359449-001 LC 1000 Series 16 Node Fast Ethernet DL140 Cluster Reference Design Fast Ethernet (expandable to 22 nodes) Rack 1 DL140 Compute Node DL140 Compute Node DL380 Control Node NIC1 NIC2 Serial ATA 2 ATA 1 NIC1 NIC2 Serial ATA 2 ATA 1 iLO NIC2 NIC1 Serial SCSI 2 SCSI 1 Public LAN SW2 Cyclades (OOB Management Switch) Optional Storage Solution 17 U Part Numbers 245161-B22 221546-YYY 169989-001 252663-ZZZ Modular PDU, 24A (US) or 32A (EMEA), High Voltage 246099-B21 246107-B21 248929-B21 Si
359449-001 LC 1000 Series 24 Node Fast Ethernet DL140 Cluster Reference Design Fast Ethernet (expandable to 36 nodes) Notes: 1. # represents the number of compute nodes. 2. Please refer to the server options table for adding processors, memory, disks, network adapters, ...
359449-001 LC 1000 Series 32 Node Fast Ethernet DL140 Cluster Reference Design Notes: 1. # represents the number of compute nodes. 2. Please refer to the server options table for adding processors, memory, disks, network adapters, ...
Fast Ethernet (expandable to 192 nodes) Rack 1 Rack 2 Rack 5 Rack 3 SW2 Cyclades (OOB Management Switch) SW2 ProCurve 2848 10/100/1000 (IB Management Switch) SW3 Cyclades (OOB Management Switch) SW1 ProCurve 2650 10/100 (IB Management Switch) SW1 ProCurve 2650 10/100 (IB Management Switch) SW2 Cyclades (OOB Management Switch) 2x 2x Rack 4 2x 2x Optional Storage Solution 20 U NIC1 NIC2 Serial ATA 2 ATA 1 NIC1 NIC2 Serial ATA 2 ATA 1 NIC1 NIC2 Serial ATA 2 ATA 1 NIC1 NIC2 Serial ATA 2 ATA
359449-001 LC 1000 Series 64 Node Fast Ethernet DL140 Cluster Reference Design Notes: 1. # represents the number of compute nodes. 2. Please refer to the server options table for adding processors, memory, disks, network adapters, ... Part Numbers LC 1000 Series Parts List Fast Ethernet Factory Integration 325733-888 Level 4 Factory Integration 359578-B21 Configuration Resource Kit DL380G3 Control Node 333705-XXX DL380G3 1P-3.2GHz 1MB Cache 533MHz FSB, 2X512MB RAM 333704-XXX DL380G3 1P-3.
LC 1000 Series Fast Ethernet DL140 Cluster Order Worksheet Note: Please make multiple copies for future use.
LC 1000 Series DL380 and DL140 Options Note: Please make multiple copies for future use. Part Numbers 293048-B21 313054-B21 333714-B21 333713-B21 257916-B21 257915-B21 300678-B21 300679-B21 300680-B21 300682-B21 286713-B22 286714-B22 286716-B22 286775-B22 286776-B22 286778-B22 313881-B21 290563-B21 263825-B21 349043-B21 359047-B21 351109-B21 351108-B21 349046-B21 278424-B21 290563-B21 359449-001 LC 1000 Series Parts List Options DL380G3 Control Node Fan Kit Hot Plug Redundant Power Supply 1P-3.
LC 1000 Series Software Options Note: 1. # represents the number of compute nodes. 2. Please make multiple copies for future use.
LC 1000 Series Fibre Channel GFS (16 node - 48 TB) DL380 Storage Node DL380 Storage Node FC 2214 iLO NIC2 NIC1 Serial SCSI 2 SCSI 1 FC 2214 iLO NIC2 NIC1 Serial SCSI 2 SCSI 1 ProCurve 2848 10/100/1000 16 Storage Nodes SAN Switch 2/32 MSA1000 MSA1000 2 TB 2 TB MSA30 MSA30 2 TB 2 TB MSA30 MSA30 2 TB 8 MSA1000s 16 MSA30s 2 TB Storage Nodes Cluster Connection Empty 42 Empty 41 Empty 40 Empty 39 Empty 38 Empty 37 Empty 36 Empty 35 34 ProCurve 2848 33 FC SW 32 DL380 31 Storage Node 30 DL38
LC 1000 Series Fibre Channel GFS (8 node - 24 TB) DL380 Storage Node DL380 Storage Node FC 2214 iLO NIC2 NIC1 Serial SCSI 2 SCSI 1 FC 2214 iLO NIC2 NIC1 Serial SCSI 2 SCSI 1 ProCurve 2824 10/100/1000 8 Storage Nodes SAN Switch 2/16 MSA1000 MSA1000 2 TB 2 TB MSA30 MSA30 2 TB 2 TB MSA30 MSA30 2 TB 4 MSA1000s 8 MSA30s 2 TB Storage Nodes Cluster Connection Empty 42 Empty 41 Empty 40 Empty 39 Empty 38 Empty 37 Empty 36 Empty 35 Empty 34 Empty 33 Empty 32 Empty 31 Empty 30 Empty 29 Empty 2
LC 1000 Series Fibre Channel GFS (4 node - 12 TB) DL380 Storage Node DL380 Storage Node FC 2214 iLO NIC2 NIC1 Serial SCSI 2 SCSI 1 FC 2214 iLO NIC2 NIC1 Serial SCSI 2 SCSI 1 ProCurve 2824 10/100/1000 4 Storage Nodes SAN Switch 2/8 MSA1000 1 MSA1000 w/Embedded SAN Switch 2/8 2 TB 2 TB 1 MSA1000 MSA30 MSA30 MSA1000 2 TB 2 TB MSA30 MSA30 2 TB 2 TB 4 MSA30s Storage Nodes Cluster Connection Note: Please refer to the storage subsystem options table for adding processors, memory, disks, ne
LC 1000 Series SCSI High Availability NFS 2TB MSA1000 1 MSA1000 w/Embedded SAN Switch 2/8 2 TB MSA30 2 TB SA 5i+ iLO NIC2 NIC1 Serial SCSI 2 SCSI 1 SA 5i+ iLO NIC2 NIC1 Serial SCSI 2 SCSI 1 FC 2214 iLO NIC2 NIC1 Serial SCSI 2 SCSI 1 FC 2214 iLO NIC2 NIC1 Serial SCSI 2 SCSI 1 DL380 Storage Node DL380 Storage Node 2 Storage Nodes SAN Switch 2/8 DL380 Storage Node DL380 Storage Node DL380 Storage Node DL380 Storage Node 359449-001 LC 1000 Series Fibre Channel GFS (2 node - 6 TB) 2 MSA30s 14
LC 1000 Series SCSI NFS 8TB DL380 Storage Node DL380 Storage Node 359449-001 LC 1000 Series SCSI NFS 4TB 6404 iLO NIC2 NIC1 Serial SCSI 2 SCSI 1 6404 iLO NIC2 NIC1 Serial SCSI 2 SCSI 1 36GB DL380 2 TB Storage Node MSA30 2 TB 4454 2 TBMSA30 2 TB MSA30 DL380 2 TB Storage Node 2 TB 8U 1 Storage Node 2 MSA30 MSA30 2 TB MSA30 2 TB MSA30 MSA30 2 TB 2 TB MSA30 MSA30 2 TB 2 TB 14U MSA30 2 TB MSA30 2 TB MSA30 2 TB 1 Storage Node 4 MSA30 Storage Node Storage Node Cluster Connection Cluste
LC 1000 Series Storage Subsystem Options Note: Please make multiple copies for future use. Part Numbers 263825-B21 293048-B21 333714-B21 333713-B21 257916-B21 257915-B21 300678-B21 300679-B21 300680-B21 300682-B21 313054-B21 286713-B22 286714-B22 286716-B22 286775-B22 286776-B22 286778-B22 153506-B21 254786-B21 245161-B22 221546-YYY 169989-001 252663-ZZZ 246099-B21 246107-B21 248929-B21 253214-B21 Storage Subsystem Options Order DL380G3 iLO Advanced Pack ALL Fan Kit 1P-3.
LC 1000 Series Myrinet DL140 Cluster Upgrade Worksheet Note: Please make multiple copies for future use.
LC 1000 Series GigE DL140 Cluster Upgrade Worksheet Note: Please make multiple copies for future use.
LC 1000 Series Fast Ethernet DL140 Cluster Upgrade Worksheet Note: Please make multiple copies for future use.
