Hardware Overview

The hardware operated by FSU's shared-HPC reflects the diverse research taking place on our campus. Leading-edge computing systems are bound together by common high-speed networks, a pair of large-scale parallel data storage systems, and a common user authentication mechanism.  The computing systems managed by HPC can be grouped into the following categories.

The constituent components of the HPC hardware categories are listed below.

Infiniband Connected Cluster

  • Processor Cores: 5248
  • Total Memory: 12.3 TeraBytes
  • Aggregate Peak Performance: 49.5 TeraFlops
  • Job Manager/Scheduler: MOAB/Torque
56 Compute nodes [Dell PowerEdge R815 servers]
Quad, 48-core 6174 2.2 GHz Opterons, 2.7 GB per core
Total of 2688 cores
Mellanox ConnectX IB Cards
128 Compute Nodes [ Dell PowerEdge SC 1435 Rev B servers]
Dual, Quad-Core 2356 2.3 GHz Opteron, 2 GB RAM per core
Total of 1024 Cores
Mellanox ConnectX IB Cards
128 Compute Nodes [ Dell PowerEdge SC 1435 Rev B servers]
Dual, Quad-Core 2382 2.6 GHz Opteron, 2 GB RAM per core
Total of 1024 Cores
Mellanox ConnectX IB Cards
128 Compute nodes [Dell PowerEdge SC1435 servers]
Dual, Dual-Core 2220 2.8 GHz Opterons, 2 GB RAM per core
Total of 512 Cores
Mellanox Cheetah IB Cards

 

Large Shared Memory Systems

  • Processor Cores: 1240
  • Total Memory:  8.5 TeraBytes
  • Aggregate Peak Performance: 13.1 TeraFlops
  • Job Manager/Scheduler: MOAB/Torque
4 3Leaf SMP system (Coming soon)
16 compute nodes which can be configured into 1 to 16 virtual SMP machines
Total of 1.5 TB of memory and 192 cores (AMD 8439 2.8 GHz Opterons)
The system has a dedicated QDR switch and each node utilizes a dual QDR connection
1 3Leaf SMP system (Coming soon)
16 compute nodes which can be configured into 1 to 16 virtual SMP machines
Total of 1.5 TB of memory and 192 cores (AMD 8425 2.1 GHz Opterons)
The system has a dedicated QDR switch and each node utilizes a dual QDR connection
1 3Leaf SMP system
12 compute nodes which can be configured into 1 to 12 virtual SMP machines
Total of 576 GB of memory and 144 cores
The system has a dedicated QDR switch and each node utilizes a dual QDR connection
1 Blade Chassis [ Dell PowerEdge M1000e ]
12-M605 Blades with 2, Quad-Core 2382 2.6 GHz Opteron, 2 GB RAM per core
2-M905 Blades with 4, Quad-Core 8382 2.6 GHz Opteron, 4 GB RAM per core
Total of 128 Cores
Mellanox DDR IB Cards

 

Interactive Computing and Remote Visualization

  • Processor Cores: 296 (CPUs)
  • Total Memory: 1.7 TeraBytes
  • gpGPU cores: 7168
  • Aggregate Peak Performance: 11.4 TeraFlops (CPU +GPUs)
  • Job Manager/Scheduler: Homemade
2 Compute Chassis [Dell PowerEdge C6105 servers]
4 nodes per chassis
Dual, 6-Core 4184 2.8 GHz Opterons, 8 GB RAM per core
QDR IB + 10 Gbps
3 Compute Chassis [Dell PowerEdge C6105 servers]
4 systems per chassis
Dual, 6-Core 4184 2.8 GHz Opterons, 4 GB RAM per core
QDR IB + 10 Gbps
2 Compute Nodes [Dell PowerEdge R815 servers]
Quad, 6-Core 6140 2.6 GHz Opterons, 8 GB RAM per core
QDR IB + 10 Gbps
1 Compute Nodes [Dell T7500 Tower]
Dual, 4-Core Intel 5570 2.9 GHz, 12 GB RAM per core
QDR IB + 10 Gbps
1 gpGPU PCI Chassis [Dell C410X]
16, NVidia Tesla M2050, total of pgGPU processor cores

 

Condor Cluster

  • Processor Cores: 720
  • Total Memory: 2 to 8 GB per processor Core
  • Aggregate Peak Performance: TBD
  • Job Manager/Scheduler: Condor

Science Portals and Databases

  • Processor Cores: Expandable
  • Total Memory:  Expandable

 

Common Data Storage Systems

Panasas Parallel Storage
  • 14 storage shelves with a total of 210 TB of raw disk space
  • 172 TB usable storage in a RAID-6 like configuration
Lustre Parallel Secondary Storage

 

Job Submission and Administrative Nodes

1 Admin Node [Dell PowerEdge 2970 server]
Dual, Quad-Core Opteron 2356, 2.3 GHz,  16 GB RAM
1 Virtualization Node for services like Moab and Torque [Dell PowerEdge R905 server]
Quad, Quad-Core Opteron 8356, 2.3 GHz, 32 GB RAM
3 Login nodes, [Dell PowerEdge 2970 severs]
Dual, Quad-Core 2387 2.8 GHz Opterons, 16 GB ram
3 Login nodes [Dell PowerEdge 2970 servers]
Dual, Quad-Core 2382, 2.6 GHz, 16 and 32 GB ram
4 Login nodes [Dell PowerEdge 2970 servers]
Dual, Quad-Core 2356, 2.3 GHz, 16 GB ram
3 Login nodes [Dell PowerEdge R415 servers]
Dual, 6-Core 4174, 2.3 GHz, 16 GB ram

 

Networking

  • CISCO 6509e Chassis for Storage Fabric (IP)
  • CISCO 6509e Chassis for Storage Fabirc and WAN access via Dual redundant 10 GBE for Uplink to campus
  • QLogic QDR 12300 switch for MPI communication for the R815 compute nodes purchased in 2010
  • CISCO 7024 Infiniband 288-port Chassis for MPI communication for the nodes purchased in 2008 and 2009.
  • Qlogic QDR 12300 (1) and 12200 (5) stack for the the Dual-Core 2220 2.8 GHz Opterons nodes purchased in 2007