Child pages
  • HPRC Infrastructure History
Skip to end of metadata
Go to start of metadata

Network Interconnect

QtySwitch model05060708091011121314151617181920212223
5Nortel 55101Gb











2SMC 8848M





1Gb






2Voltaire 4036





40Gb






1Edge-corE 4610







1Gb





1Mellanox SX6036








40/56Gb





2Mellanox SX6036










40/56Gb





3Ubiquiti EL48s











1Gb
1HPE FF5950











25/100Gb



1Juniper EX4650












25/100Gb
2Juniper EX4300













1Gb
1Juniper QFX5100













10Gb
1Juniper EX4650














10/25Gb

Storage Interconnect

QtySwitch model000102030405060708091011121314151617181920212223
5?2Gb















2Brocade ?




4/8Gb









2Brocade 6510












8/16Gb

Storage Platforms (HPC filesystems)

Storage000102030405060708091011121314151617181920212223
SGI TP91002.5TB (54)















SUN FLX380




6.2TB (28)















Compellent*







8.4TB

32.8TB











SGI IS5000










48TB (24)






SGI IS5000










120TB (60)






SGI IS5500












540TB (180)




DDN SFA12K40













2240TB (12+560)



DELL SC4020















1070TB (14+160)
DDN SFA7990E


















768TB (12+64)

The DDN SFA700E was purchased to provide a local (medici) caching service to nationally significant research (RDSI) data - held in full only at QCIF(Bne).  Around 1.5PiB of data was moved from RDSI storage onto the medici platform in 2019/2020.

Tape Libraries (near-line storage for HSM)


000102030405060708091011121314151617181920212223
StorageTek L1804xDLT44xLTO2















SUN SL500






4xLTO4 - 189 tapes











SpectraLogic T950










8xLTO5 - 600 tapes






Servers

 Cray (1992 – 1994)

Supercomputing came to JCU with the arrival of a CRAY EL-92 system.
The details of this system (long since decommissioned) aren't known.

 IBM (1994 – 1997)

Handwritten notes appear to indicate that an IBM RS6000 system (grunter) was installed in 1994.
The details of this system (long since decommissioned) aren't known.

 SGI (1997 – 2002)

An SGI PowerChallenge (octopus) system was installed in 1997.  The details of this system (long since decommissioned) aren't fully known. The information below comes from an archive of an old HPC web page. Given the name of this system, it is likely that it was purchased with only 8 CPUs and was later upgraded to 16 CPUs.

Component

Available Details

CPUs

16x(MIPS R10000 195MHz)

ECC memory

4GB

SCSI disks

6x(4.3GB), 10x(9GB), 3x(18GB)

Networking

100Mb/s (FDDI and ethernet)

 SGI (2000 – 2005)

An SGI Origin 3200 (hydra) system was installed in 2000.  An SGI 1200 server was also installed for administration of the Origin 3200 (reused, later, for Altix 350).
The details of the SGI Origin system (long since decommissioned) aren't fully known. The information below comes from archives of old HPC web pages and some from human memory. Several upgrades were made to FC storage capacity and the TP9100 also used for ITR mail and web services storage. Near the end of it's life hydra likely presented out closer to 2TB of FC storage.


Initial

2002 Upgrade

CPUs

16x(MIPS R14000 500MHz)

16x(MIPS R14000 500MHz)

CPUs

4x(MIPS R12000 400MHz)

68x(MIPS R12000 400MHz)

ECC memory

10GB

42GB

SCSI storage

2x(18GB), RAID-1

2x(18GB), RAID-1

FC storage

1.1TB from TP9100

1.1TB from TP9100

Networking

2x(1Gb/s)

2x(1Gb/s)

FC HBAs

2x(1Gb/s)

2x(1Gb/s)

 SGI (2005 – 2008)

An SGI Altix 350 (dmf) was installed in 2005 to serve as a NAS+HSM server for the HPC compute cluster.  The details of this system aren't fully known. The information below comes from packing slips and human memory. I believe this system was upgraded at some stage in its life, but haven't found any documentation associated with an upgrade yet.

CPUs

2x(Itanium2 1.5GHz)

ECC memory

8GB

SCSI storage

2x(146GB 10000 RPM), RAID-1

FC storage

4.5TB from FLX380

Networking

4x(1Gb/s)

FC HBAs

2x(2Gb/s)

 SGI (2005 – 2011)

The first cluster configured for JCU researcher use consisted of 75 SUN V20z servers, 3 SUN V40z servers, and 1 DELL PowerEdge 2850 server.  The latter was used to host APAC National Grid VMs.  A reconfiguration of V20z and V40z servers was performed in 2010 to double the memory per core ratio.

Original Server Builds


V20z(s)V40z(s)DELL 2850
CPUs2x(2.6GHz AMD Opeteron 252)2x(2.4GHz AMD Opteron 852)2x(2.8GHz Intel Xeon)
RAM4GB (400MHz)4GB (333MHz)4GB (400MHz)
Disks2x(73GB, 10K RPM), RAID-12x(73GB, 10K RPM), RAID-12x(146GB, 10K RPM), RAID-1
Networking2x1Gb/s4x1Gb/s4x1Gb/s
FC HBAs
2x1Gb/s
 SGI (2008 -- 2011)

An SGI Altix 450 (dmf1) was installed as a NAS+HSM server for the new HPC cluster, which consisted of 33 SUN X2200M2 servers (C1), 2 SUN X2200M2 servers (C2), and 3 SUN X4600M2 servers.  A second Altix 450 (dmf2) was purchased in 2009 so that a highly available NAS+HSM service could be configured (by SGI professional services staff).  In 2010, the memory in X2200M2 and X4600M2 servers saw a doubling of installed RAM.

Original Server Builds


Compute nodesLogin nodesBig memory nodes
33 x X2200M22 x X2200MX4600M2Altix 450
CPUs2x(2.3GHz quad-core AMD Opteron 2356)8x(2.8GHz dual-core AMD Opteron 8220)4x(1.6GHz dual-core Itanium 9140M)
RAM8GB (667MHz)32GB (667MHz)32GB (667MHz)
Disks1x(250GB, 7200RPM)2x(146GB, 15K RPM)2x(146GB, 15K RPM)2x(300GB 15000RPM), RAID-1
Networking4x1Gb/s4x1Gb/s10x1Gb/s
FC HBAs


4x4Gb/s
 SGI (2011--2018)



Admin node(s)

1 x SGI C2108

Login node(s)

1 x SGI C2108

Compute node(s)

32 x SGI C2112

Memory node(s)

2 x SGI C2108

Project node(s)

4 x SGI C2108

NAS server(s)

2 x SGI C3106

CPU modelAMD OpteronIntel
CPU cores12 x 2.3GHz24 x 2.3GHz24 x 2.3GHz48 x 2.3GHz32 x 3.0GHz
RAM16GB64GB64GB256GB256GB
Disks2x(1TB, 7200 RPM)8x(300GB, 15K RPM)2x(1TB, 7200 RPM)2x(1TB, 7200 RPM)2x(1TB, 7200 RPM)
Networking4x1Gb/s, 1x40Gb/s(IB)4x1Gb/s, 1x40Gb/s(IB)2x1Gb/s, 1x40Gb/s(IB)2x1Gb/s, 1x40Gb/s(IB)4x1Gb/s, 1x40Gb/s(IB)
 SGI (2013 – 2019)

RDSI Stage 1 Infrastructure 


 SGI (2014 – present)

RDSI Stage 2 Infrastructure 

 DELL (2018 – present)


Workstations

In the timeframe 2000-2005, the following workstation equipment was received and used by HPC staff and select JCU researchers.

Qty

Description

Processor(s)

Memory

Storage

Network

6

SGI O2

1x(MIPS)




2

SGI Octane

1x(195MHz MIPS R10000 - 1MB cache)




2

SGI 750

2x(733MHz Intel Itanium - 2MB L2 cache)

1GB

1x(18GB Ultra-3 SCSI)

10Mb/s

1

SUN Netra N1

1x(500MHz UltraSPARC IIe - 512KB L2 cache)

1GB

2x(40GB IDE)

100Mb/s

8

SUN Netra N1

1x(500MHz UltraSPARC IIe - 512KB L2 cache)

1GB

1x(40GB IDE)

100Mb/s

1

SUNblade 2000

2x(900MHz UltraSPARC III - 2MB L2 cache)

4GB



20

SGI 330L

2x(933MHz Intel Pentium III - 256KB L2 cache)


1x(18GB Ultra160 SCSI)


One SUN Netra N1 provided the QPSF website service. Another SUN Netra N1 provided the Tarantella service (X terminal access from a web browser and more).

  • No labels