Hardware

Computing

The Beta hardware is a subset of the hardware currently used in Flux.

Networking

The compute nodes are all interconnected with InfiniBand networking. In addition to the InfiniBand networking, there is a gigabit Ethernet network that also connects all of the nodes. This is used for node management and NFS file system access.

Storage

The high-speed scratch file system is based on Lustre v2.5 and is a DDN SFA10000 backed by the hardware described in this table, the same that is used in Flux:

Server Type Network Connection Disk Capacity (raw/usable)
Dell R610 40Gbps InfiniBand 520 TB / 379 TB
Dell R610 40Gbps InfiniBand 530 TB / 386 TB
Dell R610 40Gbps InfiniBand 530 TB / 386 TB
Dell R610 40Gbps InfiniBand 520 TB / 379 TB
Totals 160 Gbps 2100 TB / 1530 TB

Operation

Computing jobs on Beta are managed completely through Slurm.  See the Beta User Guide for directions on how to submit and manage jobs.

Software

There are three layers of software on Beta.

Operating Software

The Beta cluster runs CentOS 7. We update the operating system on Beta as CentOS releases new versions and our library of third-party applications offers support. Due to the need to support several types of drivers (AFS and Lustre file system drivers, InfiniBand network drivers and NVIDIA GPU drivers) and dozens of third party applications, we are cautious in upgrading and can lag CentOS’s releases by months.

Compilers and Parallel and Scientific Libraries

Beta supports the Gnu Compiler Collection, the Intel Compilers, and the PGI Compilers for C and Fortran. The Beta cluster’s parallel library is OpenMPI, and the default versions are 1.10.7 (i686) and 3.1.2 (x86_64), and there are limited earlier versions available.  Beta provides the Intel Math Kernel Library (MKL) set of high-performance mathematical libraries. Other common scientific libraries are compiled from source and include HDF5, NetCDF, FFTW3, Boost, and others.

Please contact us if you have questions about the availability of, or support for, any other compilers or libraries.

Application Software

Beta supports a wide range of application software. We license common engineering simulation software, for example, Ansys, Abaqus, VASP, and we compile other for use on Beta, for example, OpenFOAM and Abinit. We also have software for statistics, mathematics, debugging and profiling, etc. Please contact us if you wish to inquire about the current availability of a particular application.

GPUs

Beta has eight K20x GPUs on one node for testing GPU workloads under Slurm.

GPU Model NVidia K20X
Number and Type of GPU one Kepler GK110
Peak double precision floating point perf. 1.31 Tflops
Peak single precision floating point perf. 3.95 Tflops
Memory bandwidth (ECC off) 250 GB/sec
Memory size (GDDR5) 6 GB
CUDA cores 2688

If you have questions, please send email to arcts-support@umich.edu.

Getting Access

Beta is intended for small scale testing to convert Torque/PBS scripts to Slurm. No sensitive data of any type should be used on Beta.

To Request

Fill out the HPC account request form.

Because this is a test platform, there is no cost for using Beta.

Related Event

August 2 @ 10:00 am - 1:00 pm

Android Application Development: Introduction to Android Studio

Mobile app development is one of the biggest new industries of the last decade. If you are developing an Android app for the first time, the first option you will…

August 3 @ 10:00 am - 12:00 pm

Object Detection using Deep Learning with TorchVision

Like many image processing problems, deep learning has brought many effective solutions to the task of object detection. The TorchVision library is part of the PyTorch project, and it offers…

August 5 @ 2:00 pm - 3:30 pm

R Short Course: Programming Tools (Part 3)

This is part 3 of a 5-part workshop series on programming in R.  This week, we’ll discuss the following programming tools: logical comparisons, conditionals, iteration, and functions. You’ll learn how…

August 9 @ 6:00 am - August 11 @ 5:00 pm

Great Lakes Summer 2021 Maintenance

Due to maintenance, the Great Lakes cluster and storage systems (/home and /scratch) will be unavailable Monday, August 9, 2021, 6 a.m. – Wednesday, August 11, 2021 5 p.m. Copy…