Due to maintenance, the high-performance computing (HPC) clusters and their storage systems (/home and /scratch) will be unavailable:

  • Great Lakes: Monday, January 10, 2022, 5 a.m. – Tuesday, January 11, 2022, 2 p.m.
  • Armis2, Lighthouse: Monday, January 10, 2022, 5 a.m. – Wednesday, January 12, 2022, 5 p.m.

Copy any files you might need during the maintenance window to your local drive using Globus File Transfer.

Contact arcts-support@umich.edu if you have any questions.

Planned Updates

Great Lakes and Armis2

  • CentOS updates
  • Slurm 21.08
  • NVIDIA driver updates
  • CUDA 11.4
  • OFED updates
  • spgpu and gpu partitions updated

Lighthouse

  • CentOS updates
  • Slurm 21.08
  • NVIDIA driver updates
  • CUDA 11.3.1
  • OFED updates

Planned Changes

Bold text denotes changes

Great Lakes and Armis2

NEW version (after maintenance) OLD version (before maintenance)
CentOS 7.9
  • kernel 3.10.0-1160.45.1
  • glibc 2.17-325.el7_9
  • ucx 1.11.1-1.54303 (OFED provided)
CentOS 7.9
  • kernel 3.10.0-1160.31.1.el7
  • glibc 2.17-324.el7_9
  • ucx 1.9.0-1.51258
Mlnx-ofa_kernel-modules
  • 5.4-3.0.3.0
    • kver.3.10.0-1160.45.1
Mlnx-ofa_kernel-modules
  • 5.1-OFED.5.1.2.5.8.1
    • kver.3.10.0_1160.31.1.el7.x86_64
Slurm 21.08.4 compiles with:
  • PMIx
    • /opt/pmix/2.2.5
    • /opt/pmix/3.2.3
    • /opt/pmix/4.1.0
  • hwloc 1.11.8 (OS provided)
  • ucx 1.11.1 (OFED provided)
Slurm 20.11.8 compiles with:
  • PMIx
    • /opt/pmix/2.2.4
    • /opt/pmix/3.2.3
  • hwloc 1.11.8-4.el7 (OS provided)
  • ucx 1.9.0-1.51258 (OFED provided)
PMIx LD config /opt/pmix/2.2.5/lib LD config PMIx /opt/pmix/2.2.4/lib
PMIx versions available in /opt :
  • 1.2.5 removed
  • 2.1.3 removed
  • 2.2.4 removed
  • 2.2.5
  • 3.1.5 removed 
  • 3.2.1 removed
  • 3.2.3 
  • 4.1.0
PMIx versions available in /opt :
  • 1.2.5
  • 2.1.3
  • 2.2.4
  • 3.1.5
  • 3.2.1
  • 3.2.3
hwloc versions available in /opt:
  • No longer deployed
hwloc versions available in /opt:
  • 2.1.0
  • 2.2.0
NVIDIA driver 470.82.01

Could change to 495.x after testing. Final decision by Dec. 10th

NVIDIA driver 465.19.01
GPFS client 4.2.3.24 GPFS client 4.2.3.24
Open OnDemand 1.8.20-1.el7

Could change to 2.0.18 if the upgrade works without bugs. Final decision by Dec. 10th

Open OnDemand 1.8.20-1.el7

Lighthouse

NEW version (after maintenance) OLD version (before maintenance)
CentOS 7.9
  • kernel 3.10.0-1160.45.1
  • glibc 2.17-325.el7_9
  • ucx 1.11.1-1.49408 (OFED provided)
CentOS 7.9
  • kernel 3.10.0-1160.31.1.el7
  • glibc 2.17-324.el7_9
  • ucx-1.8.0-1.49224 (OS provided)
Mlnx-ofa_kernel-modules
  • 4.9-4.0.8.0
    • kver.3.10.0-1160.45.1
Mlnx-ofa_kernel-modules
  • 4.9-OFED.4.9.2.2.4.1
    • kver.3.10.0_1160.31.1.el7.x86_64
Slurm 21.08.4 compiles with:
  • PMIx
    • /opt/pmix/2.2.5
    • /opt/pmix/3.2.3
    • /opt/pmix/4.1.0
  • hwloc 1.11.8 (OS provided)
  • ucx 1.11.1 (OFED provided)
Slurm 20.11.8 compiles with:
  • PMIx
    • /opt/pmix/2.2.4
    • /opt/pmix/3.2.3
  • hwloc 1.11.8-4.el7 (OS provided)
  • ucx-1.8.0-1.49224 (OS provided)
PMIx LD config /opt/pmix/2.2.5/lib LD config PMIx /opt/pmix/2.2.4/lib
PMIx versions available in /opt :
  • 1.2.5 removed
  • 2.1.3 removed
  • 2.2.4 removed
  • 2.2.5
  • 3.1.5 removed 
  • 3.2.1 removed
  • 3.2.3 
  • 4.1.0
PMIx versions available in /opt :
  • 1.2.5
  • 2.1.3
  • 2.2.4
  • 3.1.5
  • 3.2.1
  • 3.2.3
hwloc versions available in /opt:
  • No longer deployed
hwloc versions available in /opt:
  • 2.1.0
  • 2.2.0
NVIDIA driver 470.82.01

Could change to 495.x after testing. Final decision by Dec. 10th

NVIDIA driver 465.19.01
GPFS client 4.2.3.24 GPFS client 4.2.3.24
Open OnDemand 1.8.20-1.el7

Could change to 2.0.18 if the upgrade works without bugs. Final decision by Dec. 10th

Open OnDemand 1.8.20-1.el7