Due to maintenance, the high-performance computing (HPC) clusters and their storage systems (/home and /scratch) will be unavailable:

  • Great Lakes: Monday, January 10, 2022, 5 a.m. – Tuesday, January 11, 2022, 2 p.m.
  • Armis2, Lighthouse: Monday, January 10, 2022, 5 a.m. – Wednesday, January 12, 2022, 5 p.m.
  • Turbo, Locker, Data Den:  Monday, January 10, 2022, 6:30 am – 8:00 am
  • Globus:  Thursday, January 13, 2022, 8:00 am – 12:00 pm

Copy any files you might need during the maintenance window to your local drive using Globus File Transfer.

Contact arc-support@umich.edu if you have any questions.

Updates

Great Lakes and Armis2

  • CentOS updates
  • Slurm 21.08
  • NVIDIA driver updates
  • OFED updates
  • spgpu and gpu partitions updated

Lighthouse

  • CentOS updates
  • Slurm 21.08
  • NVIDIA driver updates
  • OFED updates

Changes

Bold text denotes changes

Great Lakes and Armis2

NEW version (after maintenance) OLD version (before maintenance)
CentOS 7.9
  • kernel 3.10.0-1160.45.1
  • glibc 2.17-325.el7_9
  • ucx 1.11.1-1.54303 (OFED provided)
 CentOS 7.9
  • kernel 3.10.0-1160.31.1.el7
  • glibc 2.17-324.el7_9
  • ucx 1.9.0-1.51258
Mlnx-ofa_kernel-modules
  • 5.4-3.0.3.0
    • kver.3.10.0-1160.45.1
 Mlnx-ofa_kernel-modules
  • 5.1-OFED.5.1.2.5.8.1
    • kver.3.10.0_1160.31.1.el7.x86_64
Slurm 21.08.4 compiles with:
  • PMIx
    • /opt/pmix/2.2.5
    • /opt/pmix/3.2.3
    • /opt/pmix/4.1.0
  • hwloc 1.11.8 (OS provided)
  • ucx 1.11.1 (OFED provided)
 Slurm 20.11.8 compiles with:
  • PMIx
    • /opt/pmix/2.2.4
    • /opt/pmix/3.2.3
  • hwloc 1.11.8-4.el7 (OS provided)
  • ucx 1.9.0-1.51258 (OFED provided)
PMIx LD config /opt/pmix/2.2.5/lib LD config PMIx /opt/pmix/2.2.4/lib
PMIx versions available in /opt :
  • 1.2.5 removed
  • 2.1.3 removed
  • 2.2.4 removed
  • 2.2.5
  • 3.1.5 removed 
  • 3.2.1 removed
  • 3.2.3 
  • 4.1.0
 PMIx versions available in /opt :
  • 1.2.5
  • 2.1.3
  • 2.2.4
  • 3.1.5
  • 3.2.1
  • 3.2.3
hwloc versions available in /opt:
  • No longer deployed
 hwloc versions available in /opt:
  • 2.1.0
  • 2.2.0
NVIDIA driver 495.44 NVIDIA driver 465.19.01
GPFS client 4.2.3.24 GPFS client 4.2.3.24
Open OnDemand 2.0.20 Open OnDemand 1.8.20-1.el7

Lighthouse

NEW version (after maintenance) OLD version (before maintenance)
CentOS 7.9
  • kernel 3.10.0-1160.45.1
  • glibc 2.17-325.el7_9
  • ucx 1.11.1-1.49408 (OFED provided)
 CentOS 7.9
  • kernel 3.10.0-1160.31.1.el7
  • glibc 2.17-324.el7_9
  • ucx-1.8.0-1.49224 (OS provided)
Mlnx-ofa_kernel-modules
  • 4.9-4.0.8.0
    • kver.3.10.0-1160.45.1
 Mlnx-ofa_kernel-modules
  • 4.9-OFED.4.9.2.2.4.1
    • kver.3.10.0_1160.31.1.el7.x86_64
Slurm 21.08.4 compiles with:
  • PMIx
    • /opt/pmix/2.2.5
    • /opt/pmix/3.2.3
    • /opt/pmix/4.1.0
  • hwloc 1.11.8 (OS provided)
  • ucx 1.11.1 (OFED provided)
 Slurm 20.11.8 compiles with:
  • PMIx
    • /opt/pmix/2.2.4
    • /opt/pmix/3.2.3
  • hwloc 1.11.8-4.el7 (OS provided)
  • ucx-1.8.0-1.49224 (OS provided)
PMIx LD config /opt/pmix/2.2.5/lib LD config PMIx /opt/pmix/2.2.4/lib
PMIx versions available in /opt :
  • 1.2.5 removed
  • 2.1.3 removed
  • 2.2.4 removed
  • 2.2.5
  • 3.1.5 removed 
  • 3.2.1 removed
  • 3.2.3 
  • 4.1.0
 PMIx versions available in /opt :
  • 1.2.5
  • 2.1.3
  • 2.2.4
  • 3.1.5
  • 3.2.1
  • 3.2.3
hwloc versions available in /opt:
  • No longer deployed
 hwloc versions available in /opt:
  • 2.1.0
  • 2.2.0
NVIDIA driver 495.44 NVIDIA driver 465.19.01
GPFS client 4.2.3.24 GPFS client 4.2.3.24
Open OnDemand 2.0.20 Open OnDemand 1.8.20-1.el7

 

Turbo, Locker, Data Den

ITS Networking will be doing updates Monday morning which will make Turbo, Locker, Data Den unreachable until the maintenance work is completed.

Globus

We will be updating the OS with the newest OS patches for. the Globus Endpoints during this window. We are not changing the version of the Globus software.