Groups and Permissions

By | | No Comments

Linux Set GID

Using Set GID (SGID) on a directory will force all files created in that directory to inherit the same group permissions as the parent directory even if the user creating them primary or effective group is different. The benefit of this combined with the creation of a group on shared systems is that all files will be created owned and accessible (by default) to members of that group

#list available group
groups
chgrp <groupname> folder
chmod g+s folder

Windows AD Groups

Please keep mind that both NFS and CIFS volumes for Locker require an AD group. If you need assistance in setting one up please contact your local unit support team or email us at arcts-support@umich.edu.

Globus Server Endpoint

By | | No Comments

Globus Server Endpoint

Locker can be made available on existing ARC-TS Globus servers to provide high performance transfers, data sharing and access to Locker from off campus. To access Locker via Globus, request your Locker volume be added to Globus. Locker volumes that have been mounted on Great Lakes or still mounted on Flux require a user login for those clusters to access the volume via Globus. Users can request logins via these links:

Great Lakes

Flux

Users can also create their own dedicated endpoints for their Locker volume. To do sp please use this link as a resources:

https://docs.globus.org/globus-connect-server/v4/

Once an endpoint has been established please email us so we can add it to our Globus subscription.

Getting Started

By | | No Comments

Locker can be accessed from any ARC-TS compute service that supports the same data classifications as your export.  To have your Locker export added to an ARC-TS resource contact us with the export name and system name. Locker will be available on all login and data transfer nodes at a minimum.

Mounts will be located at
/nfs/locker/<export-name>/

Research groups may also request system group creation to control group access to Locker volumes.

Storage Resource Software

If you are unsure which of our storage services should be used to host your data, we have written some software that you can download and execute to analyze your files to understand how much of your data is stored in large files, how much of your data has been accessed recently, and the distribution of file sizes and access times. Use this tool to find file statistics and get a storage recommendation

Optional Features

Replication – (Recommended) Optional second copy of all data in a different geographic location.

Snapshots – (Highly Recommended) Tracking of how data in a volume changes over time allowing users to recover deleted, modified, or otherwise damaged data.

Access snapshots at:
<mount-location>/.snapshots/<date>

 

Requesting or Modifying a Locker Storage Volume

  • Go to Use your UMICH (Level-1) credentials and Duo two-factor authentication to login via the ITS Service Request (SRS) Portal or the ITS General Computing provision page
  • To create a volume please see our Ordering Storage Services page for detailed instructions.
  • To modify a volume:
    • Select ‘Request Service’ at the top of the screen.
    • Select ‘Modify’ for either NFS or CIFS and on the following page choose the Turbo volume you wish to modify
    • Enter in any changes you wish to make.
    • Near the bottom of the page, select ‘Next’ to move on to the next page.
    • Continue making changes on each page until you reach the ‘Review’ page.
    • After reviewing all your changes to ensure they are correct click on ‘Submit Now’ to submit the changes to your volume.
    • The changes will be sent to the ARC-TS Storage team so they can process the request. This can take up to a business day to complete. They will update you as soon as the changes have taken effect. 

SRS support

Information about the SRS and how to use it can be found throughout the SRS system. 

Here are some additional resources:

Locker Policies

By | | No Comments

Small File Limitation

Locker’s target audience are those research projects with massive data volumes in large files. Because of this design each 1 TByte of Locker capacity provides only 1 Million files.  Eg. 10 TByte provides 10 Million files. This works out to 1 Mbyte per file average size.

Sensitive Data — ePHI/HIPAA/ITAR/EAR/CUI

Locker is not currently supported for PHI or other data types.  It is scheduled to be reviewed for support at a later date.

System Abuse

Abuse of Locker intentionally or not may result in performance or access being limited to preserve performance and access for other users.  In the event this happens staff will be in contact with the users to engineer solutions.

Mounting your Locker Volume

By | | No Comments

Mounting on Windows CIFS
Instructions provided when provisioned

Mounting on Linux NFS
Instructions provided when provisioned

Mounting on Mac OSX
Instructions provided when provisioned

On the HPC clusters

If you requested for your volume to be mounted on any of the HPC clusters, Armis2, Great Lakes, or Lighthouse, you can access that volume at /nfs/locker/<volume_name>.  So when on the command line of any of those clusters, simply typing the command:

cd /nfs/locker/<volume-name>

where <volume_name> is the full name of the volume including prefix, like umms-jones, or lsa-johnson.  If you get ‘path not found’, or ‘directory not found’.  Submit a ticket to arc-support@umich.edu and we’ll resolve the issue.

 

What is Locker

By | | No Comments

What is Locker

Locker is a cost-optimized, high-capacity, large-file storage service for research data. Locker provides high-performance for large files, and allows investigators across U-M Ann Arbor to connect their data to computing resources necessary for their research, including U-M’s HPC clusters.

Locker can only be used for research data. It is designed for data that does not require frequent access, for example, data that is at the end of its useful life-cycle. It is tuned for large files (1MB or greater), and large numbers of small files should not be stored on the service without being aggregated in some fashion (as through tar). Locker can be used in combination with the Globus data management sharing system for hosting and sharing data with external collaborators and institutes.

Features

  • Locker is available to researchers from any academic unit.
  • Locker space can be purchased with a minimum of 10TB with 1TB increments thereafter
  • Locker uses the Globus File Transfer Service
  • Locker does not yet provide the option of secure storage for regulated and/or sensitive data, but it is scheduled on the roadmap.