Storage Overview
Storage¶
There are two shared file systems on ARIS, HOME and WORKDIR . All login and compute nodes may access same data on shared file systems.
File system overview¶
File system | Type | Env. Variable | Size | Lifetime | Backup | Quota | Description |
---|---|---|---|---|---|---|---|
/users | GPFS | $HOME | 250 TB | Project duration | NO | * | source files, input data |
/work | GPFS | $WORKDIR | 500 TB | Project duration | NO | * | short term, fast storage |
$HOME¶
Users are NOT supposed to run jobs from this filesystem because of the low performance.
In fact the emphasis on the /users file system is reliability over performance.
Store your source code and build your executables here.
The $HOME environment variable points to the personal folder /users/[username]
$WORKDIR¶
The emphasis for the /work file system is on performance rather than reliability, as a fast workspace for temporary storage.
Store large files here.
Change to this directory in your batch scripts and run jobs in this file system.
The $WORKDIR environment variable points to the personal folder /work/[username]
Quota¶
Users are restricted by file system usage quotas. Limits are set accordingly to the project request for storage resources.
*In any case, if the granted storage size should prove as insufficient please contact support, the quota may be lifted upon request.
Quota commands¶
User quotas on the file systems can be checked with mmlsquota
command
$ mmlsquota --block-size 1G
Block Limits | File Limits
Filesystem type GB quota limit in_doubt grace | files quota limit in_doubt grace Remarks
gpfs0 USR 14 1000 1200 0 none | 1008 0 0 0 none
Block Limits | File Limits
Filesystem type GB quota limit in_doubt grace | files quota limit in_doubt grace Remarks
users USR 27 1000 1200 0 none | 110914 0 0 0 none
Check disk usage with du
command
Ex: $HOME directory
$ du -chs $HOME
File system Policy¶
IMPORTANT INFORMATION - PLEASE READ:
There is NO BACKUP done of any user data located on both the $HOME
and $WORKDIR
file systems.
The only protection of your data is the redundant disk subsystem. This RAID system is able to handle a failure of one component. There is NO way to recover inadvertently removed data.
Users have to backup critical data on their local site!