Data Storage Policy
Last modified: Monday February 29, 2016 1:28 PM
******** ABBREVIATIONS USED ********
HPRC stands for the Texas A&M High Performance Research Computing
- WHO CAN STORE DATA. Only HPRC staff and HPRC users can store data on HPRC systems, be those compute or just systems dedicated to archiving.
- PERMITTED DATA. Only the following types of data are permitted for storage on HPRC systems:
- data that serve as input to executables that are run on HPRC systems
- data that is output from executables that are run on HPRC systems
- executable files that are run on HPRC systems
- other directly relevant files: source code, object files, user libraries, include files, make files, etc
- CORE FILE DELETION. Users should regularly delete core files in their directories. Core files that are useful to a user should be renamed with a name that does not contain the "core" substring. All disk-resident core files will be periodically deleted.
- ARCHIVING OF HOME. The HPRC staff archives on a regular (nightly)
basis all user home directories (
/home/$USER) on all computational servers
- BACKING UP NON-HOME FILES ON THE ARCHIVE. User files that are not stored in users' home directories are not backedup/archived. You can, however, manually back up on the archive system any files you consider valuable. Instructions on how to archive data files can be found in the user guides.
- QUOTAS. Disk file quotas for home directories are 500MB on all compute servers. For other disk areas consult the appropriate user guide. The default file quota per user on the archive is 50GB. That however can be extended upon request.
- DISK-RESIDENT DATA RETENTION. All disk-resident user data, on all compute servers, will be deleted six months after account deactivation unless a user has made prior arrangements with the HPRC staff and/or the affected data are covered by special provisions. (An account is deactivated if it is not renewed yearly during the August - September 15 period)
- COMPUTE SERVER DISK IS NOT FOR LONG-TERM STORAGE. All non-home disk-resident areas (e.g., /scratch), on all compute servers, are made available to meet the current needs of active users. Such areas are not meant in any way to provide long-term storage. Users are expected to continually delete or move elsewhere files that are not being used for current work. The staff will periodically delete older user files when the fill level reaches 90% of capacity. The HPRC will send out notices before such action takes place.
- ARCHIVE-RESIDENT DATA RETENTION. All archive-resident user data will be deleted
18 months after account deactivation. Before the 18-month period expires, users can engage in any
of the following:
- delete their archived files and/or
- copy their data files to an external, non-HPRC storage and/or
- arrange with the HPRC staff (to be initiated by an e-mail request) for a tenure extension, if possible, of their files and/or
- any combination of the above
- CONTRACTUAL CONDITIONS. Faculty and/or student users who plan to leave Texas A&M and whose archive area contains files that contractually must be preserved must contact the HPRC staff in writing to that effect in order to make secure arrangements for their eventual disposition.
- THREE YEARS MAXIMUM TENURE. Three (3) years is the maximum residency period for an archived file since its most recent use, if space is available. Extensions can be granted by written notification (to helpdesk) or at account renewal time. But, past the 3-year period and with no extension granted such files will be deleted.