Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Next revision		 Previous revision
habrok:data_management:quota [2020/10/21 11:30] – external edit 127.0.0.1habrok:data_management:quota [2023/04/18 09:45] (current) – [hbquota] admin
Line 2: Line 2:
 ====== Quota ====== ====== Quota ======
  
-Quotas are applied on the [[storage_areas|available directories]] /home, /data, and /scratch. This means that there is a limit on how much data and how many files you can store. To find information about the space available you can use the command ''pgquota'' or ''lfs'' with the arguments ''quota'' and the file system. Both commands are explained below.+Quotas are applied on the [[storage_areas|available directories]] home directories , ''/scratch'' and ''/projects''. This means that there is a limit on how much data and how many files you can store. To find information about the space available you can use the commands ''df'' for the home directories, or ''lfs'' with the arguments ''quota'' and ''/scratch'' or ''/projects'' for the ''/scratch'' and ''/projects'' file systems. 
  
-===== pgquota =====+All commands are explained below.
  
-This is a very simple wrapper around the ''lfs'' command that displays user quota. Simply type:+===== hbquota ===== 
 + 
 +The ''hbquota'' tool can be used on Hábrók to display your quota overview for the different file systems:
  
 <code> <code>
-pgquota+Quotas for: p123456 
 +/home1 
 +###############====================================    27%  
 +  Quota: 50.0 GiB 
 +  Hard Limit: 50.0 GiB 
 +  Usage: 13.7 GiB 
 +  File Quota: 1000000 
 +  File Limit: 1000000 
 +  Files: 371741 
 +/projects 
 +#===================================================    0%  
 +  Quota: 250.0 GiB 
 +  Hard Limit: 275.0 GiB 
 +  Usage: 4.0 KiB 
 +  File Quota: 512000 
 +  File Limit: 537600 
 +  Files: 1 
 +/scratch 
 +#####===============================================    8%  
 +  Quota: 250.0 GiB 
 +  Hard Limit: 275.0 GiB 
 +  Usage: 21.3 GiB 
 +  File Quota: 512000 
 +  File Limit: 537600 
 +  Files: 11135
 </code> </code>
-The output should look something like this:+===== df =====
  
 +The ''df'' tool can be used for the home directories. An example is given below for disk space:
 <code> <code>
-Quotas for user p123456 +$ df -h $HOME 
-/home +Filesystem               Size  Used Avail Use% Mounted on 
-#####===============================================    8% +172.23.15.201:/nfs/home   50G   15G   36G  29% /home1
-  Quota:    20G +
-  Hard Limit:   22G +
-  Usage:    1.79G +
-  File Quota:   204800 +
-  File Limit:   225280 +
-  Files:    44966 +
-/data +
-#===================================================    0% +
-  Quota:    250G +
-  Hard Limit:   275G +
-  Usage:    288.3M +
-  File Quota:   1024000 +
-  File Limit:   1126400 +
-  Files:    5 +
-/scratch +
-#===================================================    0% +
-  Quota:    45T +
-  Hard Limit:   50T +
-  Usage:    4k +
-  File Quota:   5120000 +
-  File Limit:   5632000 +
-  Files:    1+
 </code> </code>
-By default the program only shows quota for the user, but if you wish to see quotas displayed for all your groups, simply add the ‘-a’ flag as follows: 
  
 +You can use the ''-i'' option for number of files:
 <code> <code>
-pgquota -a+$ df -i $HOME 
 +Filesystem               Inodes  IUsed  IFree IUse% Mounted on 
 +172.23.15.201:/nfs/home 1000000 158540 841460   16% /home1
 </code> </code>
 +
 +In these examples ''df'' will show the space available in the given location, where ''$HOME'' is your home directory. You can replace this path by another directory on the home directory storage, if you need information about that directory.
  
 ===== lfs ===== ===== lfs =====
  
-An example command, how to check quota for the /home directory using lfs:+An example command, how to check quota for the ''/scratch'' or ''/projects'' directory using lfs:
  
 <code> <code>
-lfs quota -h /home+lfs quota -hp $( id -g ) /scratch
 </code> </code>
 +Where ''$( id -g )'' will be replaced by your numerical group id and in this case the output is for ''/scratch''.
 +
 The output of the command will look as follows: The output of the command will look as follows:
  
 <code> <code>
-Disk quotas for user p123456 (uid 123456): +Disk quotas for prj 10123456 (pid 10123456): 
-     Filesystem  used   quota   limit   grace   files   quota   limit   grace +     Filesystem    used   quota   limit   grace   files   quota   limit   grace 
-          /home 786.2M       0       0       -   28418       0       0       - +       /scratch  1.019G    250G    275G       -       4  204800  215040       -
-Disk quotas for group beheer (gid 500): +
-     Filesystem  used   quota   limit   grace   files   quota   limit   grace +
-          /home  786.2M  20971520 23068672       -    6042  204800  225280       -+
 </code> </code>
 There are limits for both the amount of data and for the number of files: the columns used, quota, and limit show the current usage and the soft and hard limits, while the columns files, quota, and limit on the right show the same information for the number of files.\\ There are limits for both the amount of data and for the number of files: the columns used, quota, and limit show the current usage and the soft and hard limits, while the columns files, quota, and limit on the right show the same information for the number of files.\\
Line 70: Line 78:
 ==== Group quota ==== ==== Group quota ====
  
-In the example above, information is shown for the private group belonging to your account. You will be the only person in this group. If you collaborate with other users of the cluster you may also share a group with them. The command id can be used to find information about the groups you belong to:+In the example above, information is shown for the private group belonging to your account, and its corresponding private directory/folder. You will be the only person in this group. If you collaborate with other users of the cluster you may also share a group with them. The command id can be used to find information about the groups you belong to:
  
 <code> <code>
Line 81: Line 89:
 uid=10123456(p123456) gid=10123456(p123456) groups=10123456(p123456),55102132(pg-mygroup),55103524(pg-othergroup) uid=10123456(p123456) gid=10123456(p123456) groups=10123456(p123456),55102132(pg-mygroup),55103524(pg-othergroup)
 </code> </code>
-This will show information about your user id, including the groups you belong to. In this case the groups are p123456 (private), pg-mygroup and pg-othergroup.\\ +This will show information about your user id, including the groups you belong to. In this case the groups are p123456 (private), hb-mygroup and hb-othergroup.\\ 
-In order to obtain information about the quota for these groups you can supply the option -g to lfs quota. E.g.:+In order to obtain information about the quota for these groups you can supply the numerical id for the group to lfs quota. The numerical id is listed before the group name. E.g. for pg-mygroup:
  
 <code> <code>
-lfs quota -g pg-mygroup /data+lfs quota -p 55102132 /scratch
 </code> </code>
 \\ \\
-You can combine this with ''-h'' using the combined option ''-hg''.+You can combine this with ''-h'' using the combined option ''-hp''.