User Tools

Site Tools


wiki:uso_sist_en

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
wiki:uso_sist_en [2022/08/25 11:35]
scopeadmin [Tips for using Matlab for the execution of parallel jobs on the IBiSCo HPC cluster]
wiki:uso_sist_en [2022/10/07 19:14] (current)
cnr-guest [Available file systems]
Line 73: Line 73:
  
 In-depth documentation on Lustre is available online, at the link: '' https://www.lustre.org/ ''  In-depth documentation on Lustre is available online, at the link: '' https://www.lustre.org/ '' 
 +
 +''/ibiscostorage''
 +new scratch area shared among UI and computation nodes (available from 07/10/2022), **not** LUSTRE based
  
  
 ==== Job preparation ans submission ==== ==== Job preparation ans submission ====
 +
 +=== Premise: new job management rules active from 9/10/2022 ===
 +
 +To improve the use of resources, the job management rules have been changed.
 +
 + * New usage policies based on // fairshare // mechanisms have been implemented \\
 + * New queues for job submissions have been defined
 +    - ** sequential ** queue:
 +      * accepts only sequential jobs with a number of tasks not exceeding 1,
 +      * who do not use GP-GPUs,
 +      * for a total number of jobs running on it not exceeding 128
 +      * and maximum execution time limit of 1 week
 +    - ** parallel ** queue:
 +      * accepts only parallel jobs with task number greater than 1 and less than 1580,
 +      * that use no more 64 GP-GPUs
 +      * and maximum execution time limit of 1 week
 +     - ** gpus ** queue:
 +      * only accepts jobs that use no more than 64 GP-GPUs,
 +      * with task number less than 1580
 +      * and maximum execution time limit of 1 week
 +     - ** hparallel ** queue:
 +      * accepts only parallel jobs with task number greater than 1580 and less than 3160,
 +      * that make use of at least 64 GP-GPUs
 +      * and maximum execution time limit of 1 day
 +
 +From 9 October the current queue will be disabled and only those defined here will be active, to be explicitly selected. For example, to subdue a job in the ** parallel ** queue, execute \\
 +
 +  $ srun -p parallel <MORE OPTIONS> <COMMAND NAME>
 +
 +If the job does not comply with the rules of the queue used, it will be terminated.
 +
 +=== Use of resources ===
  
 In the system is installed the resource manager SLURM to manage the cluster resources. In the system is installed the resource manager SLURM to manage the cluster resources.
Line 365: Line 400:
    * To use matlab command window, please use '' ssh ibiscohpc-ui.scope.unina.it -l [username] -Y '' when logging into the IBISCO cluster.    * To use matlab command window, please use '' ssh ibiscohpc-ui.scope.unina.it -l [username] -Y '' when logging into the IBISCO cluster.
    * Setup the matlab environment by using the command '' /nfsexports/SOFTWARE/MATLAB/R2020b/bin/matlab ''. This opens the mathworks command window where you will be able to add the settings file (see ahead).\\    * Setup the matlab environment by using the command '' /nfsexports/SOFTWARE/MATLAB/R2020b/bin/matlab ''. This opens the mathworks command window where you will be able to add the settings file (see ahead).\\
 +   * Matlab version R2022a can be accessed using the command '' /nfsexports/SOFTWARE/MATLAB/R2022a/bin/matlab ''
  
 == Configuration and execution == == Configuration and execution ==
Line 413: Line 449:
 </code> </code>
  
-To run this code, the following bash script can be used : +To run this code, the following command executed on the UI can be used: 
-<code>#!/bin/bash +<code> 
-#SBATCH -n 1 +/nfsexports/SOFTWARE/MATLAB/R2020b/bin/matlab -nodisplay -nosplash -nodesktop -r test 
- +</code>
-/nfsexports/SOFTWARE/MATLAB/R2020b/bin/matlab -nodisplay -nosplash -nodesktop -r test</code>+
  
  
wiki/uso_sist_en.1661427313.txt.gz · Last modified: 2022/08/25 11:35 by scopeadmin