SLURM and tailoring walltime for different jobs
    8 Ansichten (letzte 30 Tage)
  
       Ältere Kommentare anzeigen
    
Hi,
so finally, I have access to a big cluster that uses SLURM as scheduler for Matlab. So far so good.
Now, I would need to understand if I am planning the execution of my program properly. I have a Main file, with several batch jobs. At the moment, it looks something like this:
c = parcluster('Cluster name');
c.AdditionalProperties.AccountName = 'my account name';
c.AdditionalProperties.WallTime = '00:30:00';
N_big   = 32;%c.NumWorkers;
N_small = 32;
LAMBDA_SCALING_FACTOR = 5e12;%100e9;
job_geometry_setup = batch(c,@rectangular_loop_geometria_setup,2,{},'Pool',N_small-1,'CurrentFolder','.','AutoAddClientPath',false);
wait(job_geometry_setup)
result_geometry_setup = fetchOutputs(job_geometry_setup);
Regioni    = result_geometry_setup{1};
induttanze = result_geometry_setup{2};
clear result_geometry_setup
delete(job_geometry_setup)
job_mesh_sup = batch(c,@genera_mesh_sup_new,7,{Regioni, induttanze,time,LAMBDA_SCALING_FACTOR},'Pool',N_small-1,'CurrentFolder','.','AutoAddClientPath',false,'AttachedFiles',{'discr_psp_nono_3D_vol_sup_save_noglobal_mex.mexa64' 'genera_nodi_interni_rev.p' 'interpolating_vectors_rev.p'});
wait(job_mesh_sup)
result_mesh_sup = fetchOutputs(job_mesh_sup);
Regioni    = result_mesh_sup{1}; 
induttanze = result_mesh_sup{2}; 
A_th       = result_mesh_sup{3};  
lambda     = result_mesh_sup{4}; 
nodi       = result_mesh_sup{5}; 
A          = result_mesh_sup{6}; 
A_obj      = result_mesh_sup{7}; 
clear result_mesh_sup
delete(job_mesh_sup)
So, I have a couple of questions:
- in the way I am using now the batch, I continuously need to fetch the output from a batch job to the client, just to feed them to another batch job, as in the example above. I would not need to save all the variables. Is there a way to not fetch the output in the client, and to use what is directly available in the shared memory?
- each job can have a different walltime. Shall I just redefine c.AdditionalProperties.WallTime = '00:30:00'; before each job to a value that I find reasonable?
Best
0 Kommentare
Antworten (0)
Siehe auch
Kategorien
				Mehr zu Third-Party Cluster Configuration finden Sie in Help Center und File Exchange
			
	Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!
