Why did spmd create a pool of 12 workers on a cluster with 32 cores?
2 Ansichten (letzte 30 Tage)
Ältere Kommentare anzeigen
Claire Fang
am 16 Jul. 2021
Kommentiert: Kojiro Saito
am 19 Jul. 2021
I am experiencing a problem with running Matlab code with spmd blocks on the cedar cluster on Compute Canada. I asked for 32 cores and 1 node being allocated to me. The system can detect 32 cores, but spmd can generate a pool of only 12 workers.
Can someone explain why? I am attaching both the Matlab file and the output file here.
0 Kommentare
Akzeptierte Antwort
Kojiro Saito
am 16 Jul. 2021
You can change this value to 100 (more than 32) in Preferences menu.
Alternatively, you can specify workers in parpool.
You can add parpool(num) before spmd blocks.
parpool(num)
spmd(num)
...
end
4 Kommentare
Kojiro Saito
am 19 Jul. 2021
Usually, parpool will create a job directory, but in your universities clusters, home directory was set to read-only. I didn't know that, but I'm glad the issue is solved now.
Weitere Antworten (0)
Siehe auch
Kategorien
Mehr zu Parallel Computing Fundamentals finden Sie in Help Center und File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!