Beantwortet
Running parfor on multiple nodes (20 nodes = 960 cores) using Slurm (super computer)
To run across multiple nodes of a cluster, you need to set up MATLAB Parallel Server on the cluster. You might well need help fr...

7 Monate vor | 1

Beantwortet
Parallelization data organization/transfer
parfor is designed to "just work" for a wide range of cases, but it's true that sometimes you need a bit more control. parforOpt...

8 Monate vor | 0

Beantwortet
Access Violation Detected MatLAB
That crash dump clearly implicates your MEX file octtrees.query_index_moct. One of the common pitfalls when running MEX files in...

8 Monate vor | 0

Beantwortet
Is it possible to run multiple lines at once in a Matlab script?
To expand just a little on @Stephen23's comment - you can do this if you have Parallel Computing Toolbox. You should first restr...

8 Monate vor | 1

| akzeptiert

Beantwortet
CNN Performance: CPU Consistency vs. GPU Variance - Why?
I'm not certain if it will make everything consistent, but note that random state on the GPU is controlled by the gpurng functio...

8 Monate vor | 0

Beantwortet
Parfor with options = statset('UseParallel',true);
If you are able to "flatten" the parallelism so that it is all exposed to a single parfor loop with enough iterations to keep al...

8 Monate vor | 0

| akzeptiert

Beantwortet
Is it possible to use parfeval and backgroundPool to write to a Mongo database in a background thread?
In your first case using parfor, if you haven't changed any settings, you will be using a process pool. (The default profile is ...

8 Monate vor | 0

Beantwortet
Avoid memory copy in thread-based environment (parfeval)
In this case, thread-based workers already avoid copying the large array m to the workers. See this section in the doc. Note tha...

9 Monate vor | 2

| akzeptiert

Beantwortet
How to assign values to arrays inside the PARFOR loop in Parallel Computing Toolbox?
To assign into A here, you need to follow the rules of sliced variables in parfor. In this case, you need to modify your code to...

10 Monate vor | 1

| akzeptiert

Beantwortet
Is there a parallel version of splitapply()?
tall arrays support parallel execution of splitapply. Would that work for your case?

10 Monate vor | 0

| akzeptiert

Beantwortet
How do you organize data from a parfor loop?
You can do this more directly by flattening the parfor loop, and using a combination of ind2sub and reshape. The idea is as foll...

etwa ein Jahr vor | 0

Beantwortet
How to use parallel.pool.Constant to save on overheard for large array constant across all calls to parfeval?
You've got a subtle flaw in your first piece of code that allows the program to run, but it does not actually benefit from the u...

etwa ein Jahr vor | 0

| akzeptiert

Beantwortet
Read/Write Limitations with Parallel Computing Toolbox (parfor)
Generally speaking, parfor is conservative in what it allows to ensure that by default, all variable accesses are safe. It is s...

etwa ein Jahr vor | 0

| akzeptiert

Beantwortet
Parallel workers automatically shutting down in the middle of RL parallel training.
If workers are leaving the pool one at a time while the pool is busy, this almost certainly means that they are crashing. I reco...

etwa ein Jahr vor | 0

| akzeptiert

Beantwortet
Clear persistent variables of function on worker
Whenever you issue a clear command at the client, the same clear command is issued on the workers. So you can simply do clear p...

etwa ein Jahr vor | 1

Beantwortet
Error using parpool. Parallel pool failed to start with the following error. For more detailed information, validate the profile 'Processes' in the Cluster Profile Manager.
This is probably the following known problem in R2023a: https://www.mathworks.com/support/bugreports/2968710 . There are workaro...

mehr als ein Jahr vor | 0

Beantwortet
Matlab spmd Collecting Composite Arrays
You missed a crucial clue from your question - where are you assigning hx. I'm going to guess you have something like this: spm...

mehr als ein Jahr vor | 1

| akzeptiert

Beantwortet
Matlab spmd and CoolProp (CPython library)
You need to avoid transferring the objects to the workers, and instead simply build the objects directly on the workers. The sim...

mehr als ein Jahr vor | 0

| akzeptiert

Beantwortet
How to shut down all running workers of paarpools?
You can shut down all remaining workers of the currently running pool by executing: delete(gcp('nocreate')) There should be no...

mehr als ein Jahr vor | 0

Beantwortet
Assigning values to a vector out of order in parallel (parfor)
One of the constraints of parfor is that indexed outputs like myVec must be "sliced" - that means that you must assign only elem...

mehr als ein Jahr vor | 0

| akzeptiert

Beantwortet
Is it possible to create multiple parallel pools simultaneously
There's no direct way to do what you're after here. (As @Walter Roberson points out, you can have a backgroundPool and a parpool...

mehr als ein Jahr vor | 1

| akzeptiert

Beantwortet
Cluster multi-gpu training Error: Current pool is not local.
I think you need to specify ExecutionEnvironment="parallel" for this situation. According to the trainingOptions reference page,...

mehr als ein Jahr vor | 0

| akzeptiert

Beantwortet
Is is possible to run a batch job on an MJS Cloud Center cluster with SpmdEnabled set to false?
Unfortunately, this option is not supported at the moment for batch jobs. I realise it's probably rather a big change to your co...

mehr als ein Jahr vor | 0

| akzeptiert

Beantwortet
I need help regarding parfeval implementation with object handle. I have created an object handle, the member functions of which i want to run as parallel processes.
The documentation here applies to parfeval as well as parfor in the sense that the object instances on the workers are not conne...

mehr als ein Jahr vor | 0

| akzeptiert

Beantwortet
How to avoid broadcast variable while optimizing a cost function in parallel computing?
Investigating performance of parfor loops can be a bit tricky. Here are a few pointers: Do you happen to know if your function ...

mehr als ein Jahr vor | 0

Beantwortet
parfor with temporary variable worning
I think there are a couple of problems here. Firstly, I think you need to change the way you're assigning into dcm_stack because...

mehr als ein Jahr vor | 0

| akzeptiert

Beantwortet
Can parfor be used if no Parallel Computing Toolbox licenses are available?
The implementation of parfor is intended to gracefully fall back to running in serial if a Parallel Computing Toolbox licence ca...

mehr als ein Jahr vor | 0

Beantwortet
Slicing variable in parfor loop
In this case, you don't actually have a data dependency between the loop iterations. You can use a parfor reduction to do this, ...

mehr als ein Jahr vor | 0

| akzeptiert

Beantwortet
GPU0 and GPU1 in matlab?
GPU Computing in MATLAB supports only NVIDIA devices, so your Intel graphics card cannot be used by gpuArray.

mehr als ein Jahr vor | 1

| akzeptiert

Beantwortet
Sliced Variables in N Choose K Search
This is a limitation of the parfor analysis when it comes to indexing sliced variables in a nested for loop. There is another wo...

mehr als ein Jahr vor | 0

| akzeptiert