Edric Ellis

MathWorks

Last seen: Today | Aktiv seit 2011

Followers: 0 Following: 0

Developer at MathWorks, working on Parallel Computing Toolbox. Professional Interests: parallel computing, distributed arrays, gpu

Statistik

All

Abzeichen anzeigen

Feeds

Beantwortet
Is there a faster method than parfor?
There's quite a bit going on here, and without seeing the details of modifyArray, it's hard to know exactly what to suggest to m...

21 Tage vor | 0

Beantwortet
How does a local parpool manage path per worker?
Workers in a local parallel pool inherit their MATLAB path (and current working directory) from the MATLAB client. However, if y...

22 Tage vor | 0

| akzeptiert

Beantwortet
Did the default NumWorkers change for a local pool in R2024a?
Check the answer here: https://uk.mathworks.com/matlabcentral/answers/2062522-how-does-parallel-computing-toolbox-handle-perform...

6 Monate vor | 0

| akzeptiert

Beantwortet
parpool memory allocation per worker
Further to the other suggestions here, using parpool("Threads") will use less memory than parpool("Processes"), but not everythi...

6 Monate vor | 0

Beantwortet
How to resolve warning message about broadcast variable while using 'parfor'?
I think you should ignore this message in this case. It looks like you really need all the values of males for each iteration of...

6 Monate vor | 0

| akzeptiert

Beantwortet
parfor problems (structure, reduction assignment, etc)
The problem here is that you're trying to extend the arrays like Ball by assigning off the end of the current size of the array....

7 Monate vor | 0

| akzeptiert

Beantwortet
Cancel parfeval causes workers to throw errors
My guess is that whatever myFunc is doing is not safe against being interrupted with CTRL-C. When you cancel a parallel.Future, ...

7 Monate vor | 0

Beantwortet
How to run multiple functions simultaneously and communicate with each other?
Your spmd block as written instructs each worker to run first aData() and then bData(). This is the general pattern of spmd - al...

7 Monate vor | 1

Beantwortet
Error when running function with batch()
This is nothing to do with batch, and everything to do with workspace transparency. Basically when a parfor loop exists inside a...

8 Monate vor | 0

| akzeptiert

Beantwortet
FFT is suddenly slow down for repeated operations.
This is due to the asynchronous nature of gpuArray operations. Where possible, operations on the GPU are queued up and run in th...

8 Monate vor | 2

| akzeptiert

Beantwortet
generalizedInverseKinematics in a nested parforloop
You haven't given us a lot to go on there, but the form of assignment you mention is only valid if qWaypoints is a parfor "tempo...

9 Monate vor | 0

| akzeptiert

Beantwortet
How can I know which worker performs each iteration of the parfor loop?
You can use getCurrentTask (if you're using a process pool rather than a thread pool). This has a field ID which tells you which...

9 Monate vor | 0

Beantwortet
Multiply tall array with array
You need to use a bit of a trick to construct the colon vector. (This trick is alluded to on this doc page). Basically, you need...

9 Monate vor | 0

Beantwortet
How to output variables properly from a parfor loop
For your first case, you could use a parfor "reduction variable". Like this: loops = 10000000; b = []; parfor ii = 1:loops ...

9 Monate vor | 0

| akzeptiert

Beantwortet
Parallel tool (parfor) and COM objects
The general approach to fixing cases where a variable is needed inside parfor, but cannot be directly sent there, is to use para...

9 Monate vor | 0

Beantwortet
Problem working with parfor
That stack frame in the profiler is simply where your MATLAB client is waiting for the workers to complete their work. You can g...

9 Monate vor | 0

| akzeptiert

Beantwortet
Updating a parallel.pool.Constant within a parfor loop
You can't directly update the Value of a parallel.pool.Constant inside a parfor loop - not least because the parfor constraints ...

9 Monate vor | 0

| akzeptiert

Beantwortet
Interference in parfor when using global variables
Separate workers have their own completely separate global workspaces. If the function that you call from parfor first assigns a...

9 Monate vor | 0

Beantwortet
Parsing files and computing in parfor - GA
When working with a remote cluster parpool, usually Parallel Computing Toolbox is able to work out automatically which files nee...

10 Monate vor | 0

Beantwortet
Parallelize cumulative average algorithm
You can use a parfor "reduction variable" to compute this, with a slight modification which may or may not be significant: dat ...

10 Monate vor | 0

| akzeptiert

Beantwortet
doubts about parfeval memory allocation
If the entire dataset only just fits in memory once, then a better option than readall might be to use partition on the datastor...

10 Monate vor | 0

| akzeptiert

Beantwortet
Error Implementing parfor while creating satellite objects
I'm guessing you are trying to use this with a thread-based parallel pool. I had to add a line to your code to make it work, nam...

11 Monate vor | 0

| akzeptiert

Beantwortet
Why is it not possible to pass matrix parameters as argument to GPU arrayfun and what to do?
It would be great to see a simplified example of what you're trying to do. What you can do with gpuArray/arrayfun is write a nes...

11 Monate vor | 1

| akzeptiert

Beantwortet
terminate program if worker aborts in parallel loop
If you create your parpool using the option SpmdEnabled=true, then this has the side-effect of making parallel pools terminate c...

11 Monate vor | 0

| akzeptiert

Beantwortet
How is the work distributed in parfor loop?
If you know in advance which iterations are the time-consuming ones, then you could consider running those together as a separat...

11 Monate vor | 1

| akzeptiert

Beantwortet
How can I debug a parallel script with spmd?
Unfortunately you cannot set breakpoints in code running on workers. If the problem is related to the messages you are sending u...

12 Monate vor | 0

Beantwortet
how parfor distributes resources to each iteration if the number of cores is larger than the number of iterations
When a parfor loop executes on a parallel pool, PCT will divide up the entire loop range 1:N into a series of batches known as "...

12 Monate vor | 3

Beantwortet
bug parfor: analyzing and transferring files to worker: not done: blocked
The "analyzing and transferring files to workers" message occurs only when the workers encounter a failure to find some code tha...

12 Monate vor | 0

Beantwortet
parpool use existing slurm job
Further to @Venkat Siddarth Reddy's suggestion, what you might want to do is something like this: clus = parcluster('mySlurmPro...

12 Monate vor | 0

Beantwortet
Store intermediate results of cost function when solver is run in parallel
You could use a parallel.pool.PollableDataQueue to let the workers send the data to the client. The idea is that you create the ...

etwa ein Jahr vor | 0

| akzeptiert

Mehr laden

Edric Ellis

MathWorks

Statistik

File Exchange

File Exchange

File Exchange

File Exchange

MATLAB Answers

MATLAB Answers

MATLAB Answers

MATLAB Answers

MATLAB Answers

MATLAB Answers

Cody

Feeds