Edric Ellis

MathWorks

Last seen: Today | Aktiv seit 2011

Followers: 0 Following: 0

Developer at MathWorks, working on Parallel Computing Toolbox. Professional Interests: parallel computing, distributed arrays, gpu

Statistiken

All

Abzeichen anzeigen

Feeds

Beantwortet
How to output variables properly from a parfor loop
For your first case, you could use a parfor "reduction variable". Like this: loops = 10000000; b = []; parfor ii = 1:loops ...

etwa 17 Stunden vor | 0

Beantwortet
Parallel tool (parfor) and COM objects
The general approach to fixing cases where a variable is needed inside parfor, but cannot be directly sent there, is to use para...

etwa 23 Stunden vor | 0

Beantwortet
Problem working with parfor
That stack frame in the profiler is simply where your MATLAB client is waiting for the workers to complete their work. You can g...

etwa 23 Stunden vor | 0

| akzeptiert

Beantwortet
Updating a parallel.pool.Constant within a parfor loop
You can't directly update the Value of a parallel.pool.Constant inside a parfor loop - not least because the parfor constraints ...

2 Tage vor | 0

| akzeptiert

Beantwortet
Interference in parfor when using global variables
Separate workers have their own completely separate global workspaces. If the function that you call from parfor first assigns a...

14 Tage vor | 0

Beantwortet
Parsing files and computing in parfor - GA
When working with a remote cluster parpool, usually Parallel Computing Toolbox is able to work out automatically which files nee...

etwa ein Monat vor | 0

Beantwortet
Parallelize cumulative average algorithm
You can use a parfor "reduction variable" to compute this, with a slight modification which may or may not be significant: dat ...

etwa ein Monat vor | 0

| akzeptiert

Beantwortet
doubts about parfeval memory allocation
If the entire dataset only just fits in memory once, then a better option than readall might be to use partition on the datastor...

etwa ein Monat vor | 0

| akzeptiert

Beantwortet
Error Implementing parfor while creating satellite objects
I'm guessing you are trying to use this with a thread-based parallel pool. I had to add a line to your code to make it work, nam...

etwa 2 Monate vor | 0

| akzeptiert

Beantwortet
Why is it not possible to pass matrix parameters as argument to GPU arrayfun and what to do?
It would be great to see a simplified example of what you're trying to do. What you can do with gpuArray/arrayfun is write a nes...

etwa 2 Monate vor | 1

| akzeptiert

Beantwortet
terminate program if worker aborts in parallel loop
If you create your parpool using the option SpmdEnabled=true, then this has the side-effect of making parallel pools terminate c...

etwa 2 Monate vor | 0

| akzeptiert

Beantwortet
How is the work distributed in parfor loop?
If you know in advance which iterations are the time-consuming ones, then you could consider running those together as a separat...

2 Monate vor | 1

| akzeptiert

Beantwortet
How can I debug a parallel script with spmd?
Unfortunately you cannot set breakpoints in code running on workers. If the problem is related to the messages you are sending u...

3 Monate vor | 0

Beantwortet
how parfor distributes resources to each iteration if the number of cores is larger than the number of iterations
When a parfor loop executes on a parallel pool, PCT will divide up the entire loop range 1:N into a series of batches known as "...

3 Monate vor | 3

Beantwortet
bug parfor: analyzing and transferring files to worker: not done: blocked
The "analyzing and transferring files to workers" message occurs only when the workers encounter a failure to find some code tha...

3 Monate vor | 0

Beantwortet
parpool use existing slurm job
Further to @Venkat Siddarth Reddy's suggestion, what you might want to do is something like this: clus = parcluster('mySlurmPro...

3 Monate vor | 0

Beantwortet
Store intermediate results of cost function when solver is run in parallel
You could use a parallel.pool.PollableDataQueue to let the workers send the data to the client. The idea is that you create the ...

4 Monate vor | 0

| akzeptiert

Beantwortet
"Invalid or deleted object" when using clib object in parfor loop
I'm not terribly familiar with clibgen I'm afraid, but I think the problem here is almost certainly that the function myCppFunct...

4 Monate vor | 2

| akzeptiert

Beantwortet
MATLAB workers can't access files in network shared folder
You could try using FileStore for this. You'll first need to save your figure to a temporary location on disk, and then you can ...

4 Monate vor | 0

| akzeptiert

Beantwortet
Running parfor on multiple nodes (20 nodes = 960 cores) using Slurm (super computer)
To run across multiple nodes of a cluster, you need to set up MATLAB Parallel Server on the cluster. You might well need help fr...

4 Monate vor | 1

Beantwortet
Parallelization data organization/transfer
parfor is designed to "just work" for a wide range of cases, but it's true that sometimes you need a bit more control. parforOpt...

4 Monate vor | 0

Beantwortet
Access Violation Detected MatLAB
That crash dump clearly implicates your MEX file octtrees.query_index_moct. One of the common pitfalls when running MEX files in...

5 Monate vor | 0

Beantwortet
Is it possible to run multiple lines at once in a Matlab script?
To expand just a little on @Stephen23's comment - you can do this if you have Parallel Computing Toolbox. You should first restr...

5 Monate vor | 1

| akzeptiert

Beantwortet
CNN Performance: CPU Consistency vs. GPU Variance - Why?
I'm not certain if it will make everything consistent, but note that random state on the GPU is controlled by the gpurng functio...

5 Monate vor | 0

Beantwortet
Parfor with options = statset('UseParallel',true);
If you are able to "flatten" the parallelism so that it is all exposed to a single parfor loop with enough iterations to keep al...

5 Monate vor | 0

| akzeptiert

Beantwortet
Is it possible to use parfeval and backgroundPool to write to a Mongo database in a background thread?
In your first case using parfor, if you haven't changed any settings, you will be using a process pool. (The default profile is ...

5 Monate vor | 0

Beantwortet
Avoid memory copy in thread-based environment (parfeval)
In this case, thread-based workers already avoid copying the large array m to the workers. See this section in the doc. Note tha...

5 Monate vor | 2

| akzeptiert

Beantwortet
How to assign values to arrays inside the PARFOR loop in Parallel Computing Toolbox?
To assign into A here, you need to follow the rules of sliced variables in parfor. In this case, you need to modify your code to...

7 Monate vor | 1

| akzeptiert

Beantwortet
Is there a parallel version of splitapply()?
tall arrays support parallel execution of splitapply. Would that work for your case?

7 Monate vor | 0

| akzeptiert

Beantwortet
How do you organize data from a parfor loop?
You can do this more directly by flattening the parfor loop, and using a combination of ind2sub and reshape. The idea is as foll...

11 Monate vor | 0

Mehr laden

Edric Ellis

MathWorks

Statistiken

File Exchange

File Exchange

File Exchange

File Exchange

MATLAB Answers

MATLAB Answers

MATLAB Answers

MATLAB Answers

MATLAB Answers

MATLAB Answers

Cody

Feeds