How to loop through N different folders with M different.txt files(text​001.txt...​..text010.​txt) with (O rows and P columns). and plot the average(te​xt001.txt.​....text01​0.txt)of M different figures from the N folders.

close all
clear all
D = 'D:\dataprocessing\';
S = dir(fullfile(D,'*'));
N = setdiff({S([S.isdir]).name},{'.','..'}); % list of subfolders of D.
sums = [];
counts = [];
for ii = 1:numel(N)
    T = dir(fullfile(D,N{ii},'*')); % improve by specifying the file extension.
    C = {T(~[T.isdir]).name}; % files in subfolder.
    for jj = 1:numel(C)
        F = fullfile(D,N{ii},C{jj})
                fprintf('test%s\n',F);
 
    S(ii).data = F(:);
    end
end
X = vertcat(S.data);
avgArrivalDelay = sum(sums)/sum(counts)

[Rik]

Would the data fit in your memory all at once if you read all data and then did the processing?

[MS]

yes. it will fit in my memory. Please modify the code for average the files and plot it.

Answer 1

[Image Analyst]

Try this. Adapt as needed:

% Get a list of all txt files in the current folder, or subfolders of it.
fds = fileDatastore('*.txt', 'ReadFcn', @importdata)
fullFileNames = fds.Files
numFiles = length(fullFileNames)
% Loop over all files reading them in and plotting them.
for k = 1 : numFiles
	fprintf('Now reading file %s\n', fullFileNames{k});
	% Now have code to read in the data...
	% Now code to plot the data...
end

[MS]

Thanks. I need a code to average the data files from diffrent folders and plot it. Eg., ten files in 10 diffrent folders. I need to get average 10 files(out of 100 files) and plot it. Any addition to the code will be helpful.

[Image Analyst]

But you didn't even attach any files for me to try the code on. I figured you had the averaging code done and just needed a simple way to process all the files. If you still can't figure out how to put your averaging code into the inside of this loop, then attach at least two of your data files so I can do it for you.

[Image Analyst]

Attach at least two of your data files so I can do it for you. Use the paper clip icon.

[Image Analyst]

I'll just check back tomorrow.

Answer 2

[MS]

Thanks. i am attaching the THREE test from one folder.