Reading multiple csv files and save in a matrix

Hello, I have multple csv files in a folder, I want to read them and store in a matrix, further, I also check for any duplicate entry in different files and sort the data in according to year and day. I am attaching one of the csv file here.
I tried foll. code:
SL_files = dir(sprintf('%s%s%s',fullfile(dirName),'\','*.csv'));
for idx = 1:size(SL_files,1)
disp(SL_files(idx,1).name)
fid = fopen(sprintf('%s%s%s',fullfile(dirName),'\',SL_files(idx,1).name));
filedata{idx} = textscan(fid, '%f%f%f %f:%f %f %f','Headerlines',16);
fclose(fid);
end
However, I am getting empty values after column 4. Any help? Thanks!

1 Kommentar

I solve the problem:
numMat_All = [];
for idx = 1:size(SL_files,1)
disp(SL_files(idx,1).name)
fid = fopen(sprintf('%s%s%s',fullfile(dirName),'\',SL_files(idx,1).name));
data = textscan(fid, '%s %f %f %f %f %f %f', ...
'Delimiter',',', 'MultipleDelimsAsOne',1,'headerlines',16);
fclose(fid);
CharCell = data{1,1};
result = regexprep(CharCell,'[\s;:]+',' ');
numMat = cell2mat(cellfun(@str2num, result(:,1:end), 'UniformOutput', false));
numMat_All = [numMat_All;numMat];
data = []; CharCell = []; result = []; numMat = [];
end
dt = datetime([numMat_All(:,1:5), repmat(0,length(numMat_All),1)]);
T = table(dt,numMat_All(:,[6:7]));
T1 = sortrows(T,'dt');

Melden Sie sich an, um zu kommentieren.

Antworten (1)

KSSV
KSSV am 12 Okt. 2017

0 Stimmen

Use either xlsread or csvread to read the files.

3 Kommentare

Poulomi Ganguli
Poulomi Ganguli am 12 Okt. 2017
Bearbeitet: KSSV am 12 Okt. 2017
xlsread/csvread will not work in this case since the sheet has a combination of numeric and text values. I have attached sample sheet for reference and referred foll. link earlier:
KSSV
KSSV am 12 Okt. 2017
On using xlsread you can extract the numeric data, text data separately.
It won't work since year and time are in different format. Textscan will work in this case. I am looking for some other answer/ way to solve it. Thanks!

Melden Sie sich an, um zu kommentieren.

Kategorien

Gefragt:

am 12 Okt. 2017

Kommentiert:

am 13 Okt. 2017

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by