Read non-tabular text file using datastore or mapreduce
1 Ansicht (letzte 30 Tage)
Ältere Kommentare anzeigen
How can I read non-tabular text file using datastore or mapreduce? Thanks
0 Kommentare
Antworten (2)
yashwanth annapureddy
am 19 Nov. 2014
Hi Darek,
As you might already know datastore is primarily meant for large tabular data sets. Non-tabular/blocked reading is something we want to look at also in the near future.
However you should be able to play with the TextscanFormats to read the data you care about just as you would using textscan for reading non-tabular data. For example, as you may already know, you can set the TextscanFormats as '%q' and read in a table with one variable name with the block of text for further processing.
I could probably help more, if you provide a sample text file?
hope this helps.
0 Kommentare
Darek
am 19 Nov. 2014
3 Kommentare
yashwanth annapureddy
am 4 Dez. 2014
By records if you mean lines in the file, datastore is probably not the right tool to count the number of records in a file. Lower or even system level functions like the ones mentioned in this thread might be useful for this kind of analysis.
Siehe auch
Kategorien
Mehr zu MapReduce finden Sie in Help Center und File Exchange
Produkte
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!