Loading big CSV, and laptops with 8GB doesn't work
5 views (last 30 days)
Show older comments
Tina Zhao on 16 Mar 2016
Answered: Dave Behera on 21 Mar 2016
My script loads big CSV files and processes it. But some end users said csv files bigger than 350MB won't work. Is there a way to manage the RAM issue? Can Matlab split it and load it into smaller files or is there any other ways? Thanks.
Dave Behera on 21 Mar 2016
To read huge .csv files in MATLAB, the datastore feature may be helpful. Please see the following link: Datastore
Using a datastore, you can load a .csv file and specify how many rows to read at a time. The datastore would read only that many rows into memory, and not the entire file. This way, you won't need to split your file into multiple files.
Find more on Large Files and Big Data in Help Center and File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!Start Hunting!