Load data one file at time for CNN training

I have dataset with 4700 images with dimensions 2000*102. All these images are converted to seperate CSV files (pixel values). I think I can't load all these csv files at a time as this will crash my RAM (32GB) when the network starts to train. Is it possible in Matlab to access each image(.csv) file during training and testing from storage location rather than placing it on RAM. This is to train and test CNN in deep learning extension.

Answer 1

[Vishal Bhutani]

Try the solutions mentioned in the link attached below. It contains solution how to access data from CSV file directly when size of CSV file is large.

https://www.mathworks.com/matlabcentral/answers/231857-loading-large-csv-files

https://www.mathworks.com/matlabcentral/answers/71837-way-of-conserving-memory-when-extracting-data-from-csv

Hope it helps.