Load data one file at time for CNN training

3 Ansichten (letzte 30 Tage)
Sunny
Sunny am 8 Jan. 2019
Beantwortet: Vishal Bhutani am 11 Jan. 2019
I have dataset with 4700 images with dimensions 2000*102. All these images are converted to seperate CSV files (pixel values). I think I can't load all these csv files at a time as this will crash my RAM (32GB) when the network starts to train. Is it possible in Matlab to access each image(.csv) file during training and testing from storage location rather than placing it on RAM. This is to train and test CNN in deep learning extension.

Antworten (1)

Vishal Bhutani
Vishal Bhutani am 11 Jan. 2019
Try the solutions mentioned in the link attached below. It contains solution how to access data from CSV file directly when size of CSV file is large.
Hope it helps.

Produkte


Version

R2018b

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by