Neural Network Batch Training by calling train multiple times
3 Ansichten (letzte 30 Tage)
Ältere Kommentare anzeigen
Hello,
I have a huge dataset and I want to train my neural network using GPU. Unfortunatelly, I run out of memmory if I try to train it using the entire dataset. Is it the same If I train the network multiple times using mini-batches from the dataset or will the network just learn the last mini-batch?
I am using a custom neural network and train() function for the training.
Thanks in advance.
0 Kommentare
Antworten (1)
Aditya Salveru
am 31 Mai 2018
Bearbeitet: Aditya Salveru
am 31 Mai 2018
Hi,
Your machine is running out of memory as you trying to train network with entire data set at once.
I would suggest you to use mini-batches, for example mini batch gradient descent and also select the batch size appropriately to reduce the risk of running out of memory.
It is same as training the network with entire data set at once.
Thank you.
Aditya Salveru.
2 Kommentare
Ana Guerra Langan
am 19 Nov. 2019
Did you find a way to do it in the end? I have the same problem at the moment and trying to figure out how to proceed...
- Should I manually create a loop for each batch of data and run the train inside it for each batch for say 100 epochs each and then use the trained network as input for the next batch?
- Should I just move to deep learning even though my data has nothing to do with images and I don't think I need an architecture that is that deep?
- Or should I run the batch loop for just one single epoch adn then repeat this for so many iterations?
I'm also not sure how to deal with the validation set, since I have a separate batch of data for validation...
Siehe auch
Kategorien
Mehr zu Image Data Workflows finden Sie in Help Center und File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!