Xception convolutional neural network - training error (crash after two weeks)

7 Ansichten (letzte 30 Tage)
I was runnig Xception convolutional neural network for image classification of large dataset (around 1,500,000 images).
AMD Ryzen 9 7950X CPU, 128 Gb of RAM (Crucial Desktop DDR5-4800 UDIMM 1.1V CL40, CT2K32G48C40U5 x2; Crucial Japan, Micron, Tokyo, Japan), and an Nvidia GeForce RTX 4090 graphics card (ASUS ROG Strix GeForce RTX® 4090 OC Edition 24GB GDDR6X
Matlab r2023b update 10
Windows 10
Standard setup, solver sgdm, learning rate 0.001, minibath size 128, validation freq 50.
I was following the training/validation using the training plot that updates itself. After 2 weeks I was reaching the plateu, after 3 epochs. And was planning to stop at 5 epochs. However, the following day in the morning I found the training had stopped prematurely.
First I blamed windows 10 (had it reboot?) or a small earthquake (electromagnetic pulse?). But the log file tells different.
Faulting application name: MATLABWindow.exe, version: 23.2.0.0, time stamp: 0xe60e8bb5
Faulting module name: libcef.dll, version: 104.4.34.0, time stamp: 0x62fa72be
Maybe the system was reaching its limit and a better hardware is necessary.
Any idea?
As I understand, Matlab is not keeping safety "images" of the training process in case the program is closed prior completion.
It is fine as I am running it again, but I "wasted" two weeks of training.
Thank you.
Log Name: Application
Source: Application Error
Date: 2025/07/24 21:44:07
Event ID: 1000
Task Category: Application Crashing Events
Level: Error
Keywords:
User: S-1-5-21-3219398866-3575950627-3689656050-1001
Computer: DESKTOP-HNQCUK8
Description:
Faulting application name: MATLABWindow.exe, version: 23.2.0.0, time stamp: 0xe60e8bb5
Faulting module name: libcef.dll, version: 104.4.34.0, time stamp: 0x62fa72be
Exception code: 0xc0000005
Fault offset: 0x000000000229c84c
Faulting process id: 0x0x2908
Faulting application start time: 0x0x1dbf2380b93f22e
Faulting application path: C:\Program Files\MATLAB\R2023b\bin\win64\MATLABWindow.exe
Faulting module path: C:\Program Files\MATLAB\R2023b\bin\win64\libcef.dll
Report Id: 43229cdb-1fa4-409f-9582-d234a55cf224
Faulting package full name:
Faulting package-relative application ID:
Event Xml:
<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
<System>
<Provider Name="Application Error" Guid="{a0e9b465-b939-57d7-b27d-95d8e925ff57}" />
<EventID>1000</EventID>
<Version>0</Version>
<Level>2</Level>
<Task>100</Task>
<Opcode>0</Opcode>
<Keywords>0x8000000000000000</Keywords>
<TimeCreated SystemTime="2025-07-24T12:44:07.7995586Z" />
<EventRecordID>9796</EventRecordID>
<Correlation />
<Execution ProcessID="6980" ThreadID="6736" />
<Channel>Application</Channel>
<Computer>DESKTOP-HNQCUK8</Computer>
<Security UserID="S-1-5-21-3219398866-3575950627-3689656050-1001" />
</System>
<EventData>
<Data Name="AppName">MATLABWindow.exe</Data>
<Data Name="AppVersion">23.2.0.0</Data>
<Data Name="AppTimeStamp">e60e8bb5</Data>
<Data Name="ModuleName">libcef.dll</Data>
<Data Name="ModuleVersion">104.4.34.0</Data>
<Data Name="ModuleTimeStamp">62fa72be</Data>
<Data Name="ExceptionCode">c0000005</Data>
<Data Name="FaultingOffset">000000000229c84c</Data>
<Data Name="ProcessId">0x2908</Data>
<Data Name="ProcessCreationTime">0x1dbf2380b93f22e</Data>
<Data Name="AppPath">C:\Program Files\MATLAB\R2023b\bin\win64\MATLABWindow.exe</Data>
<Data Name="ModulePath">C:\Program Files\MATLAB\R2023b\bin\win64\libcef.dll</Data>
<Data Name="IntegratorReportId">43229cdb-1fa4-409f-9582-d234a55cf224</Data>
<Data Name="PackageFullName">
</Data>
<Data Name="PackageRelativeAppId">
</Data>
</EventData>
</Event>

Antworten (1)

Jacob Mathew
Jacob Mathew am 30 Jul. 2025
You can check out the crash logs by following the steps in the below MATLAB Answers post:
Share this crash log file with MathWorks Customer Support:

Kategorien

Mehr zu Image Data Workflows finden Sie in Help Center und File Exchange

Produkte


Version

R2023b

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by