Contractive autoencoders
Contractive autoencoder CAE adds an explicit regularizer in their objective function that forces the model to learn a function that is robust to slight variations of input values. This regularizer corresponds to the Frobenius norm of the Jacobian matrix of the encoder activations with respect to the input. The CAE in this code uses Extreme Learning Machine to minimize the following objective function:
RMSE((f(H+lamda*norm((Dx'.*HT'),'fro'))*Beta)-Targets)
(The parameters of the function are explained inside the code).
The uploaded file contains:
1- An ordinary AE which can be used for comparison.
2- Contractive AE function.
3- Jacobian matrix function downloaded from this link :
https://www.mathworks.com/matlabcentral/fileexchange/13490-adaptive-robust-numerical-differentiation
4- Data normalization function.
To learn about the CAES you can start with this tutorial:
https://www.youtube.com/watch?v=79sYlJ8Cvlc&feature=youtu.be
Zitieren als
BERGHOUT Tarek (2024). Contractive autoencoders (https://www.mathworks.com/matlabcentral/fileexchange/71257-contractive-autoencoders), MATLAB Central File Exchange. Abgerufen .
Kompatibilität der MATLAB-Version
Plattform-Kompatibilität
Windows macOS LinuxKategorien
- AI, Data Science, and Statistics > Deep Learning Toolbox > Function Approximation, Clustering, and Control > Function Approximation and Clustering > Autoencoders >
Tags
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!Live Editor erkunden
Erstellen Sie Skripte mit Code, Ausgabe und formatiertem Text in einem einzigen ausführbaren Dokument.
CAE-ELM
Version | Veröffentlicht | Versionshinweise | |
---|---|---|---|
1.2.0 | some comments updated |
|
|
1.1.0 | the optimization equation is:B=pinv((H+lamda*norm((Dx'.*HT'),'fro'))') * X ;
|
||
1.0.0 |