Does DeepNetworkDesigner support Transformer Layers?
11 Ansichten (letzte 30 Tage)
Ältere Kommentare anzeigen
I want to add Transofmrer Layers while designing the network for deep learning using MATLAB DeepNetworkDesigner, but it doesn't show me such option. How can I add Transofmer Layers to the network designed using DeepNetworkDesigner?
0 Kommentare
Antworten (2)
Matt J
am 14 Jan. 2024
If the transformer layer is a custom layer that you have created for yourself, you would import it to deepNetworkDesigner from the workspace, as explained here,
0 Kommentare
David Ho
am 18 Jan. 2024
Hi Subhadip,
In R2023b, the following layers are supported in Deep Network Designer that are commonly used in transformers:
- selfAttentionLayer
- wordEmbeddingLayer (requires Text Analytics Toolbox)
- sinusoidalPositionEncodingLayer
- positionEmbeddingLayer
- embeddingConcatenationLayer
- indexing1dLayer
- patchEmbeddingLayer (requires Computer Vision Toolbox)
Best regards,
David
0 Kommentare
Siehe auch
Kategorien
Mehr zu Image Data Workflows finden Sie in Help Center und File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!