Speech Command Recognition Code Generation with Intel MKL-DNN Using Simulink
This example demonstrates how to deploy feature extraction and a convolutional neural network (CNN) for speech command recognition on Intel® processors. To generate the feature extraction and network code, you use Embedded Coder in Simulink® and the Intel® Math Kernel Library for Deep Neural Networks (MKL-DNN). In this example you generate
Software-in-the-loop (SIL) code for a reference model which performs feature extraction and predicts the speech command. The generated
SIL code is called in a Simulink model which displays the predicted speech command and predicted scores for the given inputs. For details about audio preprocessing and network training, see Speech Command Recognition Using Deep Learning (Audio Toolbox).
The Matlab® Coder Interface for Deep Learning Libraries
Intel Processor with support for Advanced Vector Extension 2 (AVX2)
Intel Math Kernel Library for Deep Neural Networks (MKL-DNN)
Environment Variables for Intel MKL-DNN
For supported versions of libraries and for information about setting up environment variables, see Prerequisites for Deep Learning with MATLAB Coder (MATLAB Coder) (MATLAB Coder).
Prepare Simulink Model to Deploy
Create a Simulink model and capture the feature extraction, convolutional neural network and postprocessing as developed in Speech Command Recognition in Simulink (Audio Toolbox). This model is shipped with this example. Open the shipped model to understand its configurations.
modelToDeploy = "recognizeSpeechCommand"; open_system(modelToDeploy)
Set the Data type, Port dimensions, Sample time, and Signal type of the input port block as shown.
Configure Code Generation Settings
recognizeSpeechCommand model. Go to the MODELING Tab and click on Model Settings or press Ctrl+E. Select Code Generation and set the System Target File to
ert.tlc whose Description is
Embedded Coder. Set the Language to
C++, which will automatically set the Language Standard to
set_param to configure the settings programmatically,
set_param(modelToDeploy,SystemTargetFile="ert.tlc") set_param(modelToDeploy,TargetLang="C++") set_param(modelToDeploy,TargetLangStandard="C++11 (ISO)")
To set Intel MKL-DNN Deep Learning Config, expand Code Generation and select Interface. Now set the Deep Learning Target Library to
MKL-DNN as shown.
set_param to configure the Deep learning target library programmatically.
Select a solver that supports code generation. Set Solver to
auto (Automatic solver selection) and Solver type to
In Configuration > Hardware Implementation, set Device vendor to
Intel and Device type to
x86-64 (Windows64) or
x86-64 (Linux 64) or
x86-64 (Mac OS X) depending on your target system. Alternatively, use
set_param to configure the settings programmatically.
switch(computer("arch")) case "win64" ProdHWDeviceType = "Intel->x86-64 (Windows64)"; case "glnxa64" ProdHWDeviceType = "Intel->x86-64 (Linux 64)"; case "maci64" ProdHWDeviceType = "Intel->x86-64 (Mac OS X)"; end set_param(modelToDeploy, "ProdHWDeviceType", ProdHWDeviceType)
To automate setting the Device type, add the above code in Property Inspector > Properties > Callbacks > PreLoadFcn of the
Use Embedded Coder app to generate and build the code. Click on APPS tab and then click on Embedded coder as shown.
It will open a new C++ CODE tab, then click on Build to generate and build the code. It will generate the code in a folder named
recognizeSpeechCommand_ert_rtw. After generating the code, you view the report by clicking on Open Report.
Alternatively, you can use
slbuild to generate the code programatically.
### Starting build procedure for: recognizeSpeechCommand ### Generating code and artifacts to 'Model specific' folder structure ### Generating code into build folder: W:\Ex\ExampleManager\sporwal.Bdoc22a.j1852731\deeplearning_shared-ex14618832\recognizeSpeechCommand_ert_rtw ### Generated code for 'recognizeSpeechCommand' is up to date because no structural, parameter or code replacement library changes were found. ### Saving binary information cache. ### Skipping makefile generation and compilation because W:\Ex\ExampleManager\sporwal.Bdoc22a.j1852731\deeplearning_shared-ex14618832\recognizeSpeechCommand.exe is up to date ### Successful completion of build procedure for: recognizeSpeechCommand Build Summary 0 of 1 models built (1 models already up to date) Build duration: 0h 0m 50.396s
Now close the
Create a Simulink Model that Calls
recognizeSpeechCommand and Displays its Output
Create a new simulink model and add
recognizeSpeechCommand as a model reference block to it. Add the same base workspace variables, source blocks, and sink blocks as developed in Speech Command Recognition in Simulink (Audio Toolbox). Use a
radio button group for selecting speech command files. For your reference, this model is shipped with this example. Open the same simulink model.
mainModel = "slexSpeechCommRecognitionCodegenWithMklDnnExample"; open_system(mainModel)
To set the
Software-in-the-loop (SIL) simulation mode for the model reference block, click on MODELING tab.
Now click on the drop-down button as shown above, and it will open a window. Select Property Inspector as shown below.
You will get a Property Inspector window at the right of your model. Click on the Model block to get its Property Inspector. If the * Model name* is not set, browse for the
recognizeSpeechCommand.slx and set the Model name. Now set Simulation mode to
Software-in-the-loop (SIL) as shown.
Run the model to deploy the
recognizeSpeechCommand.slx on your computer and perform speech command recognition.
### Starting serial model reference code generation build ### Starting build procedure for: recognizeSpeechCommand ### Generating code and artifacts to 'Model specific' folder structure ### Code for the model reference code generation target for model recognizeSpeechCommand is up to date because no functional changes were found in the referenced model. ### Saving binary information cache. ### Model reference code generation target for recognizeSpeechCommand is up to date. Build Summary 0 of 1 models built (1 models already up to date) Build duration: 0h 0m 15.152s ### Preparing to start SIL simulation ... ### Skipping makefile generation and compilation because W:\Ex\ExampleManager\sporwal.Bdoc22a.j1852731\deeplearning_shared-ex14618832\slprj\ert\recognizeSpeechCommand\sil\recognizeSpeechCommand.exe is up to date ### Starting SIL simulation for component: recognizeSpeechCommand ### Application stopped ### Stopping SIL simulation for component: recognizeSpeechCommand ans = Simulink.SimulationOutput: SimulationMetadata: [1x1 Simulink.SimulationMetadata] ErrorMessage: [0x0 char]
Now close the
Other Things to Try
Simulate Speech Command Recognition in Simulink (Audio Toolbox) model using Intel®
MKL-DNNlibrary by setting the Configuration > Simulation Target > Language to
Copyright 2021 The MathWorks, Inc.