Train Logistic Regression Classifiers Using Classification Learner App
This example shows how to construct logistic regression classifiers in the
Classification Learner app, using the
ionosphere data set that
contains two classes. You can use logistic regression with two classes in Classification
Learner. In the
ionosphere data, the response variable is categorical
with two levels:
g represents good radar returns, and
b represents bad radar returns.
In MATLAB®, load the
ionospheredata set and define some variables from the data set to use for a classification.
load ionosphere ionosphere = array2table(X); ionosphere.Group = Y;
Alternatively, you can load the
ionospheredata set and keep the
Ydata as separate variables.
On the Apps tab, in the Machine Learning and Deep Learning group, click Classification Learner.
On the Classification Learner tab, in the File section, click New Session > From Workspace.
In the New Session from Workspace dialog box, select the table
ionospherefrom the Data Set Variable list. Observe that the app has selected
Groupfor the response variable, and the rest as predictors.
Grouphas two levels.
Alternatively, if you kept your predictor data
Xand response variable
Yas two separate variables, you can first select the matrix
Xfrom the Data Set Variable list. Then, under Response, click the From workspace option button and select
Yfrom the list. The
Yvariable is the same as the
Click Start Session.
Classification Learner creates a scatter plot of the data.
Use the scatter plot to visualize which variables are useful for predicting the response. Select different variables in the X- and Y-axis controls. Observe which variables separate the class colors most clearly.
To train the logistic regression classifier, on the Classification Learner tab, in the Models section, click the down arrow to expand the list of classifiers, and under Logistic Regression Classifiers, click Logistic Regression. Then, in the Train section, click Train All and select Train All.
If you have Parallel Computing Toolbox™, then the app has the Use Parallel button toggled on by default. After you click Train All and select Train All or Train Selected, the app opens a parallel pool of workers. During this time, you cannot interact with the software. After the pool opens, you can continue to interact with the app while models train in parallel.
If you do not have Parallel Computing Toolbox, then the app has the Use Background Training check box in the Train All menu selected by default. After you click to train models, the app opens a background pool. After the pool opens, you can continue to interact with the app while models train in the background.
Classification Learner trains the model as well as the default fine tree model. The app outlines in a box the Accuracy (Validation) score of the best model. Classification Learner also displays a validation confusion matrix for the logistic regression model.
Validation introduces some randomness into the results. Your model validation results can vary from the results shown in this example.
To view the results for the model, inspect the Summary tab. On the Classification Learner tab, in the Models section, click Summary. The Summary tab displays the Training Results metrics, calculated on the validation set.
Examine the scatter plot for the trained model. On the Classification Learner tab, in the Plots section, click the arrow to open the gallery, and then click Scatter in the Validation Results group. Try plotting different predictors. Misclassified points are shown as an X.
Inspect the accuracy of the predictions in each class. On the Classification Learner tab, in the Plots section, click the arrow to open the gallery, and then click Confusion Matrix (Validation) in the Validation Results group. View the matrix of true class and predicted class results.
Choose the best model in the Models pane (the best score is highlighted in a box). To improve the model, try including different features in the model. See if you can improve the model by removing features with low predictive power.
First duplicate the best model. On the Classification Learner tab, in the Models section, click Duplicate.
To investigate features to include or exclude, use the parallel coordinates plot. On the Classification Learner tab, in the Plots section, click the arrow to open the gallery, and then click Parallel Coordinates in the Validation Results group. Keep predictors that separate classes well.
You can specify the predictors to use during training in the model Summary tab. Click Feature Selection to expand the section, and specify predictors to remove from the model.
Alternatively, you can use a feature ranking algorithm to determine which features to use during model training. On the Classification Learner tab, in the Options section, click Feature Selection. In the Default Feature Selection tab, specify the feature ranking algorithm you want to use. Specify the number of features to keep among the highest ranked features. You can use the bar graph to help you decide how many features to use.
Click Save and Apply to save your changes. The new feature selection is applied to the existing draft model in the Models pane and will be applied to new draft models that you create using the gallery in the Models section of the Classification Learner tab.
Train the model. On the Classification Learner tab, in the Train section, click Train All and select Train Selected to train the model using the new options. Compare results among the classifiers in the Models pane.
You can export a full or compact version of the trained model to the workspace. On the Classification Learner tab, in the Export section, click Export Model and select either Export Model or Export Compact Model. See Export Classification Model to Predict New Data.
To examine the code for training this classifier, click Generate Function.
Use the same workflow to evaluate and compare the other classifier types you can train in Classification Learner.
To try all the nonoptimizable classifier model presets available for your data set:
On the Classification Learner tab, in the Models section, click the arrow to open the gallery of classification models.
In the Get Started group, click All. Then, in the Train section, click Train All and select Train All.
To learn about other classifier types, see Train Classification Models in Classification Learner App.
- Train Classification Models in Classification Learner App
- Select Data for Classification or Open Saved App Session
- Choose Classifier Options
- Logistic Regression
- Feature Selection and Feature Transformation Using Classification Learner App
- Assess Classifier Performance in Classification Learner
- Export Classification Model to Predict New Data
- Train Decision Trees Using Classification Learner App