Rise of Big Data

Predictive analytics is often discussed in the context of big data, Engineering data, for example, comes from sensors, instruments, and connected systems out in the world. Business system data at a company might include transaction data, sales results, customer complaints, and marketing information. Increasingly, businesses make data-driven decisions based on this valuable trove of information.

Increasing Competition

With increased competition, businesses seek an edge in bringing products and services to crowded markets. Data-driven predictive models can help companies solve long-standing problems in new ways.

Equipment manufacturers, for example, can find it hard to innovate in hardware alone. Product developers can add predictive capabilities to existing solutions to increase value to the customer. Using predictive analytics for equipment maintenance, or predictive maintenance, can anticipate equipment failures, forecast energy needs, and reduce operating costs. For example, sensors that measure vibrations in automotive parts can signal the need for maintenance before the vehicle fails on the road.

Companies also use predictive analytics to create more accurate forecasts, such as forecasting the demand for electricity on the electrical grid. These forecasts enable resource planning (for example, scheduling of various power plants), to be done more effectively.

Cutting-Edge Technologies for Big Data and Machine Learning

To extract value from big data, businesses apply algorithms to large data sets using tools such as Hadoop and Spark. The data sources might consist of transactional databases, equipment log files, images, video, audio, sensor, or other types of data. Innovation often comes from combining data from several sources.

With all this data, tools are necessary to extract insights and trends. Machine learning techniques are used to find patterns in data and to build models that predict future outcomes. A variety of machine learning algorithms are available, including linear and nonlinear regression, neural networks, support vector machines, decision trees, and other algorithms.

Predictive Analytics Examples

Predictive analytics helps teams in industries as diverse as finance, healthcare, pharmaceuticals, automotive, aerospace, and manufacturing.

• Automotive – Breaking new ground with autonomous vehicles
  Companies developing driver assistance technology and new autonomous vehicles use predictive analytics to analyze sensor data from connected vehicles and to build driver assistance algorithms.
• Aerospace – Monitoring aircraft engine health
  To improve aircraft up-time and reduce maintenance costs, an engine manufacturer created a real-time analytics application to predict subsystem performance for oil, fuel, liftoff, mechanical health, and controls.
• Energy Production – Forecasting electricity price and demand
  Sophisticated forecasting apps use models that monitor plant availability, historical trends, seasonality, and weather.
• Financial Services – Developing credit risk models
  Financial institutions use machine learning techniques and quantitative tools to predict credit risk.
• Industrial Automation and Machinery – Predicting machine failures
  A plastic and thin film producer saves 50,000 Euros monthly using a health monitoring and predictive maintenance application that reduces downtime and minimizes waste.
• Medical Devices – Using pattern-detection algorithms to spot asthma and COPD
  An asthma management device records and analyzes patients' breathing sounds and provides instant feedback via a smart phone app to help patients manage asthma and COPD.

Predictive analytics is the process of using data analytics to make predictions based on data. This process uses data along with analysis, statistics, and machine learning techniques to create a predictive model for forecasting future events.

The term “predictive analytics” describes the application of a statistical or machine learning technique to create a quantitative prediction about the future. Frequently, supervised machine learning techniques are used to predict a future value (How long can this machine run before requiring maintenance?) or to estimate a probability (How likely is this customer to default on a loan?).

Predictive analytics starts with a business goal: to use data to reduce waste, save time, or cut costs. The process harnesses heterogeneous, often massive, data sets into models that can generate clear, actionable outcomes to support achieving that goal, such as less material waste, less stocked inventory, and manufactured product that meets specifications.

Predictive Analytics Workflow

We are all familiar with predictive models for weather forecasting. A vital industry application of predictive models relates to energy load forecasting to predict energy demand. In this case, energy producers, grid operators, and traders need accurate forecasts of energy load to make decisions for managing loads in the electric grid. Vast amounts of data are available, and using predictive analytics, grid operators can turn this information into actionable insights.

Step-By-Step Workflow for Predicting Energy Loads

Typically, the workflow for a predictive analytics application follows these basic steps:

1. Import data from varied sources, such as web archives, databases, and spreadsheets.
   Data sources include energy load data in a CSV file and national weather data showing temperature and dew point.
2. Clean the data by removing outliers and combining data sources.
   Identify data spikes, missing data, or anomalous points to remove from the data. Then aggregate different data sources together – in this case, creating a single table including energy load, temperature, and dew point.
3. Develop an accurate predictive model based on the aggregated data using statistics, curve fitting tools, or machine learning.
   Energy forecasting is a complex process with many variables, so you might choose to use neural networks to build and train a predictive model. Iterate through your training data set to try different approaches. When the training is complete, you can try the model against new data to see how well it performs.
4. Integrate the model into a load forecasting system in a production environment.
   Once you find a model that accurately forecasts the load, you can move it into your production system, making the analytics available to software programs or devices, including web apps, servers, or mobile devices.

Developing Predictive Models

Your aggregated data tells a complex story. To extract the insights it holds, you need an accurate predictive model.

Predictive modeling uses mathematical and computational methods to predict an event or outcome. These models forecast an outcome at some future state or time based upon changes to the model inputs. Using an iterative process, you develop the model using a training data set and then test and validate it to determine its accuracy for making predictions. You can try out different machine learning approaches to find the most effective model.

Examples include time-series regression models for predicting airline traffic volume or predicting fuel efficiency based on a linear regression model of engine speed versus load.

Predictive Analytics vs. Prescriptive Analytics

Organizations that have successfully implemented predictive analytics see prescriptive analytics as the next frontier. Predictive analytics creates an estimate of what will happen next; prescriptive analytics tells you how to react in the best way possible given the prediction.

Prescriptive analytics is a branch of data analytics that uses predictive models to suggest actions to take for optimal outcomes. Prescriptive analytics relies on optimization and rules-based techniques for decision making. Forecasting the load on the electric grid over the next 24 hours is an example of predictive analytics, whereas deciding how to operate power plants based on this forecast represents prescriptive analytics.

To unlock the value of business and engineering data to make informed decisions, teams developing predictive analytics applications increasingly turn to MATLAB.

Using MATLAB tools and functions, you can perform predictive analytics with engineering, scientific, and field data, as well as business and transactional data. With MATLAB, you can deploy predictive applications to large-scale production systems, and embedded systems.

Why Use MATLAB for Predictive Analytics?

1. MATLAB analytics work with both business and engineering data.
   MATLAB has native support for sensor, image, video, telemetry, binary, and other real-time formats. Explore this data using MATLAB Tall arrays for Hadoop and Spark, and by connecting interfaces to ODBC/JDBC databases.
2. MATLAB lets engineers do data science themselves.
   Enable your domain experts to do data science, with powerful tools to help them do machine learning, deep learning, statistics, optimization, signal analysis, and image processing.
3. MATLAB analytics run in embedded systems.
   Develop analytics to run on embedded platforms, by creating portable C and C++ code from MATLAB code.
4. MATLAB analytics deploy to enterprise IT systems.
   MATLAB integrates into enterprise systems, clusters, and clouds, with a royalty-free deployable runtime.

Your Data + MATLAB = Success with Predictive Analytics

In this simplified view, engineering data arrives from sensors, instruments, and connected systems out in the world. The data is collected and stored in a file system either in-house or in the cloud. 

This data is combined with data sourced from traditional business systems such as cost data, sales results, customer complaints, and marketing information.

After this, the analytics are developed by an engineer or domain expert using MATLAB. Preprocessing is almost always required to deal with missing data, outliers, or other unforeseen data quality issues. Following that, analytics methods such as statistics and machine learning are used to produce an “analytic”–a predictive model of your system.

To be useful, that predictive model is then deployed—either in a production IT environment feeding a real-time transactional or IT system such as an e-commerce site or to an embedded device—a sensor, a controller, or a smart system in the real-world such as an autonomous vehicle.

Applying MATLAB and Simulink^® as part of this architecture is ideal, because the tools enable easy deployment paths to embedded systems with Model-Based Design, or to IT systems with application deployment products.