Construct full RGB pixel data from Bayer pattern pixel stream
System object™ constructs the full RGB pixel values from a Bayer pattern pixel stream.
You can select a low-complexity bilinear interpolation or a moderate-complexity
gradient-corrected bilinear interpolation. The object implements the calculations using
hardware-efficient algorithms for HDL code generation.
The object performs bilinear interpolation on a 3-by-3 pixel window using only additions and bit shifts.
The object performs gradient correction on a 5-by-5 pixel window. The object implements the calculation using bit shifts, additions, and low-order canonical signed digit (CSD) multiplication.
To construct full RGB pixel data from a Bayer pattern pixel stream:
visionhdl.DemosaicInterpolator object and set its properties.
Call the object with arguments, as if it were a function.
To learn more about how System objects work, see What Are System Objects?
creates a System object that interpolates RGB data from a Bayer pattern pixel
bayerInterpolator = visionhdl.DemosaicInterpolator
sets properties using one or more name-value arguments. For example,
bayerInterpolator = visionhdl.DemosaicInterpolator(
'SensorAlignment','RGGB' specifies the pattern of the RGB
pixels in the input stream.
Unless otherwise indicated, properties are nontunable, which means you cannot change their
values after calling the object. Objects lock when you call them, and the
release function unlocks them.
If a property is tunable, you can change its value at any time.
For more information on changing property values, see System Design in MATLAB Using System Objects.
InterpolationAlgorithm— Algorithm to calculate the missing pixel values
'Gradient-corrected linear'(default) |
Algorithm to calculate the missing pixel values, specified as one of these values.
'Bilinear' — Average of the pixel values
in the surrounding 3-by-3 neighborhood
'Gradient-corrected linear' (default) —
Bilinear average, corrected for intensity gradient
SensorAlignment— Color sequence of the input pixels
Color sequence of the input pixels, specified as
'BGGR'. These values
consist of four letters,
B, that correspond to the 2-by-2 block of pixels in
the top-left corner of the input image. Specify the sequence in
left-to-right, top-to-bottom order. For example, the default value,
'RGGB', represents an image with this pattern.
LineBufferSize— Size of line memory buffer
2048(default) | positive integer
Size of line memory buffer, specified as a positive integer. Choose a power of two that accommodates the number of active pixels in a horizontal line. If you specify a value that is not a power of two, the buffer uses the next largest power of two.
When you set the
'Bilinear', the object allocates
LineBufferSize memory locations.
When you set the
'Gradient-corrected linear', the
object allocates 4-by-
This object uses a streaming pixel interface with a structure
for frame control signals. This interface enables the object to operate independently of image
size and format and to connect with other Vision HDL Toolbox™ objects. The object accepts and returns a scalar pixel value and control signals
as a structure containing five signals. The control signals indicate the validity of each pixel
and its location in the frame. To convert a pixel matrix into a pixel stream and control
signals, use the
visionhdl.FrameToPixels object. For a full
description of the interface, see Streaming Pixel Interface.
pixelin— Input pixel
Single input pixel, specified as an unsigned scalar integer. Images in
the Bayer format have one color component for each pixel location.
Select the sequence of R, G, and B pixels by using the
You can simulate System objects with a multipixel streaming interface, but System objects that use multipixel streams are not supported for HDL code generation. Use the equivalent blocks to generate HDL code for multipixel algorithms.
types are supported for simulation, but not for HDL code generation.
pixelout— Output pixel
Single output pixel, returned as a three-element vector of values in RGB color space.
The data type of
pixelout is the same as the data
To use an object function, specify the
System object as the first input argument. For
example, to release system resources of a System object named
This example shows how to construct full RGB pixel data from a Bayer pattern thumbnail image.
Set the dimensions of the test image. Load the source image file. This image is represented in a Bayer pattern, meaning each pixel is represented by one value, alternating green values with red and blue values. Select a portion of the image matching the desired test size. These offsets select the face of the person in the image.
frmActivePixels = 256; frmActiveLines = 192; frmOrig = imread('mandi.tif'); frmInput = frmOrig(900:899+frmActiveLines,2350:2349+frmActivePixels); figure imshow(frmInput) title 'Input Image'
Create a serializer object and specify the size of the inactive pixel regions.
frm2pix = visionhdl.FrameToPixels(... 'NumComponents',1, ... 'VideoFormat','custom', ... 'ActivePixelsPerLine',frmActivePixels, ... 'ActiveVideoLines',frmActiveLines, ... 'TotalPixelsPerLine',frmActivePixels+10, ... 'TotalVideoLines',frmActiveLines+10, ... 'StartingActiveLine',6, ... 'FrontPorch',5);
Create an interpolator object. Specify the sequence of color values matching the 2-by-2 pixels in the top-left corner of the image.
BayerInterpolator = visionhdl.DemosaicInterpolator(... 'SensorAlignment','RGGB');
Serialize the test image.
pixIn is a vector of pixel values.
ctrlIn is a vector of control signal structures.
[pixIn,ctrlIn] = frm2pix(frmInput);
Set up variables, and then generate the RGB triplet for each pixel in the stream. This example prints a progress message every 32 lines.
[pixels,lines,numPixelsPerFrame] = getparamfromfrm2pix(frm2pix); ctrlOut = repmat(pixelcontrolstruct,numPixelsPerFrame,1); pixOut = zeros(numPixelsPerFrame,3,'uint8'); lineCount = 1; for p = 1:numPixelsPerFrame if ctrlIn(p).hEnd lineCount = lineCount+1; if mod(lineCount,32)==0 fprintf('Processing line #%d\n',lineCount) end end [pixOut(p,:),ctrlOut(p)] = BayerInterpolator(pixIn(p),ctrlIn(p)); end
Processing line #32 Processing line #64 Processing line #96 Processing line #128 Processing line #160 Processing line #192
Create a deserializer object with a format that matches that of the serializer. Convert the pixel stream to an image frame, and then display the result.
pix2frm = visionhdl.PixelsToFrame(... 'NumComponents',3, ... 'VideoFormat','custom', ... 'ActivePixelsPerLine',frmActivePixels, ... 'ActiveVideoLines',frmActiveLines); [frmOutput,frmValid] = pix2frm(pixOut,ctrlOut); if frmValid figure imshow(frmOutput) title 'Output Image' end
This object implements the algorithms described on the Demosaic Interpolator block reference page.
This System object supports C/C++ code generation for accelerating MATLAB® simulations, and for DPI component generation. For more information about acceleration, see Accelerate a Pixel-Streaming Design Using MATLAB Coder. For more information about DPI component generation, see Considerations for DPI Component Generation with MATLAB (HDL Verifier).
To generate HDL code from Vision HDL Toolbox System objects, see Design a Hardware-Targeted Image Filter in MATLAB.
demosaic(Image Processing Toolbox)