Datastore
The datastore function creates a datastore, which is a repository for collections of data that are too large to fit in memory. A datastore allows you to read and process data stored in multiple files on a disk, a remote location, or a database as a single entity. If the data is too large to fit in memory, you can manage the incremental import of data, create a tall array to work with the data, or use the datastore as an input to mapreduce for further processing. For more information, see Getting Started with Datastore.
Funktionen
Klassen
Themen
- Getting Started with Datastore
A datastore is an object for reading a single file or a collection of files or data.
- Select Datastore for File Format or Application
Choose the right datastore based on the file format of your data or application.
- Read and Analyze Large Tabular Text File
This example shows how to create a datastore for a large text file containing tabular data, and then read and process the data one block at a time or one file at a time.
- Read and Analyze Image Files
This example shows how to create a datastore for a collection of images, read the image files, and find the images with the maximum average hue, saturation, and brightness (HSV).
- Read and Analyze MAT-File with Key-Value Data
This example shows how to create a datastore for key-value pair data in a MAT-file that is the output of
mapreduce. - Read and Analyze Hadoop Sequence File
This example shows how to create a datastore for a Sequence file containing key-value data.
- Work with Remote Data
Work with remote data in Amazon S3™, Azure® Blob Storage, or HDFS™.
- Set Up Datastore for Processing on Different Machines or Clusters
Setup a datastore on your machine that can be loaded and processed on another machine or cluster.
- Develop Custom Datastore
Create a fully customized datastore for your custom or proprietary data.
- Develop Custom Datastore for DICOM Data
This example shows how to develop a custom datastore that supports writing operations.
- Testing Guidelines for Custom Datastores
After implementing your custom datastore, follow this test procedure to qualify your custom datastore.
Verwandte Informationen
You can also select a web site from the following list:
Americas
- América Latina (Español)
- Canada (English)
- United States (English)
Europe
- Belgium (English)
- Denmark (English)
- Deutschland (Deutsch)
- España (Español)
- Finland (English)
- France (Français)
- Ireland (English)
- Italia (Italiano)
- Luxembourg (English)
- Netherlands (English)
- Norway (English)
- Österreich (Deutsch)
- Portugal (English)
- Sweden (English)
- Switzerland
- United Kingdom (English)