Can develop MapReduce program by MATLAB run effectively with Hadoop?

1 Ansicht (letzte 30 Tage)
Mohammad Al Nagdawi
Mohammad Al Nagdawi am 10 Feb. 2018
Beantwortet: Kojiro Saito am 11 Feb. 2018
Hadoop by default support Java, C++, and python. However, I developed an algorithm using Matlab to deal with normal size data, later I decide to scale my algorithm using MapReduce to deal with big data.
I want to continue my work in Matlab, but I don't know if Matlab fully and smoothly supports Hadoop or not, therefore I want to hear advice from experts before it's too late.

Antworten (1)

Kojiro Saito
Kojiro Saito am 11 Feb. 2018
MATLAB does support MapReduce on Hadoop with MATLAB Compiler OR Parallel Computing Toolbox / MATLAB Distributed Computing Server.
(1) MATLAB Compiler
With MATLAB Compiler, you can create compiled MapReduce applications. This is a compiled application, so you can execute it with MATLAB Runtime.
(2) Parallel Computing Toolbox / MATLAB Distributed Computing Server With these parallel products, you can scale up your mapreduce algorithm to Hadoop.
Before executing mapreduce, it's needed to configure mapreducer environment, for example,
setenv('HADOOP_HOME', '/path/to/hadoop_home/');
cluster = parallel.cluster.Hadoop;
mr = mapreducer(cluster);
For detail, please see this doc: Run mapreduce on a Hadoop Cluster

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by