MATLAB distributed computing server

Hello. Have a nice time. I've worked on data center clustering in the framework mapreduce.I wrote the program at MATLAB. And I want to use spark + hadoop with a quasi-distributive cluster. Does this need to install MATLAB distributed compute server?

Answer 1

[Kojiro Saito]

if you're using mapreduce and want to run in Hadoop, you don't need Spark.

There are two options.

1. Use MATLAB Parallel Server (MATLAB Distributed Computing Server until R2018b)

Please see document: Run mapreduce on a Hadoop Cluster.

2. Use MATLAB Compiler to create mapreduce standalone application.

Please see document: MapReduce Applications on Hadoop Clusters

If you want to scale out tall array to Spark, there are two options.

1. Use MATLAB Parallel Server with Hadoop/Spark

Please see document: se Tall Arrays on a Spark Enabled Hadoop Cluster

2. Use MATLAB Compiler with Hadoop/Spark

Please see document: Deploy Tall Arrays to a Spark Enabled Hadoop Cluster

Also, if you want to create stanalone applications wihch use MATLAB API for Spark,

1. Use MATLAB Compiler with Hadoop/Spark

Please see document: Deploy Applications Using the MATLAB API for Spark

[adele sharifi]

Hello. Thanks for the your answer. Need to install MATLAB computing server to use Hadoop or Spark? Because I do not have permission to install. I do not have access. Without a server and just one pc there is a possibility to test my program?

[Kojiro Saito]

Yes, in order to run mapreduce or tall in Hadoop/Spark, installation of MATLAB Parallel Server is necessesary even though just one PC.

[adele sharifi]

What is the way to install? My profile is not allowed to access and download.

[Kojiro Saito]

Are you able to download an installer from here?

[adele sharifi]

Unfortunately, is it possible for me to email Matlab's distributed computing server?

[Kojiro Saito]

You can contact Customer Support team from here and ask how you can get installer.