Apache MRQL can run in four modes: in Map-Reduce mode using Apache Hadoop, in BSP mode (Bulk Synchronous Parallel mode) using Apache Hama, in Spark mode using Apache Spark, and in Flink mode using Apache Flink.
The MRQL MapReduce mode has been tested on Apache Hadoop MapReduce releases 1.x, and 2.x (Yarn). You can download the latest tarball from Apache Hadoop. The BSP mode has been tested on Apache Hama 0.6.2, 0.6.3, 0.6.4, and 0.7.0. You can download the latest tarball from Apache Hama. The Spark mode has been tested on Apache Spark 1.0.0 through 1.6.0 in local, standalone deploy, and Yarn modes. You can download the latest tarball prebuilt for Hadoop1 or Hadoop2 from Apache Spark. The Flink mode has been tested on 0.10.1 and 0.10.2 in local and Yarn modes. You can download the latest tarball prebuilt for Hadoop2 from Apache Flink.
The following instructions assume that you have already installed Apache Hadoop MapReduce and you have deployed it on your cluster successfully.
Download the latest stable MRQL binary release from http://www.apache.org/dyn/closer.cgi/incubator/mrql and extract the files. The scripts bin/mrql, bin/mrql.bsp, bin/mrql.spark, and bin/mrql.flink evaluate MRQL queries in Hadoop, Hama, Spark, and Flink modes, respectively.
Change the configuration file conf/mrql-env.sh to match your Hadoop installation. For a test, run the PageRank example or the k-means clustering example on a small Hadoop MapReduce cluster.
Follow the instructions in Getting Started with Hama to set up and start Hama. Change the configuration file conf/mrql-env.sh to match your Hama installation. For a test, run the PageRank example or the k-means clustering example on a Hama cluster.
Follow the instructions in Spark Standalone Mode to set up and start Apache Spark in standalone deploy mode. Change the configuration file conf/mrql-env.sh to match your Spark installation. For a test, run the PageRank example or the k-means clustering example on a Spark cluster.
Set SPARK_MASTER=yarn-client in conf/mrql-env.sh (see Running Spark on YARN).
First, start the Flink application manager on Yarn using ${FLINK_HOME}/bin/yarn-session.sh -n #_of_nodes (see Yarn Setup). Then run the PageRank example using the bin/mrql.flink script.
Download the latest stable MRQL source release from http://www.apache.org/dyn/closer.cgi/incubator/mrql and extract the files. You can get the latest source code using:
git clone https://git-wip-us.apache.org/repos/asf/incubator-mrql.git