• Apache
• /
• Apache Incubator
• /
• MRQL - A Query Processing and Optimization System
• Last Published: 2017-04-22
• |
• Version: 0.9.8-incubating-SNAPSHOT

MRQL is a query processing and optimization system for large-scale, distributed data analysis, built on top of Apache Hadoop, Hama, Spark, and Flink.

MRQL (pronounced miracle) is a query processing and optimization system for large-scale, distributed data analysis. MRQL (the MapReduce Query Language) is an SQL-like query language for large-scale data analysis on a cluster of computers. The MRQL query processing system can evaluate MRQL queries in four modes:

1. in Map-Reduce mode using Apache Hadoop,
2. in BSP mode (Bulk Synchronous Parallel mode) using Apache Hama,
3. in Spark mode using Apache Spark, and
4. in Flink mode using Apache Flink.

The MRQL query language is powerful enough to express most common data analysis tasks over many forms of raw in-situ data, such as XML and JSON documents, binary files, and CSV documents. MRQL is more powerful than other current high-level MapReduce languages, such as Hive and PigLatin, since it can operate on more complex data and supports more powerful query constructs, thus eliminating the need for using explicit MapReduce code. With MRQL, users are able to express complex data analysis tasks, such as PageRank, k-means clustering, matrix factorization, etc, using SQL-like queries exclusively, while the MRQL query processing system is able to compile these queries to efficient Java code.

The latest stable release MRQL-0.9.6-incubating can be downloaded from the ASF. You can verify the integrity of the downloaded files using the SHA1 or MD5 signatures. The signatures should be matched against the KEYS file. Older releases may be found in the archives. Detailed installation instructions can be found at the Getting Started page.

• 2013-03-13: MRQL project enters Apache Incubation.
• 2013-10-31: First release, MRQL-0.9.0-incubating (release notes)
• 2014-06-26: Second release, MRQL-0.9.2-incubating (release notes)
• 2015-02-25: Third release, MRQL-0.9.4-incubating (release notes)
• 2016-03-02: Fourth release, MRQL-0.9.6-incubating (release notes)

Apache MRQL is an effort undergoing incubation at The Apache Software Foundation (ASF) sponsored by the Apache Incubator PMC. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF.