Apache Spark

Apache Spark™ is a fast and general engine for large-scale data processing. Speed Run programs up to 100x faster than Hadoop MapReduce in memory, or 10x faster on disk.

Free Open Source Mac OS X Windows Linux

Apache Flink

Flink’s core is a streaming dataflow engine that provides data distribution, communication, and fault tolerance for distributed computations over data streams.

Free Open Source Mac OS X Windows Linux BSD

Disco MapReduce

Disco is a lightweight, open-source framework for distributed computing based on the MapReduce paradigm and written in Python.

Free Open Source Mac OS X Windows Linux

Amazon Kinesis

Amazon Kinesis services make it easy to work with real-time streaming data in the AWS cloud.

Commercial Web

dispy

dispy is a Python framework for parallel execution of computations by distributing them across multiple processors on a single machine (SMP), among many machines in a...

Free Open Source Mac OS X Windows Linux

HPCC Systems

HPCC Systems offers an open source cluster computing platform used to solve Big Data problems. Its unique architecture and simple yet powerful data programming language...

Free Open Source Linux

Upsolver

The only Data Preparation Platform that lets you prepare and deliver data at a massive scale in a matter of minutes.

Commercial Web