MapReduce
- Wikipedia
- Apache Hadoop implements the MapReduce model
- AWS provides Amazon Elastic MapReduce
MapReduce is a programming model for processing and generating big data sets with a parallel and distributed algorithm on a cluster.
It is composed of:
- A map procedure that performs some operations like filtering or sorting or computations
- A reduce method, that performs a summary operation like counting the number of each element in a queue or yielding name frequencies.
A MapReduce system implements a parallel computing infrastructure where the system must manage both the mashalling of the data, to the various workers of the system and the communication, providing also redundancy and fault tolerence.
See also