MapReduce programming idiom

In the FP world, MapReduce is considered as a programming idiom.

Note

The process of mapping can be described as the application of a function or computation on each element of a sequence to produce a new sequence. Reduction gathers computed elements to produce the result of a process, algorithm, or a functional transformation.

In 2003, two Google engineers (Sanjay Ghemawat and Jeff Dean) published a paper about how the company used the MapReduce programming model to simplify their distributed programming tasks. The paper entitled MapReduce: Simplified Data Processing on Large Clusters is available on the public domain. This particular paper was very influential, and the Hadoop distributed programming model was based on ...

Get .NET Design Patterns now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.