MapReduce example

If you've never worked with a MapReduce framework or system, the overall concepts are not incredibly complex. In fact, we can implement a single-process and single-threaded MapReduce system in a few lines of code.

Overall, MapReduce is designed to extract a specific bit of information from a body of data and distill it down into some final result. That may sound very vague and arbitrary, and it is. The beauty of MapReduce is that one can apply it to so many different problems. A few examples should better demonstrate what MapReduce is and how you can use it.

A Hello World MapReduce program counts the number of occurrences of a particular word in a body of text. The following code block does this with a few lines of Python ...

Get Serverless Design Patterns and Best Practices now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.