1 MapReduce

MapReduce is a programming model for processing large amounts of data in a parallel and distributed fashion. It is useful for large, long-running jobs that cannot be handled within the scope of a single request, tasks like:

• Analyzing application logs
• Aggregating related data from external sources
• Transforming data from one format to another
• Exporting data for external analysis

With the App Engine MapReduce libraries, your code can run efficiently and scale automatically. App Engine takes care of the details of partitioning the input data, scheduling execution across a set of machines, handling failures, and reading/writing to the Google Cloud platform.

See the documentation:

• For Java
• For Python