Skip to content

attinteractive/mrtoolkit

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

55 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

MRToolkit provides a framework for building simple Map/Reduce jobs in just a few lines of code. You provide only the map and reduce logic, the framework does the rest. Or use one of the provided map or reduce tools, and write even less.

Map and reduce jobs are written in Ruby. MRToolkit was inspired by Google’s Sawzall.

If you’re looking for documentation or would like to learn more about how this toolkit works, have a look at the Wiki Page

MRToolkit was inspired by Google’s Sawzall. We wanted to make it even easier by making use of an existing language, rather than inventing a new one. Ruby was a perfect fit.

The initial development of this software was supported by the New York Times, with the support and encouragement of Vadim Jelezniakov and Ranjit Prabhu.

This github repo is a mirror + patches to the mrtoolkit that is hosted on code.google.com: code.google.com/p/mrtoolkit/wiki/Introduction

This repo adds, among other things, the ability to install mrtoolkit as a gem:

gem install jashmenn-mrtoolkit --source=http://gems.github/com

About

mirror + patches of the NYT mrtoolkit - Simplify the creation of Hadoop Map/Reduce jobs

Resources

Stars

Watchers

Forks

Packages

No packages published

Contributors 3

  •  
  •  
  •