Skip to content

art-vybor/map-reduce

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

60 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Map-reduce

Map-reduce framework for BMSTU course project.

DFS

Distributed file system is required to map-reduce framework.

On each node, you should run dfs_node.py with two arguments - port and storage_path. Like this:

    python dfs_node.py -p 5556 -s /home/user_name/storage

Then you should fill config.json with information about nodes. Now you can use dfs.py. Samples of use dfs.py:

    python dfs.py -ls /user/
    python dfs.py -mkdir /user/user_name/user_data_folder
    python dfs.py -put ./test.in /user/user_name/user_data_folder/test_file
    python dfs.py -get /user/user_name/user_data_folder/test_file
    python dfs.py -rm /user/user_name

About

Map-reduce framework for BMSTU course project

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published