Skip to content

Exercise developed for the Distributed Systems and Cloud Computing exam at Tor Vergata University. Implements a MapReduce system in Go, with simulation of Master, Mapper and Reducer nodes on a single machine for sorting datasets.

Notifications You must be signed in to change notification settings

StitchMl/mapReduce

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

11 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

MapReduce in Go

A simple distributed application exercise for ordering datasets using MapReduce to be implemented in one month during the Distributed Systems and Cloud Computing course.


Instructions

1) Create the Go module

$ go mod init mapReduce
$ go mod tidy

2) Compile gRPC definition files

$ protoc --go_out=. --go-grpc_out=. mapreduce/master.proto
$ protoc --go_out=. --go-grpc_out=. mapreduce/reducer.proto

3) Run the programme

$ go run main.go

Run the program to start the MapReduce system. Master, Mapper and Reducer nodes will be simulated on the same machine, and the results will be saved to file.

About

Exercise developed for the Distributed Systems and Cloud Computing exam at Tor Vergata University. Implements a MapReduce system in Go, with simulation of Master, Mapper and Reducer nodes on a single machine for sorting datasets.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages