Projects for CS 378: Cloud Computing aka Applied Distributed Systems with Dr. Kia Teymourian.
awesome class
Unfortunately can’t share the code publicly, but if you’d like to see the code please reach out!
External Sort
Sorting a huge database that exceeds the capacity of RAM on the machine. My solution implements k-way merge, parallel/concurrent processing, and data processing pipelines. Ran on Google Cloud GCE. Sorted the FOIL NYC Taxi Dataset.
Map Reduce
Implementing Map and Reduce over huge database. Map and Reduce run on 2 separate machines connected via socket connection. Ran on Google Cloud GCE. Foil NYC Taxi Dataset again.