Loading...
Thumbnail Image
Publication

Performance study of an implementation of the push-relabel maximum flow algorithm in Apache Spark's GraphX, A

Langewisch, Ryan P.
Citations
Altmetric:
Advisor
Mehta, Dinesh P.
Editor
Date
Date Issued
2015
Date Submitted
Research Projects
Organizational Units
Journal Issue
Embargo Expires
Abstract
GraphX is an API for graph computation built upon Apache Spark, a fast and generalized engine for large-scale data processing in the cloud. While the popularity of Spark and GraphX is growing, the relatively young technology has yet to explore the breadth of graph problems that exist in the field. In order to examine and gain insights into the capabilities of GraphX, this thesis approaches the framework with the intention of implementing a solution to the Maximum Flow Problem, a complex graph problem without a trivial distributed approach. Specifically, the implementation is to be based on the serial Push-Relabel algorithm. An original MapReduce-based approach to the problem is presented, as well as an implementation of the approach in GraphX. In addition to the implementation, experimentation and deployment to an Amazon EC2 cluster allowed observations on caching and checkpointing intervals to be made.
Associated Publications
Rights
Copyright of the original work is retained by the author.
Embedded videos