Incremental Operators on Distributed Graphs

This project aims to design algorithms solving SSSP, SimRank, and Community Detection on distributed and dynamic graphs.

Project Details

• Algorithms:
  • Single Source Shortest Path
  • SimRank (Single Source, Single Pair, Top K)
  • Community Detection (Label Propagation, Speaker-Listener Propagation Algorithm, FastUnfold, Affinity Propagation, )
• Environment:
  • Memory: 40 * 50G
  • CPU Cores: 40 * 7
  • Platform: Spark 2.2.0 + JDK 1.8
• Data Set:
  • twitter-2010
  • 40M nodes
  • 1.4B edges
• Graph Changing Rate:
  • 5M edges / 2 min
• Result Accuracy:
  • SSSP: 100%
  • SimRank: 90%~100%

People

Yue Wang

Zijian Li

Xun Jian