Friday, May 13, 2016

THE POPULAR GRAPH DATABASES

1) NEO4J

neo4j_logo_600x600
Neo4j is the market leader in GraphDB. It is highly performant, scalable, and flexible. It is equipped with a rich UI, called the Neo4j browser, that is used for queries, visualization, and data interaction. It has compatibility with most programming platforms like Java, Nodejs, PHP, Python, .NET, etc. It supports the Cypher query language, whose syntax naturally depicts data and relationships. It has a good integration support with Apache Spark, Elasticsearch, MongoDB, Cassandra, and Docker. The community edition is free under GPL v3 license.

2) ORIENT DB

Orient DB is a high speed, scalable, and reliable GraphDB. It has a high and constant traversing speed that is not affected by database size. User, role, and record level security is built-in. It has a good compatibility with most programming platforms like Java, Nodejs, PHP, Python, .NET, etc. It has a strong community support and is licensed under Apache 2.

3) TiTAN DB




Titan DB is highly scalable and can store and query graphs containing hundreds of billions of vertices and edges distributed across a multi-machine cluster. Titan DB is transactional and supports various backend stores like Cassandra, HBase, and BerkeleyDB. It supports integration with Elastic Search, Lucene, and Solr, and also supports the Gremlin query language. It is licensed under Apache 2.

4) Apache Giraph



It is an Iterative Graph processing framework backed by Apache Hadoop. Giraph jobs are highly scalable as they run on Hadoop Cluster. Giraph can greatly increase the efficiency of graph computation on a huge dataset. It is licensed under Apache 2. We wanted to take a deep dive into these graph databases to understand how they stacked against each other. At the outset, we eliminated TitanDB because a stable 1.0 version had not been released at the time. We also skipped Apache Giraph because it is backed up only by Hadoop. This left Neo4j and OrientDB for more exploration.

TEST ENVIRONMENT

  • CPU- Intel quad core i7 2.2 GHz
  • RAM – 16 GB
  • Hard disk type – Flash
  • Database on same machine as test program (no network latency)

TEST METHODOLOGY

We used the sample Spring projects and Java drivers of each of the databases. The intent is to programmatically
  • Add 100k users,
  • Randomly search users across 100k edges in total, and
  • Come up with our average read/write speeds.
We then searched users with similar preferences to each other. We ran the suite as Java unit-tests and captured the times using timestamps. Neo4j allowed indexing capability on one of the attributes - we indexed the userID to give us indexed and unindexed speeds. Read queries were not identical in each DB, so the closest comparison was run.

RESULTS

The results scale from 1 to 5, where the higher value is better.
DimensionsNeo4jOrient DBComments
Stable Java Driver? (Yes/No)YesYes
Maturity of Client Framework (1-5)52
Ease of query language (1-5)53Gremlin relates to SQL. Cypher relates more to graph queries.
Ease of setup (1-5)35
# of Reads per Second0.161ms (no index) 0.139 (indexed)0.955ms (search)Single node retrieval; the gap decreased when searching for multiple nodes.
# of Writes per Second0.023ms/edge0.31ms/edge
Storage Footprint (MB)103mb86mb
Average Memory Footprint (MB)172mb – Average256mb – Average
License CostCommunity edition is free under GPL v3 license.Community edition is free under Apache 2 license.Enterprise version cost is unknown and can be figured out with the vendor directly.
Community Support52

No comments:

Post a Comment

Write a comment . .