Blog‎ > ‎

Entity Table in HBase

posted Feb 7, 2012, 7:07 PM by James Kraemer   [ updated Feb 7, 2012, 7:08 PM ]
Data Intelligence now allows customers to push all of their entities to HBase using Cloudera's Sqoop.  The HBase Entity table can reach thousands (or millions) of columns representing all of the attributes found in the customer's data model.

Sqoop uses a custom database view provided by the Entity Analytical Platform.  The view consists of all of the entities, attributes and values found in the Entity Repository.   Data Intelligence provides a custom PutTransformer that does the heavy lifting of transforming the entity data, then Sqoop loads the entities directly into HBase.  

Traditional relational databases are limited in column size and must be defined using a rigid schema.  With HBase, the columns in the Entity table can grow dynamically.  The HBase Entity table utilizes the distributed and sparse nature of the Hbase data store to bring Big Data Entity Analytics directly to the customer.