We assist our clients in creating Extract Transform Load (ETL) flow for preprocessing and transforming data to prepare for data visualization/data mining. Moreover, we assist our clients in creating Enterprise Data Warehouse(EDW) where transformed data is loaded.

After target data are selected, they are preprocessed and transformed to prepare for data visualization/data mining. Specifically, target data is preprocessed to clean the data, and preprocessed data is transformed into data tables which have mathematical relational structure and which can be mapped into visual structures. We provide following data preparation services:

knowledge-generation-process

  • Creating Extract Transform Load (ETL) flow for preprocessing and transforming data.
  • Creating Enterprise Data Warehouse(EDW) where transformed data is loaded.
  • Creating big data architecture, where big data sources –such as clickstream, web & social, geolocation, sensor & machine, sever logs and other unstructured data sources– can be stored into big data stores such as Hadoop, key value store , document-oriented store and extensible record store .

Figure below depicts modern big data architecture that can efficiently handle not only traditional data sources such as Enterprise Resource Planning (ERP), Customer Relationship Management (CRM) and other RDBMS where data is stored in a structured form but also new data sources such as clickstream, web & social, geolocation, sensor & machine, sever logs and other unstructured data sources that have wide variety and burgeoning volume. We, therefore, also assist our clients in developing similar data architecture, where big data sources can be stored into big data stores such as Hadoop, key value store , document-oriented store and extensible record store .

 

Data_Architecture

These big data stores are schema flexible and so they do not require schema for storing data as required by Enterprise Data Warehouses(EDW). Moreover, these data stores use horizontal scaling and therefore can store huge volumes of data for longer period very cost effectively. In addition, when stored data needs to be analyzed, it can be transformed in appropriate data structure so that it can either be feed into EDW to generate value through analytics or directly feed into analytical tools such as Tableau to create value for the organization.

OUR SERVICES

Contact us for more information.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s