Partner App: Bidoop Layer

Bidoop Layer

Bidoop Layer helps companies to analyze several data sources and accelerate the development of new analytical models or operational processes, giving value to their (big) data.

Application Description

Bidoop contains the following differential components: Workflow Engine, Real Time Event Engine, User Management and System Access, and Data Sources Management.

  1. Workflow Engine: With the workflow engine, users can define analytical and operational models and easily create business rules using algorithms previously developed by experts. Users can build Big Data workflows in a graphical way (using drag & drop) in a much easier way than with Oozie. It enables to integrate works from Hive, Pig, HBase, MapReduce, Spark etc. The workflow engine (and all Bidoop in general) has been thought as an extensible framework so that users can easily develop new functionalities.

  2. Real Time Event Engine: this is our CEP (Complex Event Processing) solution based on top of MapReduce and HBase. It allows different monitoring options; sequential information flows or real-time events.

  3. User management & system access: Control layer designed to improve the security of the solution by increasing the control system users.

  4. Data Sources management: to easily configure Extraction (Flume, Sqoop), Transformation (validation & data cleansing) and Load (into Hive) of the data. Archiving policies are also defined in this step.

Component Version Connection Method
MapR Distribution 3.1.x, 4.0.1 HDFS, MapReduce, Hive, Impala, HBase, Spark, Flume, Sqoop, Pig, Mahout

Support Information

Technical assistance in modalities 24 x 7 or 8 x 5. See: