9 min read
Today, we are delighted to announce the next level of advancement of the MapR platform with the latest release of MapR Database, MapR-DB 6.0 - The modern database for global data-intensive applications.
At MapR, we are fortunate to work alongside leading global 2000 companies on their journey to digitally transform themselves. Digital transformation starts with providing rich contextual user experiences to attract, engage, and retain their key stakeholders. Our customers are making big bets on modernizing the core business processes, uncovering real-time insights, and enabling automated decision making to cut down costs and innovate faster.
Enabling the business transformation requires these organizations to deal with extreme scale of data and applications. These data-intensive applications need the ability to capture and interact with diverse types of data such as IOT and leverage them to maximize their business outcomes. Customers are trying to move after-the-fact insights and processes to real-time processes and in-the-moment proactive actions by infusing ML/AI driven data intelligence. Data is the foundational enabler in all these “data-intensive” applications.
As organizations aspire to build these applications, they need critical technology building blocks and databases are the foundational components of application architecture in operationalizing the data . While working with these customers, we have identified 3 critical areas of concern around databases in the past few years.
Databases are not islands any more - In order to enable the next-generation data intensive applications, database must be part of a broader data platform including analytic processing for in-place intelligence and streaming for real-time data flows to establish a continuum of data, insights and operations coming together in real-time.
Database selection at organizations today is often a decision of complex trade offs of critical requirements - Is write ingest speed critical or read? Is data consistency critical or performance? Is this data really important for me or it’s ok to lose it because app availability is lot more important? Can I live with coarse grained security? Do I need wide column performance or JSON flexibility? The result is that while there are many many new databases in the market, they often are used in niche purpose-built use cases or as part of auxiliary applications while most of the mission critical business apps continue to stay in well trusted traditional RDBMS systems not leveraging the modern technology trends thus not fully achieving the desired business transformation.
Every database app today is a silo in its own infrastructure - the result is 100s-1000s of non-integrated apps - This is a daunting reality. Databases traditionally are not built for running multiple apps simultaneously and still meet SLAs. The result is complexity and cost of infrastructure and the need to interconnect these apps using fragile data pipelines.
At MapR, our goal has been to a build a complete data platform with a built-in modern scalable database to create these breakthrough data-intensive applications spread across on-prem, edge and multi-cloud environments with no complex trade offs and compromises.
MapR-DB allows a broad variety of applications by bringing critical database capabilities into one system as below.
Over the last 3 years, MapR has systematically built MapR-DB to be a converged and complete database. The latest MapR-DB 6.0 release delivers on this broader vision.
Here is the evolution of the database over the past few years leading to the MapR-DB 6.0.
MapR-DB 6.0 is a significant milestone. With this, we are introducing several new capabilities & performance improvements to expand the usage of the database in organizations.
Here is the summary of the key features in this release.
Prior to 6.0, MapR-DB is optimized for access only based on rowkey. The new built-in rich secondary indexes expand on this by supporting flexible and efficient queries on any columns in the DB tables at Scale. This enables application developers to build rich and new types of applications that supports complex user interaction patterns and business users can perform optimized/high performance SQL queries using the familiar BI/Analytics tools.
The key features of the Secondary Indexing functionality include:
OJAI (Open JSON Application Interface) is the API to develop applications with MapR-DB document data model. In 6.0, we are expanding on the API for more functionality and performance.
The new capabilities include:
Apache Drill provides flexible SQL analytics on the data in MapR-DB JSON tables. Drill is a distributed SQL query engine and serves as a unified interactive access layer for the MapR platform bringing together data from MapR-FS and MapR-DB.
The new capabilities of the MapR-DB & Drill optimize the SQL data access on MapR-DB speeding up ad-hoc queries.The new capabilities include:
MapR-DB 6.0 deeply integrates with Apache Spark and MapR-DB JSON tables. Customers can use these capabilities to perform real-time data processing as well as build and serve machine learning models on MapR-DB tables directly without creating analytic silos.
The new capabilities of this integration include:
MapR-DB 6.0 deeply integrates with Apache Hive and MapR-DB JSON tables. Customers can use these capabilities to perform ETL/batch processing of the data in MapR-DB tables directly.
The new capabilities of this integration include:
Built on the foundations of global table replication and MapR Event Streaming, the MapR-DB Change Data Capture API provides a powerful and easy to use interface to support real time integration of changes arriving at a MapR-DB table to arbitrary, external systems. Users can now build applications to consume and process the MapR-DB table data changes published as ‘change log’ streams in real time in a highly scalable way. The change data propagation is granular for selected columns/fields and supports ordered atleast-once delivery.
This capability enables use cases such as:
All the new functionality expands on the data access capabilities on MapR-DB and help leverage in a variety of use cases such as customer 360, personalization, real-time analytics, IOT, and building scalable and high performance enterprise apps. The general availability of the MapR-DB 6.0 is in Q4’2017.
For more information on MapR-DB refer to the following:
Stay ahead of the bleeding edge...get the best of Big Data in your inbox.