MapR Event Store For Apache Kafka C Applications

C applications can be developed for MapR Event Store For Apache Kafka (as of MapR 5.2.1). The MapR Event Store For Apache Kafka C Client is a distribution of librdkafka that works with MapR Event Store For Apache Kafka. The MapR Event Store For Apache Kafka C Client is available in MapR Expansion Pack (MEP) 3.0 or higher.

The following Apache Kafka librdkafka versions are supported:
Table 1. Supported Apache Kafka librdkafka versions
MapR release MEP Release Kafka librdkafka version
As of MapR 6.0.1 As of 5.0 0.11.3
As of MapR 5.2.1 through 6.0.0 As of 3.0 0.9.0

The MapR Event Store For Apache Kafka C Client supports a majority of the librdkafka C APIs plus additional configuration properties that are available only with MapR Event Store For Apache Kafka. When developing applications for MapR Event Store For Apache Kafka or migrating Kafka applications to MapR Event Store For Apache Kafka, see the list of librdkafka APIs Supported by MapR Event Store For Apache Kafka C Client which also describes API behavior. Reference rdkafka.h for API signatures.

When developing and running MapR Event Store For Apache Kafka C applications, note the following:
  • You can create producers and high-level consumers. Low-level consumers are not supported.
  • Consuming or producing topics in a Kafka cluster is not supported.
  • As of MapR 6.0, the MapR Event Store For Apache Kafka offset values start at 0.
  • MapR Security is supported. Kafka application-level security is not supported. See Security.
  • User impersonation is not supported.
CAUTION:
As of MapR 6.1, the mapr-core package has a dependency on mapr-librdkafka. If the mapr-librdkafka package is installed, do not remove it manually. Doing so could result in the removal of MapR core packages, rendering the node unusable.