Kafka and Apama

Aims of this blog

My goal with this blog post is to show how to set up Apama with Kafka and how they can be used together in a stream processing application. Kafka handles the transport and allows you to set up the delivery system, while Apama is a high performance event-processing engine with enough flexibility and throughput to provide for most applications. This blog post isn’t going to be a tutorial on Kafka, and I have used a containerized version of a Kafka cluster for simplicity.… Read More

Introducing ‘apama_project’

Apama uses the concept of “bundles” to provide the ability to add connectivity such as Kafka or MQTT to the project, and also for adding EPL capabilities such as date/time formatting. Until now, the only way to create a project and add these bundles was using the Software AG Designer graphical environment, which is only supported on Windows.

However, now we have a new tool called apama_project  that enables all this functionality from the command line, on Linux as well as Windows.… Read More

Apama on the Thin Edge with Cumulocity IoT

In this blog, we will look at how we can use Apama running on the Raspberry Pi to act as a “Thin Edge” device, and integrate it with Cumulocity IoT Cloud.

A “Thin Edge” platform is designed to handle a potentially large amount of data generated by sensors/devices, perform additional analytics on that data, and then communicate the results (e.g. calculated aggregate values, alarms, etc.) back to a “Thick Edge”/Cloud deployment. … Read More

Changing the base image used for Apama Docker images

Apama ships pre-built Docker images via several public stores, including Docker Store and Amazon Marketplace. These are based upon CentOS 7 base images. Some users may want to use a different base OS, for size reasons, support, or access to more recent compilers. Apama supports a wide selection of Linux distribution on-premise, but by default only ships one version of Docker images.

However, we do have a Docker build posted on Github which will take official Apama base images and change them to use a different base OS.… Read More

Using Python plug-ins with the Apama Core installation

We introduced Python plug-ins for EPL in this post. The full community installation provides a Python installation, but users of the community core package will need to provide their own. Today we’re going to explore how to do this on various common operating systems.

Configuring Apama to use an external Python

By default Apama will look inside the installation to locate a copy of the Python library when loading Python plug-ins.… Read More