Lookup additional data in Spark Streaming
07/26/17
Looking up and adding additional data to the incoming stream is a common problem in Spark Streaming. In this post I will show four alternative solutions for this problem. Read more
Posts about Architecture
Blockchain, the next big thing?
07/18/17
What’s this Blockchain everyone starts talking about? What can we do with it? Isn’t it just about Bitcoin and currencies? This post explains the basic concepts of Blockchain and how they can be used. Read more
Debug Ansible Playbooks Like A Pro
Ansible 2.1 introduced two features that make it possible to add proper debug logging to your playbooks, and also check and troubleshoot them on the fly, while they are executed. Read more
Scaling Spring Boot Apps on Docker Windows Containers with Ansible: A Complete Guide incl Spring Cloud Netflix and Docker Compose
05/30/17
Provision a Docker Windows Container with Ansible? No Problem! But wasn´t Docker meant for more than one Container?! Don´t we... Read more
Event time processing in Apache Spark and Apache Flink
04/20/17
Event time processing is one of the key features streaming frameworks should support nowadays. This article gives an overview on the event time capabilities of Apache Spark and Apache Flink. Read more
XFS: Possible Memory Allocation Deadlock in kmem_alloc
We were hit by sudden I/O hangs on random virtual machines. Any attempt to write to a its data volume would block forever. This post describes the analysis, cause, and remedy of the problem. Read more
Distributed Stream Processing Frameworks for Fast & Big Data
03/27/17
Spark Streaming, Flink, Storm, Kafka Streams, ... The possibilities for stream processing are manifold. Time to bring some light into the dark. Read more
Building a distributed Runtime for Interactive Queries in Apache Kafka with Vert.x
03/20/17
Interactive Queries are a fairly new feature of Apache Kafka Streams that provides programmatic access to the internal state held... Read more
Interactive Queries in Apache Kafka Streams
03/13/17
Version 0.10.1 of the streaming platform Apache Kafka introduced a new feature called "Interactive Queries" that makes your streaming application queryable. This article introduces core concepts. Read more