Stream Processing in Kubernetes: practical guide

Stream Processing in Kubernetes: practical guide

How should the modern distributed data processing look like? It should definitely be fast, real-time, and so easy to use that you could understand its basics in less than 1 hour! In this hands-on session I’ll present the steps to use stream processing in Kubernetes.

You can expect the following agenda:

  1. Introduction to stream processing (in comparison to the good old batch processing)
  2. Setting up a Hazelcast Jet cluster in Kubernetes
  3. Running a sample distributed batch job
  4. Running a real-time stream processing application in Kubernetes
  5. Automatic scaling up/down of Jet cluster depending on the load
  6. Running more complex stream processing algorithms with data windowing and aggregations

You can either come and listen or join with your own laptop. The only requirement is to have access to a Kubernetes cluster (Minikube / Docker for Desktop is good enough). Welcome!