Python Client for Apache Kafka Producer and Consumer

Introduction In this tutorial I am going to show you how to use Python client to work with Apache kafka distributed stream processing system. I will create Kafka producer and consumer examples using Python language. KafkaConsumer is a high-level message consumer that consumes records from a kafka cluster. The consumer is not thread safe and should not be shared across threads.

Continue

Event Driven Streaming using Spring Cloud Stream and Apache Kafka

In this tutorial we will see an example of event driven streaming using Spring Cloud Stream and Apache Kafka streaming platform. How do we deal with some events, such as, a new user has registered to a portal, an order was placed, a file has been uploaded etc? Let’s say when an order was placed then we need a call to process payment, a call to reserve inventory, a call to begin the process of packaging, picking and shipping the product. For a few orders it’s not a big deal…

Continue

Apache Kafka Streams for building Real Time Data Processing with STOMP over WebSocket using Spring Boot and Angular 8

Introduction In this tutorial I will show you how to work with Apache Kafka Streams for building Real Time Data Processing with STOMP over Websocket using Spring Boot and Angular 8. We will see how to build push notifications using Apache Kafka, Spring Boot and Angular 8. We need to provide some basic things that Kafka Streams requires, such as, the cluster information, application id, the topic to consume, Serdes to use, and so on. I will show you how to build the application using both gradle and maven build…

Continue

How to produce and consume message using Apache Kafka and Spring Boot

Introduction In this tutorial I will show you how to produce and send message using Apache Kafka and Spring Boot. Apache Kafka is supported by providing auto-configuration of the spring-kafka project. Kafka configuration is controlled by external configuration properties in spring.kafka.*. I will show you how to build this application using both maven and gradle build tools. I will create a new topic on application start up. You need to make sure that ZooKeeper server and Kafka server or broker are running. You also need to make sure that a…

Continue

How to setup and work with Publish Subscribe domain in Apache Kafka in Windows Environment

Introduction In this guide I will tell you how to setup and work with publish subscribe domain in Apache Kafka in windows environment. I am not going to tell you about Kafka and you will find very good documentation on this here. Kafka works on publish subscribe domain and this tutorial will show you how to create topic, how to send or publish messages, how to consume messages etc using command line tool.

Continue