In this article, we will see how to install and configure Filebeat on Ubuntu/Debian servers. Filebeat is a lightweight agent installed on your servers that monitors and collect events and then forwards them either to Elasticsearch or Logstash for indexing. It belongs to the family of lightweight shippers where each shipper is known for shipping ... Read more

In this article, I will go through Apache Kafka tutorial from beginners perspective so that anyone learning Kafka for the first time can understand it. To understand Kafka you need to first understand why we need Kafka ? Any application which is dealing with lot of upstream and downstream data requires almost zero time lag ... Read more

In this tutorial, we will understand the steps and queries required to check the Elasticsearch cluster health status. Sometimes you might have noticed that frontend app which was fetching data from Elasticsearch cluster suddenly not showing any data and it goes completely blank. Although the issue could be anywhere but just for the understanding we ... Read more

In this article, I will take you through the steps to delete Elasticsearch Unassigned Shards. Elasticsearch stores data in the form of documents, which are grouped into an index. In the case of a huge amount of data, the number of documents in a single index may cross the limit of the underlying hardware capacity. ... Read more

In this article, I will show you how to delete all Elasticsearch Red Status Indices in 3 Easy Steps. Many times it so happens that your Elasticsearch will go down due to some reasons or it might not start properly if you perform reboot operation. In those cases you will see your cluster status as ... Read more

In this tutorial, I will take you through 10 Popular Kafka Console Producer and Consumer Examples. Kafka is currently in high demand due to its various use cases. It is widely used as a messaging system, as a storage system and for stream processing. Kafka usually consists of four API Producer API, Consumer API, Streams ... Read more

In this tutorial, I will explain about Apache Kafka Architecture in 3 Popular Steps. Kafka was released as an open source project on GitHub in late 2010. As it started to gain attention in the open source community, it was proposed and accepted as an Apache Software Foundation incubator project in July of 2011. Apache ... Read more

In this article, I will take you through 17 Useful Apache Kafka Examples on Linux(RedHat/CentOS 7/8). For many decades Organizations are using databases to store objects and entities. In a more general term objects and entities state but there were also a separate class of people who started thinking about Object events rather than Object ... Read more

In this article I will take you through the steps to install Apache Kafka on Ubuntu. Kafka was Originally developed at LinkedIn. Later on, in 2011 it became an Open Source Project. Since then it has evolved as a very important Real Time Data Pipeline application. Kafka basically provides a Distributed Streaming platform which you ... Read more

In this article, I will take you through Zookeeper Installation on Ubuntu 18.04. Zookeeper is an external software used to track information that must be synchronized across your cluster. In a Real world Distributed System, Cluster might get into any kind of Failures like individual nodes went down, time drift between the nodes, network go ... Read more