Skip to content

Widhian Bramantya

coding is an art form

Menu
  • About Me
Menu
elasticsearch

Log Management at Scale: Integrating Elasticsearch with Beats, Logstash, and Kibana

Posted on October 5, 2025October 5, 2025 by admin

Modern systems generate millions of logs every day, from API servers, databases, applications, and containers. Managing, searching, and visualizing all of these logs in real-time is not easy. This is where the ELK Stack, Elasticsearch, Logstash, and Kibana, comes in.When combined with Beats, it becomes one of the most powerful and flexible log management systems…

Pages: 1 2
Read more
elasticsearch

Index Lifecycle Management (ILM) in Elasticsearch: Automatic Data Control Made Simple

Posted on October 5, 2025October 5, 2025 by admin

When your Elasticsearch grows very large, managing all indices by hand becomes impossible.Old data takes space, slows down queries, and increases cost. Index Lifecycle Management (ILM) helps you automate this, deciding when to roll over, move, merge, freeze, or delete indices automatically. This article explains ILM in simple English, including the frozen phase and how…

Pages: 1 2
Read more
elasticsearch

Blue-Green Deployment in Elasticsearch: Safe Reindexing and Zero-Downtime Upgrades

Posted on October 5, 2025October 5, 2025 by admin

Reindexing or upgrading Elasticsearch can be risky when your system is already in production.If you change mappings, update analyzers, or move to a new version, stopping the cluster is not an option.That’s where the blue-green strategy helps, it allows you to build a new index (or cluster), test it, and switch traffic smoothly without downtime.

Pages: 1 2 3
Read more
elasticsearch

Maintaining Super Large Datasets in Elasticsearch

Posted on October 5, 2025October 5, 2025 by admin

Elasticsearch can handle millions or even billions of documents. It is fast and scalable, but only if you manage it correctly. When your data grows very large, bad shard planning or poor data balance can make the cluster slow or unstable. This article explains how to maintain very large datasets in Elasticsearch, including the trade-offs…

Pages: 1 2
Read more
elasticsearch

Elasticsearch Best Practices for Beginners

Posted on October 5, 2025October 5, 2025 by admin

Elasticsearch is powerful, but it can also be confusing for new users.Many people make mistakes that slow down performance, waste memory, or even break the cluster.This article explains best practices for beginners — simple rules that help you build a stable and fast Elasticsearch setup.

Pages: 1 2
Read more
debezium

Implementing the Outbox Pattern with Debezium

Posted on September 27, 2025September 27, 2025 by admin

Introduction Modern applications often need to store data and at the same time publish events.Example: If the app writes to the database and Kafka separately, things can go wrong: This problem is called the dual-write problem.The Outbox Pattern solves it.

Pages: 1 2
Read more
debezium

Production-Grade Debezium Connector with Kafka (Postgres Outbox Example – E-Commerce Orders)

Posted on September 27, 2025September 27, 2025 by admin

Introduction Running Debezium in production is very different from running it locally. In production, the pipeline must be: This article shows how to build a production-grade Debezium + Kafka connector using the Outbox Pattern with PostgreSQL in an e-commerce order system.

Pages: 1 2
Read more
debezium

Connecting Debezium with Kafka for Real-Time Streaming

Posted on September 27, 2025September 27, 2025 by admin

Introduction Modern systems need real-time data. For example: Batch jobs are too slow for these cases. The solution is to build a real-time streaming pipeline. Together, they form a strong foundation for event-driven systems.

Pages: 1 2
Read more
debezium

Debezium Architecture – How It Works and Core Components

Posted on September 27, 2025September 27, 2025 by admin

Introduction Modern systems need to move data fast and in real time. A small change in a database, like a new order or an update to a customer’s profile, must reach many systems instantly: analytics dashboards, search engines, caches, or other microservices. Debezium helps solve this challenge. It is an open-source platform for Change Data…

Pages: 1 2
Read more
debezium

What is Debezium? – An Introduction to Change Data Capture

Posted on September 22, 2025September 22, 2025 by admin

Introduction Today, many companies need to move data quickly from one system to another. For example, when a new order is made in an online shop, that order data must be sent to many other systems: payment, inventory, shipping, and reports. Doing this manually is slow and complex. This is where Debezium comes in.

Pages: 1 2 3
Read more
  • 1
  • 2
  • 3
  • 4
  • 5
  • Next

Linkedin

Widhian Bramantya

Recent Posts

  • Log Management at Scale: Integrating Elasticsearch with Beats, Logstash, and Kibana
  • Index Lifecycle Management (ILM) in Elasticsearch: Automatic Data Control Made Simple
  • Blue-Green Deployment in Elasticsearch: Safe Reindexing and Zero-Downtime Upgrades
  • Maintaining Super Large Datasets in Elasticsearch
  • Elasticsearch Best Practices for Beginners
  • Implementing the Outbox Pattern with Debezium
  • Production-Grade Debezium Connector with Kafka (Postgres Outbox Example – E-Commerce Orders)
  • Connecting Debezium with Kafka for Real-Time Streaming
  • Debezium Architecture – How It Works and Core Components
  • What is Debezium? – An Introduction to Change Data Capture
  • Offset Management and Consumer Groups in Kafka
  • Partitions, Replication, and Fault Tolerance in Kafka
  • Delivery Semantics in Kafka: At Most Once, At Least Once, Exactly Once
  • Producers and Consumers: How Data Flows in Kafka
  • Kafka Architecture Explained: Brokers, Topics, Partitions, and Offsets
  • Getting Started with Apache Kafka: Core Concepts and Use Cases
  • Security Best Practices for RabbitMQ in Production
  • Understanding RabbitMQ Virtual Hosts (vhosts) and Their Uses
  • RabbitMQ Performance Tuning: Optimizing Throughput and Latency
  • High Availability in RabbitMQ: Clustering and Mirrored Queues Explained

Recent Comments

  1. Playing with VPC AWS (Part 2) – Widhian's Blog on Playing with VPC AWS (Part 1): VPC, Subnet, Internet Gateway, Route Table, NAT, and Security Group
  2. Basic Concept of ElasticSearch (Part 3): Translog, Flush, and Refresh – Widhian's Blog on Basic Concept of ElasticSearch (Part 1): Introduction
  3. Basic Concept of ElasticSearch (Part 2): Architectural Perspective – Widhian's Blog on Basic Concept of ElasticSearch (Part 3): Translog, Flush, and Refresh
  4. Basic Concept of ElasticSearch (Part 3): Translog, Flush, and Refresh – Widhian's Blog on Basic Concept of ElasticSearch (Part 2): Architectural Perspective
  5. Basic Concept of ElasticSearch (Part 1): Introduction – Widhian's Blog on Basic Concept of ElasticSearch (Part 2): Architectural Perspective

Archives

  • October 2025
  • September 2025
  • August 2025
  • November 2021
  • October 2021
  • August 2021
  • July 2021
  • June 2021
  • March 2021
  • January 2021

Categories

  • Debezium
  • Devops
  • ElasticSearch
  • Golang
  • Kafka
  • Lua
  • NATS
  • Programming
  • RabbitMQ
  • Redis
  • VPC
© 2025 Widhian Bramantya | Powered by Minimalist Blog WordPress Theme