Archives on Mi&Bee Blog

Implementing a Lightweight File Backup System Based on OpenResty

Wed, 30 Jan 2019 00:00:00 +0000

Introduction

There are tools like filebeat for log collection, open-source cloud drives like seafile, and simple distributed file systems like FastDFS, among others. However, the remote backup logs of a certain enterprise SaaS platform still rely on traditional compressed file scp transfers to backup storage.

Since filebeat’s log collection completeness is debatable, open-source cloud drives have cluttered features that are not conducive to management, distributed file systems’ internal storage logic is not well-suited for the backup log management of the enterprise SaaS platform, and scp transfers pose security risks with private keys deployed on servers, we leveraged OpenResty’s features to implement a simple file backup API interface using Lua.

Linux High Availability and Load Balancing in Practice — From Keepalived to Performance Tuning

Tue, 19 Jun 2018 00:00:00 +0000

Introduction

In modern enterprise application architectures, high availability and load balancing are key technologies for ensuring stable system operation. This article provides a detailed introduction to achieving dual-machine hot standby with Keepalived, building internal network service load balancing with HAProxy, and resolving NIC soft interrupt issues for network performance optimization. Through real-world cases and detailed configuration explanations, this article helps readers understand the core principles and practical applications of these technologies.

JVM Performance Tuning and Off-Heap Memory Leak Troubleshooting in Practice

Tue, 16 Jan 2018 00:00:00 +0000

Introduction

JVM performance tuning and memory issue troubleshooting have always been significant challenges for Java developers. This article starts from the three core goals of GC tuning and combines them with a real-world off-heap memory leak investigation case to provide a systematic approach to performance tuning and practical troubleshooting methods.

In complex distributed systems, memory issues are often the hardest to diagnose. Off-heap memory leaks in particular, occurring outside the JVM heap, are difficult to detect with conventional GC monitoring tools and can easily cause systems to crash suddenly in production environments. This article shares a complete off-heap memory leak investigation process, hoping to provide valuable reference for readers.

Overseas Email Delivery Acceleration Architecture — Smart Delivery Network in Practice

Tue, 16 Jan 2018 00:00:00 +0000

Introduction: Challenges of Overseas Email Delivery

In globalized business scenarios, email delivery faces numerous challenges. Overseas email delivery must not only overcome network latency issues but also navigate complex geopolitical network environments. Traditional direct overseas delivery methods often encounter connection timeouts, firewall blocking, and high delivery latency. At the same time, interoperability between domestic email systems and overseas networks also presents technical challenges.

To address these issues, we designed and implemented a Smart Delivery Network (SDN) architecture that effectively improves the efficiency and reliability of overseas email delivery through multi-level proxying, intelligent routing, and load balancing mechanisms.

Advanced Bash Programming Techniques — Handling Message Queue Backlog with the Producer-Consumer Pattern

Wed, 05 Jul 2017 00:00:00 +0000

Introduction

In message system operations, queue backlog is a common and tricky problem. Especially during malicious attacks or system anomalies, the delivery queue may accumulate a large number of messages, severely impacting normal system operation. Traditional single-process processing is not only inefficient but may also cause problems to worsen due to delayed handling.

This article shares a set of advanced Bash programming techniques based on the producer-consumer pattern. Through core technologies including multi-process concurrency, pipe communication, and efficient awk parsing, we achieve fast and effective handling of message queue backlog issues. This solution has been validated in multiple production environments, capable of improving processing efficiency several times over while ensuring system stability.

Practices and Pitfalls of Dockerizing Enterprise Applications — From Traditional Virtualization to Containerization

Mon, 17 Apr 2017 00:00:00 +0000

Introduction (Why Containerize Enterprise Applications)

In the era of cloud computing, the way enterprise applications are deployed and managed is undergoing a profound transformation. While traditional virtualization technology solved the resource isolation problem, it still has many pain points in terms of operational efficiency, resource utilization, and deployment speed. The rise of Docker container technology has provided a brand-new solution for the modernization of enterprise applications.

This article shares our practical experience in the containerization migration of an enterprise email system, including technology selection, infrastructure construction, the full process of migrating from OpenVZ virtualization to Docker, and various issues encountered in production along with their solutions. Through these practical cases, we hope to provide valuable reference for teams that are currently or planning to undertake containerization migration.

A Simple BBR Test on Linode

Mon, 10 Apr 2017 00:00:00 +0000

Overview:

TCP BBR solves two problems:

Fully utilizing bandwidth on network links with some packet loss. Suitable for high-latency, high-bandwidth network links.
Reducing buffer occupancy on network links, thereby lowering latency. Suitable for users with slow access networks.

I remember when BBR was first merged into the Linux 4.9 kernel in 2017, this congestion control algorithm proposed by Google was extremely popular in the tech community. At the time, I was doing cross-border file transfers on Linode, where packet loss was commonplace, so I wanted to test the results firsthand.

Raspberry Pi Docker Cluster

Wed, 08 Mar 2017 00:00:00 +0000

Overview

At the time, I was learning Docker cluster management and wanted a low-cost lab environment to experiment with, so I thought of using Raspberry Pis. Following the Hypriot blog, I bought one Raspberry Pi 2 board and two Raspberry Pi 3 boards. The reasoning was that the Pi 2 was cheaper so it would be the master, and the Pi 3s had better performance for worker nodes — together they made a small cluster.

ARM Board Notes and Experiences

Mon, 27 Feb 2017 00:00:00 +0000

Raspberry Pi

I originally got into Raspberry Pi to set up a Docker cluster environment — mainly because they were cheap and power-efficient. Bought 3 Raspberry Pi 2 boards for around 600+ yuan. Back then, running Docker on ARM was still a novel concept.

I used Raspberry Pi to build a Docker cluster environment, following the Hypriot blog.

CubieBoard

Getting Docker running on ARM was a major challenge back then — official support was poor, community documentation was sparse, and it required a lot of trial and error.

Building a Blog on GitHub

Sun, 26 Feb 2017 00:00:00 +0000

2023 Blog Migration from `hexo` to `hugo`

The main reason was getting tired of hexo taking forever to generate each time, plus the npm package dependency management issues — maintenance was indeed a burden. And hugo, as a static site generator written in Go, is genuinely much faster.

Chose hugo as the tool
Chose Hugo.NexT as the theme
Chose CloudFlare for CDN

The migration process was quite a hassle, mainly converting front matter format from YAML to TOML, and the various configuration differences between themes were quite significant, but eventually it all worked out.

Enterprise Mail System Architecture Design and Mail Flow Analysis

Fri, 24 Feb 2017 00:00:00 +0000

Introduction

In the digital era, email serves as a core communication tool for both internal and external enterprise interactions. Its architecture design directly impacts the stability, security, and performance of mail services. This article explores the three-tier architecture design of enterprise mail systems, provides a detailed analysis of the complete mail receiving and sending processes, and helps readers gain a comprehensive understanding of the technical implementation of modern mail systems.

MySQL Operations in Practice — From Optimization, Monitoring to Disaster Recovery

Sat, 18 Feb 2017 00:00:00 +0000

Introduction

In the operations and maintenance of business systems, MySQL databases serve as core components whose performance stability and data security are critical. Based on years of hands-on operational experience, this article comprehensively shares practical MySQL database operations knowledge — from performance optimization, monitoring systems, Binlog management, and high-availability deployment to disaster recovery. These insights come from real-world cases across multiple production environments, covering the full technology stack from daily tuning to emergency incident response. We hope this provides valuable reference for database administrators and operations engineers alike.

SSL Certificate Automation Management — Ansible Batch Deployment and Update Practices

Mon, 13 Feb 2017 00:00:00 +0000

In modern IT infrastructure management, secure management of SSL certificates has become increasingly important. As the number of services grows and certificate renewal cycles shorten, manual certificate management becomes inefficient and error-prone. This article details how to use Ansible for automated batch deployment and renewal of certificates, improving management efficiency and reducing security risks.

The Importance of SSL Certificate Management

SSL certificates are the foundation of network communication security. They ensure:

Building a Cross-City LAN with Docker

Fri, 20 Jan 2017 00:00:00 +0000

Overview

At the time, I had servers both at home and at the office and wanted unified management, but the two internal networks were isolated. Traditional port forwarding was too cumbersome, and some services I didn’t want exposed to the public internet. After trying several approaches, I found Docker OpenVPN to be the most hassle-free solution.

I chose Docker OpenVPN over traditional VPN mainly because containerized deployment is extremely convenient, and certificate management is much simpler. The end result was great — I could access various services on the remote internal network via domain names, saving a lot of configuration hassle.

Boosting Development Efficiency — Linux Development Environment Setup Guide

Wed, 07 Dec 2016 00:00:00 +0000

In modern software development, having an efficient and convenient development environment can significantly improve productivity. This article provides a detailed guide on setting up a complete development environment on Linux, including configuration and usage of the tmux terminal multiplexer, vim code editor, enhanced zsh shell, and git version control.

Prerequisites

Before you begin, make sure your system meets the following minimum requirements:

tmux: version >= 2.1
vim: version >= 7.3
zsh: oh-my-zsh recommended
git: latest version

1. TMUX Terminal Multiplexer Configuration

TMUX is an excellent terminal multiplexer that allows you to create multiple sessions and windows within a single terminal window, making it ideal for developers who need to handle multiple tasks simultaneously.

Complete Distribution of the TCP/IP Protocol Suite in the OSI Model — Understanding Network Protocols at a Glance

Tue, 24 Feb 2015 00:00:00 +0000

Network communication is the cornerstone of modern information technology, and understanding how network protocols work is crucial for every developer and system administrator. This article uses the OSI model framework to provide a detailed introduction to the distribution and roles of each protocol in the TCP/IP protocol suite within the network layer hierarchy.

What is the OSI Model?

The OSI (Open Systems Interconnection) model is a conceptual network model that divides the network communication process into seven layers. Although this model is less popular in practice than the TCP/IP model, it is very helpful for understanding how network protocols work.

Archives on Mi&Bee Blog

Implementing a Lightweight File Backup System Based on OpenResty

Introduction

Linux High Availability and Load Balancing in Practice — From Keepalived to Performance Tuning

Introduction

JVM Performance Tuning and Off-Heap Memory Leak Troubleshooting in Practice

Introduction

Overseas Email Delivery Acceleration Architecture — Smart Delivery Network in Practice

Introduction: Challenges of Overseas Email Delivery

Advanced Bash Programming Techniques — Handling Message Queue Backlog with the Producer-Consumer Pattern

Introduction

Practices and Pitfalls of Dockerizing Enterprise Applications — From Traditional Virtualization to Containerization

Introduction (Why Containerize Enterprise Applications)

A Simple BBR Test on Linode

Overview:

Raspberry Pi Docker Cluster

Overview

ARM Board Notes and Experiences

Raspberry Pi

CubieBoard

Building a Blog on GitHub

2023 Blog Migration from hexo to hugo

Enterprise Mail System Architecture Design and Mail Flow Analysis

Introduction

MySQL Operations in Practice — From Optimization, Monitoring to Disaster Recovery

Introduction

SSL Certificate Automation Management — Ansible Batch Deployment and Update Practices

The Importance of SSL Certificate Management

Building a Cross-City LAN with Docker

Overview

Boosting Development Efficiency — Linux Development Environment Setup Guide

Prerequisites

1. TMUX Terminal Multiplexer Configuration

Complete Distribution of the TCP/IP Protocol Suite in the OSI Model — Understanding Network Protocols at a Glance

What is the OSI Model?

2023 Blog Migration from `hexo` to `hugo`