Mi&Bee Blog

MiBeeNvr v0.6.0: Timelapse + Transcoding UI + ONVIF Enhancements + Documentation Restructure

Fri, 05 Jun 2026 00:00:00 +0000

After running continuous recording for a few weeks, storage became the first bottleneck. A single 1080p camera writes tens of GB per day — with a 30-day retention policy, a 1TB硬盘 is mostly consumed. Many community members reported the same issue, and during discussions, the ideas of timelapse and transcoding storage gained the most traction: most of the time the画面 is static, and compressing it with timelapse requires only 5% of the space for the same duration.

MiBeeNvr v0.6.0's Test Machines: Three Camera Projects Updated in Sync

Fri, 05 Jun 2026 00:00:00 +0000

The concurrently released MiBeeNvr v0.6.0 brought major features like timelapse, video transcoding, and ONVIF enhancements. Unit tests alone are far from enough — the full workflow must be tested against real camera hardware. To provide reliable test machines for this release, three camera projects were updated on the same day, June 5th — both to supply testing environments for the NVR and to solve some typical embedded development engineering problems along the way.

MiBeeNvr v0.5.0: Full ONVIF Protocol Support + Hardware Transcoding + rpi-cam Co-development

Sat, 30 May 2026 00:00:00 +0000

Less than a week after v0.4.0, another 31 commits were pushed. v0.5.0 is a feature-dense release: full ONVIF protocol support (covering all five major services: Device/Media/PTZ/Imaging/Event), hardware transcoding (H.265 → H.264), and recorder reconnection optimizations. 127 files changed, +24,509 / -730 lines. See the full changelog at GitHub Release Notes.

If you haven’t seen the previous versions, check out MiBeeNvr Introduction and v0.4.0 Technical Post.

Full ONVIF Protocol Support

v0.4.0 already had ONVIF device discovery and stream URL retrieval, but that was just the tip of the ONVIF iceberg. v0.5.0 completes the core services of ONVIF Profile S:

MiBeeHive: The "Hive" Toolbox I Built for My Studio

Tue, 26 May 2026 00:00:00 +0000

Coming from an operations background, later transitioning to development, the number of projects I maintain keeps growing. Various middleware, databases, monitoring components… each version upgrade is a manual labor: go to the official site to find the download link, compare version numbers, manually download to the internal network, then distribute to each machine. I used to write a bunch of Shell scripts to periodically pull the latest versions to the LAN — functional but not user-friendly: scripts scattered everywhere, adding new software required writing parsing logic by hand, and there was nothing to check when things went wrong.

MiBeeNvr v0.4.0: Audio Recording Finally Arrives, Auto-Recovery When Cameras Go Down

Mon, 25 May 2026 00:00:00 +0000

Previously, MiBeeNvr’s MP4 files only had a video track — playback was silent. v0.4.0 fills this gap with audio recording. It also adds more practical camera health monitoring and auto-recovery.

Recordings Now Have Sound

Each camera can independently enable audio recording:

yaml


1
2
3
4
5
6


cameras:
 - id: "front-door"
 name: "Front Door Camera"
 protocol: "rtsp"
 encoding: "h264"
 audio_enabled: true

Supported audio formats:

MiBeeNvr v0.4.0: Audio Recording Pipeline and Multi-Layer Health Monitoring Architecture

Mon, 25 May 2026 00:00:00 +0000

After v0.3.1 shipped, I put in another 196 commits. v0.4.0 is a feature-dense release: audio recording pipeline, multi-layer health monitoring engine, HLS/LL-HLS playback stability optimization, and a major UI redesign. For the full changelog, see GitHub Release Notes.

The previous post covered v0.3.x’s multi-protocol streaming and Xiaomi camera support (v0.3.0 Tech Post). If you haven’t read the first post, start with MiBeeNvr Introduction.

Audio Recording: From Silent to Sound

In the v0.3.x era, recorded MP4 files only had a video track. v0.4.0 introduces a complete audio capture and muxing pipeline, supporting AAC audio from RTSP cameras and G.711 audio from ONVIF/Xiaomi cameras.

MiBeeNvr v0.3.1: Multi-Protocol Streaming and Native Xiaomi Camera Support

Fri, 22 May 2026 00:00:00 +0000

A lot of work went into the releases after v0.2.0. v0.3.x brings several major updates: native Xiaomi camera support, recording archiving, multi-protocol streaming architecture (WebRTC/HTTP-FLV/RTMP/SRT/LL-HLS), and a wave of security hardening. The architectural evolution from external dependencies to built-in implementation, from single protocol to full protocol support, was much more曲折 than I expected.

The previous post introduced v0.2.0’s 15 new features (v0.2.0 Update). If you haven’t read the first post, start with MiBeeNvr Introduction. v0.3.0 focuses on deep Xiaomi camera integration, and v0.3.1 builds on that with a complete multi-protocol streaming architecture. For the full changelog, see GitHub Release Notes.

From Compliance to Real-Time Defense: The Evolution of security-collector-exporter

Thu, 21 May 2026 00:00:00 +0000

The Origin: Compliance Check Hassles

Anyone in operations knows there’s no escaping one hurdle for domestic servers: Cybersecurity Level Protection (GB/T 22239-2019, commonly known as “Level Protection 2.0”). Whether you’re Level 3 or Level 2, auditors come asking about these things:

Is SSH root login disabled? Are password policies compliant?
Is the firewall on? Is SELinux enforcing?
Are there expired accounts? What’s the password validity period?
Which ports are open? Are there high-risk services running?
Are audit logs enabled? How long are they retained?

There are plenty of compliance check tools on the market—search GitHub and you’ll find a bunch: Golin, EvaluationTools, Linux-Security-Compliance-Check, etc. But they all share one limitation: Run once, get a report, done. You check compliance today, and someone changes sshd_config tomorrow, turns off the firewall, installs a backdoor service—you’d never know.

MiBeeNvr v0.3.0: One-Click Xiaomi Camera Integration, Recordings Never Lost

Wed, 20 May 2026 00:00:00 +0000

Got Xiaomi cameras at home? Want to keep your recordings on your own storage instead of relying on the cloud?

As someone with several Xiaomi cameras at home, I always had one frustration: every time I wanted to check the footage from my doorbell camera, I had to log into Xiaomi Cloud, wait for ages while it loaded, and it would often just spin. Plus, cloud storage charges by the day — it adds up over the month. And if you swap cameras, all your old recordings are gone. Pretty frustrating.

security-collector-exporter v0.3.0: Real-Time Security Monitoring with eBPF

Tue, 19 May 2026 00:00:00 +0000

From Static to Real-Time

The previous article introduced security-collector-exporter v0.1.0 — turning Linux security configuration states into Prometheus metrics. But v0.1.0 is essentially “snapshot-based”: periodically reading /etc, /proc, capturing the static configuration at a single point in time.

There’s an area of security operations that snapshots can’t cover: real-time security events. Someone running a reverse shell, a process escalating privileges, an abnormal network connection, someone loading a kernel module — these events happen and pass; you’d never see them at your next scrape.

From Hashmod to Jump Consistent Hash — stream-metrics-route Hash Algorithm Upgrade

Sat, 16 May 2026 00:00:00 +0000

Introduction

In the previous article, we reviewed the three-year evolution of stream-metrics-route and mentioned that the “dual hashmod scheduling” is the core scheduling mechanism of the entire gateway. However, during continuous production operation, one fatal flaw of hashmod became increasingly obvious—every scaling operation triggers full data redistribution.

This article documents the complete decision process of migrating from hash % N (hashmod) to Jump Consistent Hash: which candidate algorithms were evaluated, why Jump Hash was ultimately chosen, and the specific impact before and after migration.

The Hidden Trap of Headless Browsers: Why Can't Your Automation Tool Catch Early Page Errors?

Fri, 15 May 2026 00:00:00 +0000

Introduction

You’re debugging a frontend engineering issue — the page is behaving abnormally. You ask an AI to open the page with a browser tool and check the console for errors.

The AI opens the page, scans around, and tells you: The console is clean, no errors whatsoever.

You’re skeptical. You open Chrome DevTools yourself — three bright red errors are staring you in the face, the page has already crashed into a white screen. The AI visited the exact same page using a Headless browser, so why did it catch nothing?

security-collector-exporter: Monitoring Linux Security Auditing

Thu, 14 May 2026 00:00:00 +0000

Why This Was Built

Anyone managing servers has probably had this experience: compliance audit comes, SSH into machines one by one to check—SSH config correct, SELinux enabled, firewall running, any expired accounts, password policies compliant. A few machines are fine; dozens or hundreds becomes purely manual grunt work.

And the more painful part: none of this has continuous monitoring. You check compliance today, someone changes a config tomorrow, and you’d never know.

One Month with the Zhi Theme: Mermaid v11 Upgrade Experience

Wed, 13 May 2026 00:00:00 +0000

One Month In

It’s been nearly a month since the previous article Switched My Blog Theme: From Hugo NexT to Self-Written Zhi. During this month, the theme has been running stably without major issues. Replacing the NexT theme was the right decision — although there was some initial adjustment, the experience is now significantly better.

After a month of use, the theme’s stability has exceeded expectations. My initial concerns — whether pure Hugo Pipes without build tools could support complex requirements — were proven unfounded. Daily maintenance has become very simple; modifying a feature no longer requires digging through deeply nested SCSS files — one CSS file gets the job done.

MiBeeNvr v0.2.0 Update: Docker Deployment, HLS Streaming, Recording Merging, and a Complete Installation Guide

Tue, 12 May 2026 00:00:00 +0000

The previous article introduced MiBeeNvr’s basic features and design philosophy. It’s only been a week since v0.1.0, and v0.2.0 follows right behind. This update is substantial — 15 new features, some I needed myself, others from community feedback.

This article covers three things: what’s new in v0.2.0, how to deploy from scratch, and some practical tips for real-world use.

v0.2.0 New Features Overview

This update has a lot of content. Here’s a breakdown by category:

VictoriaMetrics Stream Aggregation: Three-Year Review and Current Status (2026)

Tue, 12 May 2026 00:00:00 +0000

Introduction

It’s been exactly three years since the previous article Applying VictoriaMetrics Stream Aggregation for Metrics was published in March 2023. In these three years, the VictoriaMetrics ecosystem has undergone tremendous changes—let’s revisit the issues raised in that blog post, see what the official project has resolved, and where our stream-metrics-route project stands today.

I. Problems We Encountered Three Years Ago

Let’s quickly recap the core issue list from the 2023 blog post:

ESP32-CAM Monitor: DIY Auto Flash for Dark Scenes

Fri, 08 May 2026 00:00:00 +0000

Why

I built a surveillance camera with ESP32-S3 before, and it worked well. Later, while rummaging through a drawer, I found an AI-Thinker ESP32-CAM development board — that classic board costing about ten bucks with a built-in OV2640 camera and TF card slot. No reason to let it go to waste, so I built another one: ai-thinker-esp32-cam.

This time I wrote the firmware from scratch using ESP-IDF again, with similar capabilities to the previous project but with lots of adaptations for the AI-Thinker board. Here’s what it ended up doing:

Evolution: Oh My OpenAgent Configuration Iteration Log

Thu, 07 May 2026 00:00:00 +0000

The previous article covered the initial configuration setup. This one documents the adjustments after two weeks of running: expanding from single vendor to a four-tier model pool, adding fallback chains, hitting the GLM-4.5-air trap of analyzing without writing code.

This post covers: fallback strategy design, complete free model pool inventory and analysis, concurrency control configuration, and the decision process for GLM-4.5-air replacement.

After the previous article’s initial configuration, I ran it for two weeks — all the issues that needed fixing surfaced.

MiBeeNvr: A Lightweight Home NVR System I Built

Wed, 06 May 2026 00:00:00 +0000

I have several cameras at home — a few Xiaomi cameras, some DIY ESP32 cameras, and multiple Raspberry Pi CSI cameras. I’d been using cloud storage solutions, but I was never comfortable with them: vendor lock-in, network dependency, and the costs add up. So I decided to build my own NVR system, called MiBeeNvr.

Why Build MiBeeNvr

To be honest, I was never satisfied with existing cloud storage solutions. Take Xiaomi cameras, for example. By default, you can only view them through the Mi Home app. Recordings are either stored on an SD card (limited capacity, frequent plugging/unplugging) or in the cloud. Cloud storage costs tens of dollars per month, and there’s the privacy concern — you never know when the manufacturer might use your video data for AI training or sell it to third parties. Not to mention vendor lock-in — switching platforms is nearly impossible.

Building a Surveillance Camera with ESP32-S3 — WiFi, TF Card, Video Output Pitfalls

Tue, 28 Apr 2026 00:00:00 +0000

Why

We have a few parrots at home, and during the workday nobody’s around. I wanted to check in on them anytime. The requirement sounds simple: real-time video streaming, recording to storage, and ideally automatic backup to NAS. Off-the-shelf cameras are either expensive or require installing apps, registering accounts, and binding phone numbers — privacy concerns. I just want to watch my birds, not stream video to someone else’s server.

Replacing VMs with ESP32 for Network Probing — esp32-blackbox Project in Action

Thu, 23 Apr 2026 00:00:00 +0000

Why

I have several LANs in different locations around the city, roughly 10 km apart. To make these networks talk to each other, I used tools like NetBird, ZeroTier, and Cloudflare Tunnel to set up a cross-region virtual LAN.

The network was set up, but how to ensure stability? After all, these tunnels traverse the public internet with varying link quality. The most direct approach is to use Prometheus’s blackbox_exporter for probing — periodic HTTP requests, Pings, DNS queries — feeding results into a time-series database with alert rules, so problems are detected immediately.

Switched My Blog Theme: From Hugo NexT to Self-Written Zhi

Thu, 16 Apr 2026 00:00:00 +0000

Why Switch

This blog previously used Hugo NexT, forked for custom modifications. NexT itself is a feature-rich theme, but when it comes to “customizing things yourself,” the experience wasn’t great.

The issues boiled down to a few things:

SCSS nesting hell. 101 SCSS files, three levels of directory nesting. _common/components/post, _common/components/third-party, _common/outline/sidebar… To change a style, you first had to figure out which file it was in, where variables were defined, and which scheme was overriding it. Not that it couldn’t be done, but each change meant half an hour of hunting.

Zhipu Coding Plan × Oh My OpenCode: Multi-Model Orchestration Setup Guide

Sun, 05 Apr 2026 00:00:00 +0000

Why Bother

When it comes to writing code with AI, the gap between single-model and multi-model approaches keeps widening. No matter how strong a single model is, it can’t compete with a team of specialized models working in parallel.

Oh My OpenCode (OmO for short) is a multi-model orchestration plugin in the OpenCode ecosystem, with 11 Agents each having distinct responsibilities and 48 Hooks spanning the entire lifecycle. Zhipu’s Coding Plan provides access to the full GLM model series. Combining the two allows you to assign different models by role — strong coders for coding, strong reasoners for reasoning, free models for busywork.

Windows Defender Exclusion Bulk Cleanup Guide

Fri, 03 Apr 2026 00:00:00 +0000

When the Windows Defender exclusion list accumulates a large number of useless entries, you can clean them all at once with a PowerShell one-liner. This article details the entire process, including backup, cleanup, and verification.

Prerequisites

Modifying Defender configuration requires administrator privileges. Open a terminal with sufficient permissions as follows:

Click the Windows Start menu and search for PowerShell
Right-click Windows PowerShell in the search results, then select Run as administrator
Click Yes in the User Account Control (UAC) window to confirm authorization

Step 1: Backup Existing Exclusions (Highly Recommended)

Before cleaning, it is recommended to back up the current exclusion list to prevent accidentally deleting entries you want to keep. If needed later, you can restore from the backup file.

Domestic LLM Resource and Cost Comparison: GLM-5 / Kimi K2.5 / MiniMax M2.7

Mon, 23 Mar 2026 00:00:00 +0000

Overview

This article compares the resource requirements and usage costs of three major domestic LLMs, helping developers choose the right solution for their scenarios.

Model	Vendor	Architecture	Minimum Deployable VRAM	API Available
GLM-5	Zhipu AI	Dense (multiple versions)	24GB (8B)	✅
Kimi K2.5	Moonshot AI	MoE (undisclosed)	24GB (lightweight)	✅
MiniMax M2.7	MiniMax	MoE 230B	Not yet open-sourced	✅

GLM-5 (Zhipu AI)

Versions & Hardware Requirements

GLM-5 offers 4 parameter versions, making it the widest-coverage domestic LLM currently available.

Temperature and Humidity Monitoring with ESP01 Board

Fri, 09 Feb 2024 00:00:00 +0000

Introduction

In IoT applications, temperature and humidity monitoring is a common and important requirement. The ESP01, as a low-cost, low-power WiFi module, provides a convenient solution for implementing temperature and humidity monitoring. This article details how to use the ESP01 board for temperature and humidity monitoring development, including hardware connections, code implementation, and functional analysis.

Hardware Preparation

ESP01 Board: Core control module, responsible for data collection and network communication.
DHT Temperature and Humidity Sensor: Used to measure ambient temperature and humidity.
Dupont Wires: Used to connect the ESP01 and DHT sensor.

Connect the DHT sensor’s VCC pin to the ESP01’s 3.3V pin, the GND pin to GND, and the data pin to the designated pin on the ESP01 (defined as DHTPIN in the code).

eBPF Series: DeepFlow Extended Protocol Parsing Practice (MongoDB Protocol & Kafka Protocol)

Sat, 25 Nov 2023 00:00:00 +0000

Overview

MongoDB is widely used today, but lacks effective observability capabilities. DeepFlow is an excellent solution for observability, but it lacks support for the MongoDB protocol. This article extends DeepFlow with MongoDB protocol parsing, enhancing observability in the MongoDB ecosystem. It briefly describes the process from protocol document analysis to implementing code parsing within DeepFlow.

Applying VictoriaMetrics Stream Aggregation for Metrics

Mon, 27 Mar 2023 00:00:00 +0000

Community VM Stream Aggregation Capability Analysis and Issues

VictoriaMetrics Open-Source Project Native Capabilities

Stream aggregation in the VictoriaMetrics project was integrated into vmagent starting from version 1.86. For details, refer to: https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3460 From the source code analysis, the stream aggregation capability looks like this:

The core computation code is described in the pushSample function:

go


 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39


func (as *totalAggrState) pushSample(inputKey, outputKey string, value float64) {
	currentTime := fasttime.UnixTimestamp()
	deleteDeadline := currentTime + as.intervalSecs + (as.intervalSecs >> 1)
again:
	v, ok := as.m.Load(outputKey)
	if !ok {
		v = &totalStateValue{
			lastValues: make(map[string]*lastValueState),
		}
		vNew, loaded := as.m.LoadOrStore(outputKey, v)
		if loaded {
			v = vNew
		}
	}
	sv := v.(*totalStateValue)
	sv.mu.Lock()
	deleted := sv.deleted
	if !deleted {
		lv, ok := sv.lastValues[inputKey]
		if !ok {
			lv = &lastValueState{}
			sv.lastValues[inputKey] = lv
		}
		d := value
		if ok && lv.value <= value {
			d = value - lv.value
		}
		if ok || currentTime > as.ignoreInputDeadline {
			sv.total += d
		}
		lv.value = value
		lv.deleteDeadline = deleteDeadline
		sv.deleteDeadline = deleteDeadline
	}
	sv.mu.Unlock()
	if deleted {
		goto again
	}
}

General Application Analysis of Stream Aggregation

First, let’s look at the time series chart after stream aggregation:

eBPF Series: A Brief Analysis of Pixie

Fri, 10 Feb 2023 00:00:00 +0000

Deployment process and instructions reference: pixie install

Pixie Platform Main Components

Pixie Edge Module (PEM): Pixie’s agent, installed per node. PEMs use eBPF to collect data, which is stored locally on the node.
Vizier: Pixie’s collector, installed per cluster. Responsible for query execution and managing PEMs.
Pixie Cloud: Used for user management, authentication, and data proxying. Can be hosted or self-hosted.
Pixie CLI: Used to deploy Pixie. Can also be used to run queries and manage resources like API keys.

A Casual Talk About CPU Timing and Modern Operating Systems

Fri, 20 Jan 2023 00:00:00 +0000

First, let’s review time-sharing systems. The time-sharing system is a very important operating system concept that maximizes computer utilization and is a crucial means of implementing multi-program concurrency.

The Linux kernel we use daily also adopts the time-sharing system philosophy, mainly reflected in the following aspects:

Time Slice:

Linux uses a time slice mechanism to divide CPU time. Each process can only execute for one time slice before yielding the CPU to other processes. This achieves CPU time sharing and fair allocation.

Eyes On You: The 2022 Productization Journey of a Multi-Cloud Heterogeneous Monitoring Platform

Mon, 20 Jun 2022 00:00:00 +0000

In the context of multi-cloud deployment, global networking, and exponential growth in service scale within internet businesses, monitoring platforms have long surpassed the basic “metric collection + alert notification” positioning, becoming the core infrastructure for ensuring end-to-end stability. This article, based on the real evolution of a large-scale internet enterprise monitoring platform, dissects the complete planning and implementation approach for upgrading the monitoring platform from large-scale coverage to productization, usability, and intelligence in 2022.

From Bottleneck Breakthrough to Platform Governance — The Full Evolution of an Internet Company's Monitoring Platform Architecture

Mon, 10 Jan 2022 00:00:00 +0000

In the context of rapid internet business expansion, multi-cloud deployment, and exponential asset growth, the monitoring platform is a critical infrastructure for ensuring service stability. This article provides a complete review of a major internet company’s monitoring platform evolution from 2019 to 2021 — from solving legacy monitoring performance bottlenecks, to implementing cross-cloud distributed monitoring, to cloud-native platform governance — presenting the full transformation of the monitoring system from 0 to 1 build → large-scale expansion → platform governance.

Hybrid Cloud Cross-Region Monitoring System Governance: Autonomous + Unified Dual-Core Architecture Practice

Mon, 10 Jan 2022 00:00:00 +0000

In the context of global business expansion and large-scale hybrid cloud deployment, cross-IDC, cross-border, multi-cloud heterogeneous monitoring governance has become a core challenge for stability assurance. Traditional monitoring solutions either rely on expensive dedicated line upgrades that intrude on business architecture, or cannot balance node autonomy with global unification. Meanwhile, as a non-revenue infrastructure, the monitoring system must strictly control resource usage without allowing capability degradation.

This article breaks down a practical cross-region monitoring system governance solution from a real internet company, explaining how to achieve elastic scaling, cross-border coverage, node autonomy, and data unification for the monitoring system without modifying business architecture or incurring business cross-domain costs.

Black-box Probing Monitoring System Architecture Design and Practice for Internet Companies

Tue, 31 Aug 2021 00:00:00 +0000

In the full-link monitoring system of internet services, white-box monitoring focuses on proactively uncovering potential issues and predicting risks, while black-box monitoring is fault-oriented, rapidly detecting problems that have already occurred online. The two work together to form a complete monitoring闭环. Most internet companies have long had a monitoring blind spot for public network services and the user-side last mile. User-side faults often only trigger investigation after users report issues. The black-box probing monitoring system was designed precisely to solve this industry pain point.

Monitoring System Enterprise Architecture Evolution — Probing Monitoring

Sat, 12 Dec 2020 00:00:00 +0000

Recap

In “Monitoring System Enterprise Architecture Evolution — Cross-Region Hybrid Cloud”, the monitoring system had gradually matured and evolved toward enterprise-level capabilities. This chapter briefly describes the construction of the probing capability during this period. Below is the development history of this system. During the construction of the monitoring platform, internal monitoring collection alone was insufficient to meet enterprise business needs. Before planning APM development, remote probing with black-box monitoring was also incorporated as a subsystem.

Monitoring System Enterprise Architecture Evolution — Cross-Region Hybrid Cloud

Mon, 12 Oct 2020 00:00:00 +0000

Recap

In “Monitoring System Enterprise Architecture Evolution — First Steps with Prometheus”, the monitoring system had already been upgraded from a single-node architecture to a single IDC distributed architecture. The content of the previous article applies to both VM-based and container-based deployments. Prometheus is a product of the cloud-native era and is commonly used alongside Kubernetes, but Prometheus itself can also replace traditional monitoring solutions like Zabbix in non-Kubernetes environments. In this article, we begin to use Kubernetes deployment to upgrade the entire monitoring system architecture, making it more flexible for cross-region hybrid cloud business scenarios.

Eyes On You: From SRE Principles to Prometheus Monitoring System Implementation

Sat, 20 Jun 2020 00:00:00 +0000

In the context of distributed internet services, high concurrency, and multi-cloud deployment, SRE (Site Reliability Engineering) has become a core role in ensuring service availability, and the monitoring system serves as SRE’s “eyes.” This article starts from SRE core principles, deconstructs the pain points of modern monitoring systems, technology stack selection, Prometheus core principles, and alerting best practices, presenting a practical enterprise-grade monitoring system construction methodology.

SRE Core Principles: Stability is the #1 Metric

SRE’s core is ensuring continuous service stability through engineering practices, focusing on capacity planning, cluster maintenance, fault tolerance, load balancing, and monitoring system construction. There are only 3 core measurement metrics:

Large Enterprise Email System Architecture Design and Full Mail Flow Analysis

Wed, 10 Jun 2020 00:00:00 +0000

As enterprise digitalization scales up, large organizations demand extreme capabilities from email systems: independent deployment, high availability, global interoperability, security protection, and load balancing. This article breaks down the practical architecture of a dedicated large enterprise email system, covering overall design, physical/logical deployment, core service systems, and the full send/receive mail flow, providing a reference technical solution for enterprise-level email architecture implementation.

I. Overall System Architecture Design

Large enterprise email systems adopt a layered architecture of “frontend gateway layer + load balancing layer + core service layer + backend independent mail system”, balancing security isolation, traffic scheduling, and business independence. The overall architecture is as follows:

Monitoring System Enterprise Architecture Evolution — First Steps with Prometheus

Thu, 12 Dec 2019 00:00:00 +0000

Prometheus is an open-source monitoring and time series database system that has gained widespread adoption in recent years. The official architecture diagram is shown below: This series of articles will gradually understand and deepen various components and concepts through the deployment architecture evolution of Prometheus in an enterprise. First, let’s get a quick overview of this evolution history through the diagram below:

Single Node Architecture

When first getting started with the Prometheus monitoring system, you only need to deploy the Prometheus binary on the server side, using the basic file service discovery configuration file_sd_config to pull metrics from node_exporter for basic host monitoring. Then configure the Prometheus url address as a datasource in Grafana to start viewing monitoring data.

Implementing a Lightweight File Backup System Based on OpenResty

Wed, 30 Jan 2019 00:00:00 +0000

Introduction

There are tools like filebeat for log collection, open-source cloud drives like seafile, and simple distributed file systems like FastDFS, among others. However, the remote backup logs of a certain enterprise SaaS platform still rely on traditional compressed file scp transfers to backup storage.

Since filebeat’s log collection completeness is debatable, open-source cloud drives have cluttered features that are not conducive to management, distributed file systems’ internal storage logic is not well-suited for the backup log management of the enterprise SaaS platform, and scp transfers pose security risks with private keys deployed on servers, we leveraged OpenResty’s features to implement a simple file backup API interface using Lua.

Linux High Availability and Load Balancing in Practice — From Keepalived to Performance Tuning

Tue, 19 Jun 2018 00:00:00 +0000

Introduction

In modern enterprise application architectures, high availability and load balancing are key technologies for ensuring stable system operation. This article provides a detailed introduction to achieving dual-machine hot standby with Keepalived, building internal network service load balancing with HAProxy, and resolving NIC soft interrupt issues for network performance optimization. Through real-world cases and detailed configuration explanations, this article helps readers understand the core principles and practical applications of these technologies.

JVM Performance Tuning and Off-Heap Memory Leak Troubleshooting in Practice

Tue, 16 Jan 2018 00:00:00 +0000

Introduction

JVM performance tuning and memory issue troubleshooting have always been significant challenges for Java developers. This article starts from the three core goals of GC tuning and combines them with a real-world off-heap memory leak investigation case to provide a systematic approach to performance tuning and practical troubleshooting methods.

In complex distributed systems, memory issues are often the hardest to diagnose. Off-heap memory leaks in particular, occurring outside the JVM heap, are difficult to detect with conventional GC monitoring tools and can easily cause systems to crash suddenly in production environments. This article shares a complete off-heap memory leak investigation process, hoping to provide valuable reference for readers.

Overseas Email Delivery Acceleration Architecture — Smart Delivery Network in Practice

Tue, 16 Jan 2018 00:00:00 +0000

Introduction: Challenges of Overseas Email Delivery

In globalized business scenarios, email delivery faces numerous challenges. Overseas email delivery must not only overcome network latency issues but also navigate complex geopolitical network environments. Traditional direct overseas delivery methods often encounter connection timeouts, firewall blocking, and high delivery latency. At the same time, interoperability between domestic email systems and overseas networks also presents technical challenges.

To address these issues, we designed and implemented a Smart Delivery Network (SDN) architecture that effectively improves the efficiency and reliability of overseas email delivery through multi-level proxying, intelligent routing, and load balancing mechanisms.

Advanced Bash Programming Techniques — Handling Message Queue Backlog with the Producer-Consumer Pattern

Wed, 05 Jul 2017 00:00:00 +0000

Introduction

In message system operations, queue backlog is a common and tricky problem. Especially during malicious attacks or system anomalies, the delivery queue may accumulate a large number of messages, severely impacting normal system operation. Traditional single-process processing is not only inefficient but may also cause problems to worsen due to delayed handling.

This article shares a set of advanced Bash programming techniques based on the producer-consumer pattern. Through core technologies including multi-process concurrency, pipe communication, and efficient awk parsing, we achieve fast and effective handling of message queue backlog issues. This solution has been validated in multiple production environments, capable of improving processing efficiency several times over while ensuring system stability.

About me

Fri, 09 Jun 2017 20:12:52 +0800

Profile

I am a engineer with a rich work experience in IT field. I have extensive experience in operations, development and cloud native technologies. I have a passion for observable technologies and cloud native technologies. I have worked on shell scripts, VBA tools, Python, Lua, Golang, C and Rust. I also have experience in embedded development with Arduino and MicroPython.

I am an experienced IT engineer with a diverse career spanning from operations to development. I am passionate about observability technologies and have deep practical knowledge of cloud-native technologies. My technical journey began with shell scripts, then expanded to VBA tool development, followed by mastering Python, Lua, and in-depth study of Golang and Rust. In addition, I have embedded development experience with Arduino and MicroPython.

Practices and Pitfalls of Dockerizing Enterprise Applications — From Traditional Virtualization to Containerization

Mon, 17 Apr 2017 00:00:00 +0000

Introduction (Why Containerize Enterprise Applications)

In the era of cloud computing, the way enterprise applications are deployed and managed is undergoing a profound transformation. While traditional virtualization technology solved the resource isolation problem, it still has many pain points in terms of operational efficiency, resource utilization, and deployment speed. The rise of Docker container technology has provided a brand-new solution for the modernization of enterprise applications.

This article shares our practical experience in the containerization migration of an enterprise email system, including technology selection, infrastructure construction, the full process of migrating from OpenVZ virtualization to Docker, and various issues encountered in production along with their solutions. Through these practical cases, we hope to provide valuable reference for teams that are currently or planning to undertake containerization migration.

A Simple BBR Test on Linode

Mon, 10 Apr 2017 00:00:00 +0000

Overview:

TCP BBR solves two problems:

Fully utilizing bandwidth on network links with some packet loss. Suitable for high-latency, high-bandwidth network links.
Reducing buffer occupancy on network links, thereby lowering latency. Suitable for users with slow access networks.

I remember when BBR was first merged into the Linux 4.9 kernel in 2017, this congestion control algorithm proposed by Google was extremely popular in the tech community. At the time, I was doing cross-border file transfers on Linode, where packet loss was commonplace, so I wanted to test the results firsthand.

Raspberry Pi Docker Cluster

Wed, 08 Mar 2017 00:00:00 +0000

Overview

At the time, I was learning Docker cluster management and wanted a low-cost lab environment to experiment with, so I thought of using Raspberry Pis. Following the Hypriot blog, I bought one Raspberry Pi 2 board and two Raspberry Pi 3 boards. The reasoning was that the Pi 2 was cheaper so it would be the master, and the Pi 3s had better performance for worker nodes — together they made a small cluster.

ARM Board Notes and Experiences

Mon, 27 Feb 2017 00:00:00 +0000

Raspberry Pi

I originally got into Raspberry Pi to set up a Docker cluster environment — mainly because they were cheap and power-efficient. Bought 3 Raspberry Pi 2 boards for around 600+ yuan. Back then, running Docker on ARM was still a novel concept.

I used Raspberry Pi to build a Docker cluster environment, following the Hypriot blog.

CubieBoard

Getting Docker running on ARM was a major challenge back then — official support was poor, community documentation was sparse, and it required a lot of trial and error.

Building a Blog on GitHub

Sun, 26 Feb 2017 00:00:00 +0000

2023 Blog Migration from `hexo` to `hugo`

The main reason was getting tired of hexo taking forever to generate each time, plus the npm package dependency management issues — maintenance was indeed a burden. And hugo, as a static site generator written in Go, is genuinely much faster.

Chose hugo as the tool
Chose Hugo.NexT as the theme
Chose CloudFlare for CDN

The migration process was quite a hassle, mainly converting front matter format from YAML to TOML, and the various configuration differences between themes were quite significant, but eventually it all worked out.

Enterprise Mail System Architecture Design and Mail Flow Analysis

Fri, 24 Feb 2017 00:00:00 +0000

Introduction

In the digital era, email serves as a core communication tool for both internal and external enterprise interactions. Its architecture design directly impacts the stability, security, and performance of mail services. This article explores the three-tier architecture design of enterprise mail systems, provides a detailed analysis of the complete mail receiving and sending processes, and helps readers gain a comprehensive understanding of the technical implementation of modern mail systems.

Monitoring Collection Notes

Mon, 20 Feb 2017 00:00:00 +0000

MySQL Monitoring

MySQL Privilege Best Practices

Privilege control is primarily for security reasons, so follow these best practices:

Grant only the minimum privileges needed to prevent users from doing harm. For example, if a user only needs to query, just grant SELECT privileges, not UPDATE, INSERT, or DELETE.
Restrict the login host when creating users, typically to a specific IP or internal network IP range.
Delete users without passwords after initializing the database. The installation automatically creates some users with no passwords by default.
Set passwords that meet complexity requirements for each user.
Periodically clean up unnecessary users. Revoke privileges or delete users.

Example:

MySQL Operations in Practice — From Optimization, Monitoring to Disaster Recovery

Sat, 18 Feb 2017 00:00:00 +0000

Introduction

In the operations and maintenance of business systems, MySQL databases serve as core components whose performance stability and data security are critical. Based on years of hands-on operational experience, this article comprehensively shares practical MySQL database operations knowledge — from performance optimization, monitoring systems, Binlog management, and high-availability deployment to disaster recovery. These insights come from real-world cases across multiple production environments, covering the full technology stack from daily tuning to emergency incident response. We hope this provides valuable reference for database administrators and operations engineers alike.

SSL Certificate Automation Management — Ansible Batch Deployment and Update Practices

Mon, 13 Feb 2017 00:00:00 +0000

In modern IT infrastructure management, secure management of SSL certificates has become increasingly important. As the number of services grows and certificate renewal cycles shorten, manual certificate management becomes inefficient and error-prone. This article details how to use Ansible for automated batch deployment and renewal of certificates, improving management efficiency and reducing security risks.

The Importance of SSL Certificate Management

SSL certificates are the foundation of network communication security. They ensure:

Building a Cross-City LAN with Docker

Fri, 20 Jan 2017 00:00:00 +0000

Overview

At the time, I had servers both at home and at the office and wanted unified management, but the two internal networks were isolated. Traditional port forwarding was too cumbersome, and some services I didn’t want exposed to the public internet. After trying several approaches, I found Docker OpenVPN to be the most hassle-free solution.

I chose Docker OpenVPN over traditional VPN mainly because containerized deployment is extremely convenient, and certificate management is much simpler. The end result was great — I could access various services on the remote internal network via domain names, saving a lot of configuration hassle.

Boosting Development Efficiency — Linux Development Environment Setup Guide

Wed, 07 Dec 2016 00:00:00 +0000

In modern software development, having an efficient and convenient development environment can significantly improve productivity. This article provides a detailed guide on setting up a complete development environment on Linux, including configuration and usage of the tmux terminal multiplexer, vim code editor, enhanced zsh shell, and git version control.

Prerequisites

Before you begin, make sure your system meets the following minimum requirements:

tmux: version >= 2.1
vim: version >= 7.3
zsh: oh-my-zsh recommended
git: latest version

1. TMUX Terminal Multiplexer Configuration

TMUX is an excellent terminal multiplexer that allows you to create multiple sessions and windows within a single terminal window, making it ideal for developers who need to handle multiple tasks simultaneously.

Complete Distribution of the TCP/IP Protocol Suite in the OSI Model — Understanding Network Protocols at a Glance

Tue, 24 Feb 2015 00:00:00 +0000

Network communication is the cornerstone of modern information technology, and understanding how network protocols work is crucial for every developer and system administrator. This article uses the OSI model framework to provide a detailed introduction to the distribution and roles of each protocol in the TCP/IP protocol suite within the network layer hierarchy.

What is the OSI Model?

The OSI (Open Systems Interconnection) model is a conceptual network model that divides the network communication process into seven layers. Although this model is less popular in practice than the TCP/IP model, it is very helpful for understanding how network protocols work.

Mi&Bee Blog

MiBeeNvr v0.6.0: Timelapse + Transcoding UI + ONVIF Enhancements + Documentation Restructure

MiBeeNvr v0.6.0's Test Machines: Three Camera Projects Updated in Sync

MiBeeNvr v0.5.0: Full ONVIF Protocol Support + Hardware Transcoding + rpi-cam Co-development

Full ONVIF Protocol Support

MiBeeHive: The "Hive" Toolbox I Built for My Studio

MiBeeNvr v0.4.0: Audio Recording Finally Arrives, Auto-Recovery When Cameras Go Down

Recordings Now Have Sound

MiBeeNvr v0.4.0: Audio Recording Pipeline and Multi-Layer Health Monitoring Architecture

Audio Recording: From Silent to Sound

MiBeeNvr v0.3.1: Multi-Protocol Streaming and Native Xiaomi Camera Support

From Compliance to Real-Time Defense: The Evolution of security-collector-exporter

The Origin: Compliance Check Hassles

MiBeeNvr v0.3.0: One-Click Xiaomi Camera Integration, Recordings Never Lost

security-collector-exporter v0.3.0: Real-Time Security Monitoring with eBPF

From Static to Real-Time

From Hashmod to Jump Consistent Hash — stream-metrics-route Hash Algorithm Upgrade

Introduction

The Hidden Trap of Headless Browsers: Why Can't Your Automation Tool Catch Early Page Errors?

Introduction

security-collector-exporter: Monitoring Linux Security Auditing

Why This Was Built

One Month with the Zhi Theme: Mermaid v11 Upgrade Experience

One Month In

MiBeeNvr v0.2.0 Update: Docker Deployment, HLS Streaming, Recording Merging, and a Complete Installation Guide

v0.2.0 New Features Overview

VictoriaMetrics Stream Aggregation: Three-Year Review and Current Status (2026)

Introduction

I. Problems We Encountered Three Years Ago

ESP32-CAM Monitor: DIY Auto Flash for Dark Scenes

Why

Evolution: Oh My OpenAgent Configuration Iteration Log

MiBeeNvr: A Lightweight Home NVR System I Built

Why Build MiBeeNvr

Building a Surveillance Camera with ESP32-S3 — WiFi, TF Card, Video Output Pitfalls

Why

Replacing VMs with ESP32 for Network Probing — esp32-blackbox Project in Action

Why

Switched My Blog Theme: From Hugo NexT to Self-Written Zhi

Why Switch

Zhipu Coding Plan × Oh My OpenCode: Multi-Model Orchestration Setup Guide

Why Bother

Windows Defender Exclusion Bulk Cleanup Guide

Prerequisites

Step 1: Backup Existing Exclusions (Highly Recommended)

Domestic LLM Resource and Cost Comparison: GLM-5 / Kimi K2.5 / MiniMax M2.7

Overview

GLM-5 (Zhipu AI)

Versions & Hardware Requirements

Temperature and Humidity Monitoring with ESP01 Board

Introduction

Hardware Preparation

eBPF Series: DeepFlow Extended Protocol Parsing Practice (MongoDB Protocol & Kafka Protocol)

Overview

Applying VictoriaMetrics Stream Aggregation for Metrics

Community VM Stream Aggregation Capability Analysis and Issues

VictoriaMetrics Open-Source Project Native Capabilities

General Application Analysis of Stream Aggregation

eBPF Series: A Brief Analysis of Pixie

Pixie Platform Main Components

A Casual Talk About CPU Timing and Modern Operating Systems

Time-Sharing Systems and Linux

Time Slice:

Eyes On You: The 2022 Productization Journey of a Multi-Cloud Heterogeneous Monitoring Platform

From Bottleneck Breakthrough to Platform Governance — The Full Evolution of an Internet Company's Monitoring Platform Architecture

Hybrid Cloud Cross-Region Monitoring System Governance: Autonomous + Unified Dual-Core Architecture Practice

Black-box Probing Monitoring System Architecture Design and Practice for Internet Companies

Monitoring System Enterprise Architecture Evolution — Probing Monitoring

Recap

Monitoring System Enterprise Architecture Evolution — Cross-Region Hybrid Cloud

Recap

Eyes On You: From SRE Principles to Prometheus Monitoring System Implementation

SRE Core Principles: Stability is the #1 Metric

Large Enterprise Email System Architecture Design and Full Mail Flow Analysis

I. Overall System Architecture Design

Monitoring System Enterprise Architecture Evolution — First Steps with Prometheus

Single Node Architecture

Implementing a Lightweight File Backup System Based on OpenResty

Introduction

Linux High Availability and Load Balancing in Practice — From Keepalived to Performance Tuning

2023 Blog Migration from `hexo` to `hugo`