YOLO Advanced Optimization: Lightweight, Quantization and Accuracy

Sun, 17 May 2026 00:00:00 +0000

Model Lightweighting Strategies

Model Size Selection

Model	Parameters (M)	mAP	CPU Inference	Use Cases
YOLO26n	2.8	38.9	Fastest	Edge devices, Embedded
YOLO26s	9.4	48.2	Very fast	Mobile, Web
YOLO26m	21.8	53.1	Medium	Server, High performance
YOLO11n	2.6	39.6	Fast	Lightweight deployment
YOLOv8n	3.2	37.3	Baseline	General purpose

Knowledge Distillation

python


 1
 2
 3
 4
 5
 6
 7
 8
 9
10


# Large model as teacher, small model as student
teacher = YOLO("yolo26x.pt")
student = YOLO("yolo26n.yaml")

# Distillation training (Ultralytics built-in support)
student.train(
 data="data.yaml",
 distill="yolo26x.pt", # Teacher model
 distill_ratio=0.5, # Distillation loss ratio
)

Model Pruning

Structured vs Unstructured Pruning

Type	Method	Sparsity Pattern	Hardware Acceleration	Compression Ratio
Unstructured	Weight pruning	Random sparse	Difficult (special HW needed)	High
Structured	Channel pruning	Regular sparse	Native acceleration	Medium

Torch Prune Channel Pruning Example

python


 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25


import torch
import torch.nn.utils.prune as prune

# L1 unstructured pruning on conv layers
model = YOLO("yolo26n.pt")
for name, module in model.model.named_modules():
 if isinstance(module, torch.nn.Conv2d):
 prune.l1_unstructured(module, name="weight", amount=0.3)
 prune.remove(module, "weight") # Make pruning permanent

# Channel pruning with torch-pruning library
# pip install torch-pruning
import torch_pruning as tp

model = YOLO("yolo26n.pt").model
DG = tp.DependencyGraph()
DG.build_dependency(model, example_inputs=torch.randn(1, 3, 640, 640))

# Prune 20% channels by L1 norm
pruning_plan = DG.get_pruning_plan(
 model.model[4], tp.prune_conv,
 pruning_dim=0, # Output channel dimension
 idxs=list(range(0, 64, 5)) # Keep every 5th channel
)
pruning_plan.exec()

Pruning Ratio Guidelines

Model	Safe Ratio	Aggressive Ratio	mAP Drop
YOLO26n	≤20%	20-40%	<1% / 2-5%
YOLO26s	≤30%	30-50%	<1% / 3-6%
YOLO26m	≤40%	40-60%	<1% / 3-8%
YOLOv8n	≤20%	20-35%	<1% / 2-4%

Model Pruning and Quantization

Export Time Quantization

python


 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16


model = YOLO("yolo26n.pt")

# INT8 quantization (requires calibration data)
model.export(
 format="engine", # TensorRT
 int8=True,
 data="data.yaml", # Calibration dataset
 batch=8,
)

# ONNX dynamic quantization
model.export(
 format="onnx",
 dynamic=True,
 simplify=True,
)

TensorRT INT8 Calibration Step-by-Step

Calibration Dataset Preparation

INT8 quantization requires representative calibration data to determine activation value ranges:

Knowledge Distillation on Mi&Bee Blog

YOLO Advanced Optimization: Lightweight, Quantization and Accuracy

Model Lightweighting Strategies

Model Size Selection

Knowledge Distillation

Model Pruning

Structured vs Unstructured Pruning

Torch Prune Channel Pruning Example

Pruning Ratio Guidelines

Model Pruning and Quantization

Export Time Quantization

TensorRT INT8 Calibration Step-by-Step

Calibration Dataset Preparation