ByteDance Releases Multi-Object Tracking Library Named “ByteTrack”
Video and Language analytics platform ByteDance recently announced the release of its Multi-Object Tracking library for estimating bounding boxes and identities of objects in videos, named ByteTrack. The library aims to solve the problem of detecting objects with low detection scores, e.g. occluded objects that are simply thrown away, and bring non-negligible true objects missing and fragmented trajectories. ByteTrack uses a simple, effective and generic association method, tracking by associating every detection box instead of only the high score ones. For the low score detection boxes, it utilizes their similarities with tracklets to recover true objects and filter out the background detections. Image: ByteTrack Research Paper ByteTrack uses BYTE technology, which is different from traditional methods, which only keep the high score detection boxes. BYTE keeps every detection box and separates them into high score ones and low score ones. It first associates the high score detection boxes to the tracklets. Some tracklets get unmatched because it does not match to an appropriate high score detection box, which usually happens when occlusion, motion blur or size changing occurs. Then it associates the low score detection boxes and these unmatched tracklets to recover the objects in low score detection boxes and filter out the background simultaneously. Image: ByteTrack Research Paper The input of BYTE is a video sequence V, along with an object detector and the Kalman filter. ByteTrack is equipped with a high-performance detector named YOLOX, along with the association method BYTE. YOLOX switches the YOLO series detectors to an anchor-free manner and conducts other advanced detection techniques, including decoupled heads, strong data augmentations, such as Mosaic and Mixup with effective label assignment strategy SimOTA, to achieve state-of-the-art performance on object detection Image: ByteTrack Research Paper ByteTrack was evaluated on the half validation set of MOT17 using different combinations of training data. When using only the half training set of MOT17, the performance achieves 75.8 MOTA, outperforming most methods. This is because it uses strong augmentations such as Mosaic and Mixup. When further adding CrowdHuman, Cityperson and ETHZ for training, we can achieve 76.7 MOTA and 79.7 IDF1. ByteTrack is very robust to occlusion for its accurate detection performance and the help of associating low score detection boxes. The model also sheds light on making the best use of detection results to enhance multi-object tracking. The research team hopes that the high accuracy, fast speed and simplicity of ByteTrack can make it attractive and effective in real applications.
The research team hopes that the high accuracy, fast speed and simplicity of ByteTrack can make it attractive and effective in real applications.
The model also sheds light on making the best use of detection results with the model to enhance multi-object tracking.
["AI (Artificial Intelligence)", "Data Science", "Deep Learning", "image", "image processing", "image recognition", "image reconstruction", "image segmentation", "Machine Learning", "Object Detection", "Object Detection techniques", "object recognition", "Python"]
["object detection", "R", "analytics platform", "Object Detection techniques", "image reconstruction", "image recognition", "RAG", "analytics", "Data Science", "object recognition", "image processing", "AI", "Machine Learning", "Object Detection", "image", "data augmentation", "image segmentation", "programming_languages:R", "Python", "Aim", "YOLO", "Deep Learning", "AI (Artificial Intelligence)"]
["AI", "analytics", "Aim", "RAG", "object detection", "R", "YOLO", "data augmentation", "analytics platform", "programming_languages:R"]
Victor is an aspiring Data Scientist &amp; is a Master of Science in Data Science &amp; Big Data Analytics. He is a Researcher, a Data Science Influencer and also an Ex-University Football Player. A keen learner of new developments in Data Science and Artificial Intelligence, he is committed to growing the Data Science community.