High-Performance Discriminative Tracking with Transformers

End-to-end discriminative trackers improve the state of the art significantly, yet the improvement in robustness and efficiency is restricted by the conventional discriminative model, i.e., least-squares based regression. In this paper, we present DTT, a novel single-object discriminative tracker, b...

Full description

Saved in:
Bibliographic Details
Main Authors: Yu, Bin, Tang, Ming, Zheng, Linyu, Zhu, Guibo, Wang, Jinqiao, Feng, Hao, Feng, Xuetao, Lu, Hanqing
Format: Conference Proceeding
Language:English
Subjects:
Benchmark testing
Computer architecture
Computer vision
Motion and tracking
Pipelines
Target tracking
Transformers
Visualization
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:End-to-end discriminative trackers improve the state of the art significantly, yet the improvement in robustness and efficiency is restricted by the conventional discriminative model, i.e., least-squares based regression. In this paper, we present DTT, a novel single-object discriminative tracker, based on an encoder-decoder Transformer architecture. By self- and encoder-decoder attention mechanisms, our approach is able to exploit the rich scene information in an end-to-end manner, effectively removing the need for hand-designed discriminative models. In online tracking, given a new test frame, dense prediction is performed at all spatial positions. Not only location, but also bounding box of the target object is obtained in a robust fashion, streamlining the discriminative tracking pipeline. DTT is conceptually simple and easy to implement. It yields state-of-the-art performance on four popular benchmarks including GOT-10k, LaSOT, NfS, and TrackingNet while running at over 50 FPS, confirming its effectiveness and efficiency. We hope DTT may provide a new perspective for single-object visual tracking.
ISSN:2380-7504
DOI:10.1109/ICCV48922.2021.00971