Visual Feature Extraction and Tracking Method Based on Corner Flow Detection
Article Information
Abstract
Front-end feature tracking based on vision is the process in which a robot captures images of its surrounding environment using a camera while in motion. Each frame of the image is then analyzed to extract feature points, which are subsequently matched between pairwise frames to estimate the robot’s pose changes by solving for the variations in these points. While feature matching methods that rely on descriptor-based approaches perform well in cases of significant lighting and texture variations, the addition of descriptors increases computational cost and introduces instability. Therefore, in this paper, a novel approach is proposed that combines sparse optical flow tracking with Shi-Tomasi corner detection, replacing the use of descriptors. This new method offers improved stability in situations of challenging lighting and texture variations while maintaining lower computational cost. Experimental results, validated using the OpenCV library on the Ubuntu operating system, demonstrate the algorithm's effectiveness and efficiency.
Graphical Abstract
Keywords
Data Availability Statement
Funding
Conflicts of Interest
Ethical Approval and Consent to Participate
References
- Papanikolopoulos, N. P., Khosla, P. K., & Kanade, T. (1993). Visual tracking of a moving target by a camera mounted on a robot: A combination of control and vision. IEEE transactions on robotics and automation, 9(1), 14-35.
[CrossRef] [Google Scholar] - Li, S., & Yeung, D. Y. (2017, February). Visual object tracking for unmanned aerial vehicles: A benchmark and new motion models. In Proceedings of the AAAI conference on artificial intelligence (Vol. 31, No. 1).
[CrossRef] [Google Scholar] - Jiao, L., Wang, D., Bai, Y., Chen, P., & Liu, F. (2021). Deep learning in visual tracking: A review. IEEE transactions on neural networks and learning systems, 34(9), 5497-5516.
[CrossRef] [Google Scholar] - Marvasti-Zadeh, S. M., Cheng, L., Ghanei-Yakhdan, H., & Kasaei, S. (2021). Deep learning for visual tracking: A comprehensive survey. IEEE Transactions on Intelligent Transportation Systems, 23(5), 3943-3968.
[CrossRef] [Google Scholar] - Haifeng, L., Zunhe, H., & Xinwei, C. (2017). PLP-SLAM: A visual SLAM method based on point line and surface feature fusion. Robot, 39(02), 214-220.
[Google Scholar] - Noble, J. A. (1988). Finding corners. Image and vision computing, 6(2), 121-128.
[CrossRef] [Google Scholar] - Agarwal, A., Gupta, S., & Singh, D. K. (2016, December). Review of optical flow technique for moving object detection. In 2016 2nd international conference on contemporary computing and informatics (IC3I) (pp. 409-413). IEEE.
[CrossRef] [Google Scholar] - Nie, G. Y., Bodda, S. S., Sandhu, H. K., Han, K., & Gupta, A. (2022). Computer-vision-based vibration tracking using a digital camera: A sparse-optical-flow-based target tracking method. Sensors, 22(18), 6869.
[CrossRef] [Google Scholar] - Plyer, A., Le Besnerais, G., & Champagnat, F. (2016). Massively parallel Lucas Kanade optical flow for real-time video processing applications. Journal of Real-Time Image Processing, 11(4), 713-730.
[CrossRef] [Google Scholar] - Sinha, S. N., Frahm, J. M., Pollefeys, M., & Genc, Y. (2006, May). GPU-based video feature tracking and matching. In EDGE, workshop on edge computing using new commodity architectures (Vol. 278, p. 4321).
[Google Scholar] - Abdullah, L. M., Tahir, N. M., & Samad, M. (2012, July). Video stabilization based on point feature matching technique. In 2012 IEEE Control and System Graduate Research Colloquium (pp. 303-307). IEEE.
[CrossRef] [Google Scholar] - Kulkarni, S., Bormane, D. S., & Nalbalwar, S. L. (2017, January). Video stabilization using feature point matching. In Journal of Physics: Conference Series (Vol. 787, No. 1, p. 012017). IOP Publishing.
[CrossRef] [Google Scholar] - Lim, J., Ross, D., Lin, R. S., & Yang, M. H. (2004). Incremental learning for visual tracking. Advances in neural information processing systems, 17.
[Google Scholar] - Cazzato, D., Cimarelli, C., Sanchez-Lopez, J. L., Voos, H., & Leo, M. (2020). A survey of computer vision methods for 2d object detection from unmanned aerial vehicles. Journal of Imaging, 6(8), 78.
[CrossRef] [Google Scholar] - Shi, J. (1994, June). Good features to track. In 1994 Proceedings of IEEE conference on computer vision and pattern recognition (pp. 593-600). IEEE.
[CrossRef] [Google Scholar]
Cited By (15)
-
Wei Chen, Shanqing Wan. Lightweight pose detection for marathon sports based on improved Center Net algorithm.
Discover Artificial Intelligence, 2026 , 6 (1).
[CrossRef] -
Khadijah Alkandary, Ahmet Serhat Yildiz, Hongying Meng. Enhancing Multi Object Tracking with CLIP: A Comparative Study on DeepSORT and StrongSORT.
Electronics, 2026 , 15 (2).
[CrossRef] -
Hexuan Ren. Research on embodied agent multimodal perception and real-time path planning algorithms for complex unstructured environments.
Frontiers in Neurorobotics, 2026 , 20 .
[CrossRef] -
Samuel Appleby, Giacomo Bergami, Gary Ushaw. From Camera Image to Active Target Tracking: Modelling, Encoding and Metrical Analysis for Unmanned Underwater Vehicles.
AI, 2025 , 6 (4).
[CrossRef] -
Tian Qin, Guang Cheng, Zhichao Yin, Yichen Wei, Zifan Yao, Zihan Chen. Building robust traffic classifier under low quality data: A federated contrastive learning approach.
Digital Communications and Networks, 2025 , 11 (5).
[CrossRef] -
Peng Tang, Zhibin Yu. Self-supervised visual assessment of railway track curvature via homography learning based on projective curvilinear geometry model.
Engineering Applications of Artificial Intelligence, 2025 , 162 .
[CrossRef] -
Tae-Moon Seo, Dong-Joong Kang. Disentangled reflectance-ambient feature learning for day-night vehicle re-identification.
Applied Soft Computing, 2025 , 181 .
[CrossRef] -
Jianfeng Han, Xiongwei Gao, Lili Song, Jiandong Fang, Yongzhao Tao, Haixin Deng, Jie Yao. A New Algorithm for Visual Navigation in Unmanned Aerial Vehicle Water Surface Inspection.
Sensors, 2025 , 25 (8).
[CrossRef] -
Ziyu Wu, Minghao Li, Yang Han, Xin Feng. Semantic segmentation of 3D point cloud for sewer defect detection using an integrated global and local deep learning network.
Measurement, 2025 , 253 .
[CrossRef] -
Long Zhao, Jinhui Su, Yusheng Zhong, Weiwei Xie, Jinya Su, Xisong Chen, Congyan Chen, Shihua Li. BeltLineNet: A Shape-Prior-Guided Lightweight Network for Real-Time Deviation Detection in Circular Pipe Conveyors.
IEEE Sensors Journal, 2025 , 25 (11).
[CrossRef] -
Lei Feng, Fan Wu, Xuguang Chai. A Deep Learning-Based Feature Extraction and Knowledge Discovery Method for Spatiotemporal Graph Data.
IEEE Transactions on Computational Social Systems, 2025 , 12 (6).
[CrossRef] -
Romas Vijeikis, Ibidapo Dare Dada, Adebayo A. Abayomi-Alli, Vidas Raudonis. Enhancing Driver Monitoring Systems Based on Novel Multi-Task Fusion Algorithm.
Sensors, 2025 , 25 (21).
[CrossRef] -
Zhuoheng Xiang, Jiaxi Guo, Jin Meng, Xin Meng, Yan Li, Jonghyuk Kim, Shifeng Wang, Bo Lu, Yu Chen, Sukhjit Singh Sehra. Accurate localization of indoor high similarity scenes using visual slam combined with loop closure detection algorithm.
PLOS ONE, 2024 , 19 (12).
[CrossRef] -
Jing Zhang, Bin Li, Jun Li. A Novel Semantic Segmentation Method for Remote Sensing Images Through Adaptive Scale-Based Convolution Neural Network.
IEEE Access, 2024 , 12 .
[CrossRef] -
Fafa Wang, Shenglun Yi. Spatio-temporal Feature Soft Correlation Concatenation Aggregation Structure for Video Action Recognition Networks.
ICCK Transactions on Sensing, Communication, and Control, 2024 , 1 (1).
[CrossRef]
Cite This Article
TY - JOUR AU - Li, Jiaxi AU - Wang, Binbin AU - Ma, Huijun AU - Gao, Longfei AU - Fu, Heran PY - 2024 DA - 2024/05/15 TI - Visual Feature Extraction and Tracking Method Based on Corner Flow Detection JO - ICCK Transactions on Intelligent Systematics T2 - ICCK Transactions on Intelligent Systematics JF - ICCK Transactions on Intelligent Systematics VL - 1 IS - 1 SP - 3 EP - 9 DO - 10.62762/TIS.2024.136895 UR - https://www.icck.org/article/abs/TIS.2024.136895 KW - computer vision KW - feature tracking KW - optical flow method KW - visual features KW - visual tracking AB - Front-end feature tracking based on vision is the process in which a robot captures images of its surrounding environment using a camera while in motion. Each frame of the image is then analyzed to extract feature points, which are subsequently matched between pairwise frames to estimate the robot’s pose changes by solving for the variations in these points. While feature matching methods that rely on descriptor-based approaches perform well in cases of significant lighting and texture variations, the addition of descriptors increases computational cost and introduces instability. Therefore, in this paper, a novel approach is proposed that combines sparse optical flow tracking with Shi-Tomasi corner detection, replacing the use of descriptors. This new method offers improved stability in situations of challenging lighting and texture variations while maintaining lower computational cost. Experimental results, validated using the OpenCV library on the Ubuntu operating system, demonstrate the algorithm's effectiveness and efficiency. SN - 3068-5079 PB - Institute of Central Computation and Knowledge LA - English ER -
@article{Li2024Visual,
author = {Jiaxi Li and Binbin Wang and Huijun Ma and Longfei Gao and Heran Fu},
title = {Visual Feature Extraction and Tracking Method Based on Corner Flow Detection},
journal = {ICCK Transactions on Intelligent Systematics},
year = {2024},
volume = {1},
number = {1},
pages = {3-9},
doi = {10.62762/TIS.2024.136895},
url = {https://www.icck.org/article/abs/TIS.2024.136895},
abstract = {Front-end feature tracking based on vision is the process in which a robot captures images of its surrounding environment using a camera while in motion. Each frame of the image is then analyzed to extract feature points, which are subsequently matched between pairwise frames to estimate the robot’s pose changes by solving for the variations in these points. While feature matching methods that rely on descriptor-based approaches perform well in cases of significant lighting and texture variations, the addition of descriptors increases computational cost and introduces instability. Therefore, in this paper, a novel approach is proposed that combines sparse optical flow tracking with Shi-Tomasi corner detection, replacing the use of descriptors. This new method offers improved stability in situations of challenging lighting and texture variations while maintaining lower computational cost. Experimental results, validated using the OpenCV library on the Ubuntu operating system, demonstrate the algorithm's effectiveness and efficiency.},
keywords = {computer vision, feature tracking, optical flow method, visual features, visual tracking},
issn = {3068-5079},
publisher = {Institute of Central Computation and Knowledge}
}
Publisher's Note
ICCK stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and Permissions
Portico