Visual Feature Extraction and Tracking Method Based on Corner Flow Detection
Research Article  ·  Published: 15 May 2024
Issue cover
ICCK Transactions on Intelligent Systematics
Volume 1, Issue 1, 2024: 3-9
Research Article Free to Read

Visual Feature Extraction and Tracking Method Based on Corner Flow Detection

1 National Engineering Laboratory for Agri-product Quality Traceability, BTBU, Beijing, China
* Corresponding Author: Huijun Ma, [email protected]
Volume 1, Issue 1

Article Information

Abstract

Front-end feature tracking based on vision is the process in which a robot captures images of its surrounding environment using a camera while in motion. Each frame of the image is then analyzed to extract feature points, which are subsequently matched between pairwise frames to estimate the robot’s pose changes by solving for the variations in these points. While feature matching methods that rely on descriptor-based approaches perform well in cases of significant lighting and texture variations, the addition of descriptors increases computational cost and introduces instability. Therefore, in this paper, a novel approach is proposed that combines sparse optical flow tracking with Shi-Tomasi corner detection, replacing the use of descriptors. This new method offers improved stability in situations of challenging lighting and texture variations while maintaining lower computational cost. Experimental results, validated using the OpenCV library on the Ubuntu operating system, demonstrate the algorithm's effectiveness and efficiency.

Graphical Abstract

Visual Feature Extraction and Tracking Method Based on Corner Flow Detection

Keywords

computer vision feature tracking optical flow method visual features visual tracking

Data Availability Statement

Data will be made available on request.

Funding

This work was supported in part by the National Natural Science Foundation of China under Grant 62173007, Grant 62006008, and Grant 62203020; in part by the Project of Humanities and Social Sciences (Ministry of Education in China, MOC) under Grant 22YJCZH006.

Conflicts of Interest

The authors declare no conflicts of interest.

Ethical Approval and Consent to Participate

Not applicable.

References

  1. Papanikolopoulos, N. P., Khosla, P. K., & Kanade, T. (1993). Visual tracking of a moving target by a camera mounted on a robot: A combination of control and vision. IEEE transactions on robotics and automation, 9(1), 14-35.
    [CrossRef] [Google Scholar]
  2. Li, S., & Yeung, D. Y. (2017, February). Visual object tracking for unmanned aerial vehicles: A benchmark and new motion models. In Proceedings of the AAAI conference on artificial intelligence (Vol. 31, No. 1).
    [CrossRef] [Google Scholar]
  3. Jiao, L., Wang, D., Bai, Y., Chen, P., & Liu, F. (2021). Deep learning in visual tracking: A review. IEEE transactions on neural networks and learning systems, 34(9), 5497-5516.
    [CrossRef] [Google Scholar]
  4. Marvasti-Zadeh, S. M., Cheng, L., Ghanei-Yakhdan, H., & Kasaei, S. (2021). Deep learning for visual tracking: A comprehensive survey. IEEE Transactions on Intelligent Transportation Systems, 23(5), 3943-3968.
    [CrossRef] [Google Scholar]
  5. Haifeng, L., Zunhe, H., & Xinwei, C. (2017). PLP-SLAM: A visual SLAM method based on point line and surface feature fusion. Robot, 39(02), 214-220.
    [Google Scholar]
  6. Noble, J. A. (1988). Finding corners. Image and vision computing, 6(2), 121-128.
    [CrossRef] [Google Scholar]
  7. Agarwal, A., Gupta, S., & Singh, D. K. (2016, December). Review of optical flow technique for moving object detection. In 2016 2nd international conference on contemporary computing and informatics (IC3I) (pp. 409-413). IEEE.
    [CrossRef] [Google Scholar]
  8. Nie, G. Y., Bodda, S. S., Sandhu, H. K., Han, K., & Gupta, A. (2022). Computer-vision-based vibration tracking using a digital camera: A sparse-optical-flow-based target tracking method. Sensors, 22(18), 6869.
    [CrossRef] [Google Scholar]
  9. Plyer, A., Le Besnerais, G., & Champagnat, F. (2016). Massively parallel Lucas Kanade optical flow for real-time video processing applications. Journal of Real-Time Image Processing, 11(4), 713-730.
    [CrossRef] [Google Scholar]
  10. Sinha, S. N., Frahm, J. M., Pollefeys, M., & Genc, Y. (2006, May). GPU-based video feature tracking and matching. In EDGE, workshop on edge computing using new commodity architectures (Vol. 278, p. 4321).
    [Google Scholar]
  11. Abdullah, L. M., Tahir, N. M., & Samad, M. (2012, July). Video stabilization based on point feature matching technique. In 2012 IEEE Control and System Graduate Research Colloquium (pp. 303-307). IEEE.
    [CrossRef] [Google Scholar]
  12. Kulkarni, S., Bormane, D. S., & Nalbalwar, S. L. (2017, January). Video stabilization using feature point matching. In Journal of Physics: Conference Series (Vol. 787, No. 1, p. 012017). IOP Publishing.
    [CrossRef] [Google Scholar]
  13. Lim, J., Ross, D., Lin, R. S., & Yang, M. H. (2004). Incremental learning for visual tracking. Advances in neural information processing systems, 17.
    [Google Scholar]
  14. Cazzato, D., Cimarelli, C., Sanchez-Lopez, J. L., Voos, H., & Leo, M. (2020). A survey of computer vision methods for 2d object detection from unmanned aerial vehicles. Journal of Imaging, 6(8), 78.
    [CrossRef] [Google Scholar]
  15. Shi, J. (1994, June). Good features to track. In 1994 Proceedings of IEEE conference on computer vision and pattern recognition (pp. 593-600). IEEE.
    [CrossRef] [Google Scholar]

Cited By (15)

  1. Wei Chen, Shanqing Wan. Lightweight pose detection for marathon sports based on improved Center Net algorithm. Discover Artificial Intelligence, 2026 , 6 (1).
    [CrossRef]
  2. Khadijah Alkandary, Ahmet Serhat Yildiz, Hongying Meng. Enhancing Multi Object Tracking with CLIP: A Comparative Study on DeepSORT and StrongSORT. Electronics, 2026 , 15 (2).
    [CrossRef]
  3. Hexuan Ren. Research on embodied agent multimodal perception and real-time path planning algorithms for complex unstructured environments. Frontiers in Neurorobotics, 2026 , 20 .
    [CrossRef]
  4. Samuel Appleby, Giacomo Bergami, Gary Ushaw. From Camera Image to Active Target Tracking: Modelling, Encoding and Metrical Analysis for Unmanned Underwater Vehicles. AI, 2025 , 6 (4).
    [CrossRef]
  5. Tian Qin, Guang Cheng, Zhichao Yin, Yichen Wei, Zifan Yao, Zihan Chen. Building robust traffic classifier under low quality data: A federated contrastive learning approach. Digital Communications and Networks, 2025 , 11 (5).
    [CrossRef]
  6. Peng Tang, Zhibin Yu. Self-supervised visual assessment of railway track curvature via homography learning based on projective curvilinear geometry model. Engineering Applications of Artificial Intelligence, 2025 , 162 .
    [CrossRef]
  7. Tae-Moon Seo, Dong-Joong Kang. Disentangled reflectance-ambient feature learning for day-night vehicle re-identification. Applied Soft Computing, 2025 , 181 .
    [CrossRef]
  8. Jianfeng Han, Xiongwei Gao, Lili Song, Jiandong Fang, Yongzhao Tao, Haixin Deng, Jie Yao. A New Algorithm for Visual Navigation in Unmanned Aerial Vehicle Water Surface Inspection. Sensors, 2025 , 25 (8).
    [CrossRef]
  9. Ziyu Wu, Minghao Li, Yang Han, Xin Feng. Semantic segmentation of 3D point cloud for sewer defect detection using an integrated global and local deep learning network. Measurement, 2025 , 253 .
    [CrossRef]
  10. Long Zhao, Jinhui Su, Yusheng Zhong, Weiwei Xie, Jinya Su, Xisong Chen, Congyan Chen, Shihua Li. BeltLineNet: A Shape-Prior-Guided Lightweight Network for Real-Time Deviation Detection in Circular Pipe Conveyors. IEEE Sensors Journal, 2025 , 25 (11).
    [CrossRef]
  11. Lei Feng, Fan Wu, Xuguang Chai. A Deep Learning-Based Feature Extraction and Knowledge Discovery Method for Spatiotemporal Graph Data. IEEE Transactions on Computational Social Systems, 2025 , 12 (6).
    [CrossRef]
  12. Romas Vijeikis, Ibidapo Dare Dada, Adebayo A. Abayomi-Alli, Vidas Raudonis. Enhancing Driver Monitoring Systems Based on Novel Multi-Task Fusion Algorithm. Sensors, 2025 , 25 (21).
    [CrossRef]
  13. Zhuoheng Xiang, Jiaxi Guo, Jin Meng, Xin Meng, Yan Li, Jonghyuk Kim, Shifeng Wang, Bo Lu, Yu Chen, Sukhjit Singh Sehra. Accurate localization of indoor high similarity scenes using visual slam combined with loop closure detection algorithm. PLOS ONE, 2024 , 19 (12).
    [CrossRef]
  14. Jing Zhang, Bin Li, Jun Li. A Novel Semantic Segmentation Method for Remote Sensing Images Through Adaptive Scale-Based Convolution Neural Network. IEEE Access, 2024 , 12 .
    [CrossRef]
  15. Fafa Wang, Shenglun Yi. Spatio-temporal Feature Soft Correlation Concatenation Aggregation Structure for Video Action Recognition Networks. ICCK Transactions on Sensing, Communication, and Control, 2024 , 1 (1).
    [CrossRef]
* Citation data provided by Crossref Cited-by.

Cite This Article

APA Style
Li, J., Wang, B., Ma, H., Gao, L., & Fu, H. (2024). Visual Feature Extraction and Tracking Method Based on Corner Flow Detection. ICCK Transactions on Intelligent Systematics, 1(1), 3-9. https://doi.org/10.62762/TIS.2024.136895
Export Citation
RIS Format
Compatible with EndNote, Zotero, Mendeley, and other reference managers
TY  - JOUR
AU  - Li, Jiaxi
AU  - Wang, Binbin
AU  - Ma, Huijun
AU  - Gao, Longfei
AU  - Fu, Heran
PY  - 2024
DA  - 2024/05/15
TI  - Visual Feature Extraction and Tracking Method Based on Corner Flow Detection
JO  - ICCK Transactions on Intelligent Systematics
T2  - ICCK Transactions on Intelligent Systematics
JF  - ICCK Transactions on Intelligent Systematics
VL  - 1
IS  - 1
SP  - 3
EP  - 9
DO  - 10.62762/TIS.2024.136895
UR  - https://www.icck.org/article/abs/TIS.2024.136895
KW  - computer vision
KW  - feature tracking
KW  - optical flow method
KW  - visual features
KW  - visual tracking
AB  - Front-end feature tracking based on vision is the process in which a robot captures images of its surrounding environment using a camera while in motion. Each frame of the image is then analyzed to extract feature points, which are subsequently matched between pairwise frames to estimate the robot’s pose changes by solving for the variations in these points. While feature matching methods that rely on descriptor-based approaches perform well in cases of significant lighting and texture variations, the addition of descriptors increases computational cost and introduces instability. Therefore, in this paper, a novel approach is proposed that combines sparse optical flow tracking with Shi-Tomasi corner detection, replacing the use of descriptors. This new method offers improved stability in situations of challenging lighting and texture variations while maintaining lower computational cost. Experimental results, validated using the OpenCV library on the Ubuntu operating system, demonstrate the algorithm's effectiveness and efficiency.
SN  - 3068-5079
PB  - Institute of Central Computation and Knowledge
LA  - English
ER  - 
BibTeX Format
Compatible with LaTeX, BibTeX, and other reference managers
@article{Li2024Visual,
  author = {Jiaxi Li and Binbin Wang and Huijun Ma and Longfei Gao and Heran Fu},
  title = {Visual Feature Extraction and Tracking Method Based on Corner Flow Detection},
  journal = {ICCK Transactions on Intelligent Systematics},
  year = {2024},
  volume = {1},
  number = {1},
  pages = {3-9},
  doi = {10.62762/TIS.2024.136895},
  url = {https://www.icck.org/article/abs/TIS.2024.136895},
  abstract = {Front-end feature tracking based on vision is the process in which a robot captures images of its surrounding environment using a camera while in motion. Each frame of the image is then analyzed to extract feature points, which are subsequently matched between pairwise frames to estimate the robot’s pose changes by solving for the variations in these points. While feature matching methods that rely on descriptor-based approaches perform well in cases of significant lighting and texture variations, the addition of descriptors increases computational cost and introduces instability. Therefore, in this paper, a novel approach is proposed that combines sparse optical flow tracking with Shi-Tomasi corner detection, replacing the use of descriptors. This new method offers improved stability in situations of challenging lighting and texture variations while maintaining lower computational cost. Experimental results, validated using the OpenCV library on the Ubuntu operating system, demonstrate the algorithm's effectiveness and efficiency.},
  keywords = {computer vision, feature tracking, optical flow method, visual features, visual tracking},
  issn = {3068-5079},
  publisher = {Institute of Central Computation and Knowledge}
}

Article Metrics

Citations
Crossref
15
Scopus
16
Views
5828
PDF Downloads
1418

Publisher's Note

ICCK stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and Permissions

Institute of Central Computation and Knowledge (ICCK) or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
ICCK Transactions on Intelligent Systematics
ICCK Transactions on Intelligent Systematics
ISSN: 3068-5079 (Online) | ISSN: 3069-003X (Print)
Portico
Preserved at
Portico