Multi-frame Network Feature Fusion Model and Self-attention Mechanism for Vehicle Lane Line Detection

Guang Zhu1, Yajuan Liu2 and Jiyue Wang1, 3

  1. School of Vehicle and Traffic Engineering, Zhengzhou University of Science and Technology
    Zhengzhou 450064 China
    zhuguangzz@163.com
  2. School of Foreign Languages, Zhengzhou University of Science and Technology
    Zhengzhou 450064 China
    xdwangxd@163.com

Abstract

The traditional lane detection networks mainly use independent single frame images to extract features first and then detect them, which cannot deal with the scene with complex background well. Therefore, this paper proposes a lane parallel detection network based on multi-frame network feature fusion model and self-attention mechanism according to the scene characteristics that vehicles can obtain continuous images during normal driving. Firstly, a parallel feature extraction structure is designed. On the one hand, a single frame network with high precision is used to extract the features of the current frame. On the other hand, a lightweight multi-frame network is designed to extract features of low-resolution multi-frame temporal images. And the recurrent neural network module is used to fuse the extracted temporal features and obtain multi-frame features. Self-attention mechanism can effectively capture the relevant information of internal features. Then the fusion module of single frame feature, multi-frame feature and self-attention feature is designed. The feature map of lane line is output by up-sampling network. The experimental results show that the network in this paper has significant improvement in both objective detection accuracy and subjective effect compared with other methods.

Key words

vehicle lane detection, multi-frame network feature fusion, self-attention mechanism

Digital Object Identifier (DOI)

https://doi.org/10.2298/CSIS240314054Z

Publication information

Volume 21, Issue 4 (September 2024)
Year of Publication: 2024
ISSN: 2406-1018 (Online)
Publisher: ComSIS Consortium

Full text

DownloadAvailable in PDF
Portable Document Format

How to cite

Zhu, G., Liu, Y., Wang, J.: Multi-frame Network Feature Fusion Model and Self-attention Mechanism for Vehicle Lane Line Detection. Computer Science and Information Systems, Vol. 21, No. 4, 1699–1723. (2024), https://doi.org/10.2298/CSIS240314054Z