• 中国计算机学会会刊
  • 中国科技核心期刊
  • 中文核心期刊

Computer Engineering & Science ›› 2022, Vol. 44 ›› Issue (09): 1665-1675.

• Graphics and Images • Previous Articles     Next Articles

Accurate location of unconstrained license plate  based on cascaded CNNs

XU Guang-zhu1,2,KUANG Wan1,WAN Qiu-bo1,LEI Bang-jun1,2,WU Zheng-ping1,2,MA Guo-liang3   

  1. (1.Hubei Key Laboratory of Intelligent Vision Monitoring 
    for Hydroelectric Engineering,China Three Gorges University,Yichang 443002;
    2.College of Computer and Information Technology,China Three Gorges University,Yichang 443002;
    3.Traffic Police Detachment,Public Security Bureau of Yichang City,Yichang 443002,China)
  • Received:2020-12-15 Revised:2021-03-04 Accepted:2022-09-25 Online:2022-09-25 Published:2022-09-20

Abstract: To solve the problem that the rectangular detection box outputted from a single deep convolutional neural network (CNN) cannot deal with the non-front license plate location well under unconstrained scenarios, a solution based on cascaded CNNs is proposed. The solution cascades the target detection and target classification CNN network, uses the detection network to obtain the region of interest, and then uses the lightweight classification network to transform the license plate vertex detection problem into a regression problem. Firstly, the YOLOv3 network is used for locating license plates roughly to obtain all the license plate candidate areas in an image. Then, an improved MobileNetV3 lightweight CNN is adopted to locate the license plate vertices in the candidate areas to achieve the precise location of license plate areas. Finally, the license plate is corrected and projected into the rectangular box through perspective transformation. Experiment results show that the proposed cascaded CNNs can effectively solve the problem that a single CNN object detection network can only output a rectangular detection box and is not suitable for unconstrained license plate detection. It has a good application potential. 

Key words: unconstrained license plate location, convolutional neural network, YOLOv3, MobileNetV3