Fast Text/non-Text Image Classification with Knowledge Distillation - Laboratoire Informatique, Image et Interaction Access content directly
Conference Papers Year :

Fast Text/non-Text Image Classification with Knowledge Distillation

Miao Zhao
  • Function : Author
Rui-Qi Wang
  • Function : Author
Fei Yin
  • Function : Author
Xu-Yao Zhang
  • Function : Author
Lin-Lin Huang
  • Function : Author


How to efficiently judge whether a natural image contains texts or not is an important problem. Since text detection and recognition algorithms are usually time-consuming, and it is unnecessary to run them on images that do not contain any texts. In this paper, we investigate this problem from two perspectives: the speed and the accuracy. First, to achieve high speed for efficient filtering large number of images especially on CPU, we propose using small and shallow convolutional neural network, where the features from different layers are adaptively pooled into certain sizes to overcome difficulties caused by multiple scales and various locations. Although this can achieve high speed but its accuracy is not satisfactory due to limited capacity of small network. Therefore, our second contribution is using the knowledge distillation to improve the accuracy of the small network, by constructing a larger and deeper neural network as teacher network to instruct the learning process of the small network. With the above two strategies, we can achieve both high speed and high accuracy for filtering scene text images. Experimental results on a benchmark dataset have shown the effectiveness of our method: the teacher network yields state-of-the-art performance, and the distilled small network achieves high performance while maintaining high speed which is 176 times faster on CPU and 3.8 times faster on GPU than a compared benchmark method.
Fichier principal
Vignette du fichier
Zhao2019.pdf (210.57 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03030201 , version 1 (06-05-2022)


Attribution - NonCommercial



Miao Zhao, Rui-Qi Wang, Fei Yin, Xu-Yao Zhang, Lin-Lin Huang, et al.. Fast Text/non-Text Image Classification with Knowledge Distillation. International Conference on Document Analysis and Recognition (ICDAR) 2019, Sep 2019, Sydney, Australia. pp.1458-1463, ⟨10.1109/ICDAR.2019.00234⟩. ⟨hal-03030201⟩


32 View
36 Download



Gmail Facebook Twitter LinkedIn More