SearchWise: Fine-grained Visual Content Search Platform
Technology Transfer & Commercialisation

SearchWise: Fine-grained Visual Content Search Platform

Bronze Medal

SearchWise: Fine-grained Visual Content Search Platform

Deep learning technique has been widely applied in vision applications. Yet the fine-grained image analysis is still a critical challenge that recognizes the species of the same meta-category in which most of them are visually similar. To handle this problem, a fine-grained visual content search platform is given. This is a complete end-to-end solution that clients can customize new analysis models on their applications, consisting of object detection, coarse-grained image classification, and fine-grained image analysis. Specifically, a novel multi-focus fine-grained retrieval algorithm is proposed in the invention where three powerful modules including a class learning module, a local description module, and an outline description module are presented to learn the similarities of the same species and differences of different species from various aspects. Besides, this is a weakly supervised method that users do not need to annotate the local differences among species but only provide fine-grained labels, which saves much manpower costs in the labelling stage. In addition, the proposed method achieves state-of-the-art results on public datasets when compared with the latest models.