Front-End Smart Visual Sensing and Back-End Intelligent Analysis: A Unified Infrastructure for Economizing the Visual System of City Brain

• Published in: IEEE journal on selected areas in communications 2019-07, Vol.37 (7), p.1489-1503
• Main Authors: Lou, Yihang, Duan, Ling-Yu, Wang, Shiqi, Chen, Ziqian, Bai, Yan, Chen, Changwen, Gao, Wen
• Format: Article
• Language: English
• Subjects: Artificial intelligence; Artificial neural networks; Brain; Cameras; compact feature representation; Data acquisition; Data management; Deep learning; Economic analysis; Feature extraction; Infrastructure; Machine learning; person re-identification; Representations; Sensors; Smart cities; Smart city; standardization; Utilities; vehicle re-identification; visual analysis; Visual signals; Visualization
• ISSN: 0733-8716; 1558-0008
• DOI: 10.1109/JSAC.2019.2916488

The visual data, which are acquired from the ubiquitous visual sensors deployed in metropolitans, are of great value and paramount significance to enhance the effectiveness and pursue the future development of smart cities. In this paper, the essential building blocks of the unified visual data management and analysis infrastructure that serve as the foundation for the economical visual system in the city brain, are introduced to facilitate the utilization of the visual signal in the artificial intelligence era. In particular, we start by the discussion of the front-end smart visual sensing in the context of economical communication and service with the heterogeneous network, and the functionalities and necessities of compact visual feature and deep learning model representations are detailed. Subsequently, the utilities of the infrastructure are demonstrated through two intelligent applications at the back-end, including vehicle re-identification and person re-identification. The standardizations regarding compact feature and deep neural network representations, which are regarded as the key ingredients in this infrastructure and greatly facilitate the construction of the visual system in the city brain, are also discussed. Finally, we envision how the potential issues regarding the economical visual communications for future smart cities might be pragmatically approached within this unified infrastructure.