Intelligent Embedded Vision for Summarization of Multiview Videos in IIoT

Tanveer Hussain, Khan Muhammad, Javier Del Ser, Sung Wook Baik, Victor Hugo C. De Albuquerque

Research output: Contribution to journalArticlepeer-review

63 Citations (Scopus)

Abstract

Nowadays, video sensors are used on a large scale for various applications, including security monitoring and smart transportation. However, the limited communication bandwidth and storage constraints make it challenging to process such heterogeneous nature of Big Data in real time. Multiview video summarization (MVS) enables us to suppress redundant data in distributed video sensors settings. The existing MVS approaches process video data in offline manner by transmitting them to the local or cloud server for analysis, which requires extra streaming to conduct summarization, huge bandwidth, and are not applicable for integration with industrial Internet of Things (IIoT). This article presents a light-weight convolutional neural network (CNN) and IIoT-based computationally intelligent (CI) MVS framework. Our method uses an IIoT network containing smart devices, Raspberry Pi (RPi) (clients and master) with embedded cameras to capture multiview video data. Each client RPi detects target in frames via light-weight CNN model, analyzes these targets for traffic and crowd density, and searches for suspicious objects to generate alert in the IIoT network. The frames of each client RPi are encoded and transmitted with approximately 17.02% smaller size of each frame to master RPi for final MVS. Empirical analysis shows that our proposed framework can be used in industrial environments for various applications such as security and smart transportation and can be proved beneficial for saving resources.11[Online]. Available: https://github.com/tanveer-hussain/Embedded-Vision-for-MVS.

Original languageEnglish
Article number8815938
Pages (from-to)2592-2602
Number of pages11
JournalIEEE Transactions on Industrial Informatics
Volume16
Issue number4
DOIs
Publication statusPublished - Apr 2020

Keywords

  • Artificial intelligence
  • Big Data
  • Internet of Things (IoT)
  • computational intelligence
  • computer vision
  • convolutional neural network (CNN)
  • industrial Internet of Things (IIoT)
  • video summarization

Fingerprint

Dive into the research topics of 'Intelligent Embedded Vision for Summarization of Multiview Videos in IIoT'. Together they form a unique fingerprint.

Cite this