Audio–Visual Sensor Fusion Strategies for Video Content Analytics
A special issue of Sensors (ISSN 1424-8220). This special issue belongs to the section "Physical Sensors".
Deadline for manuscript submissions: closed (15 April 2019) | Viewed by 3994
Special Issue Editor
Interests: computer vision; acoustic signal processing; multi-sensor fusion; deep learning; big data analytics
Special Issues, Collections and Topics in MDPI journals
Special Issue Information
Dear Colleagues,
A two-hour movie, or a short movie clip as its subset, is intended to capture and present a meaningful (or significant) story in video to be recognized and understood by a human audience. What if we substitute human audience with that of an intelligent machine or robot capable of capturing and processing the semantic information in terms of audio and video cues contained in the video? By using both auditory and visual means, the human brain processes the audio (sound, speech) and video (background image scene, moving video objects, and written characters) modalities to extract the spatial and temporal semantic information, that are contextually complementary and robust. Smart machines equipped with audiovisual multisensors (e.g. CCTV equipped with cameras and microphones) should be capable of achieving the same task. An appropriate fusion strategy combining the audio and visual information would be key in developing such artificial general intelligent (AGI) systems. This Special Issue calls for papers on various sensor fusion techniques to combine the audiovisual information cues for video content analytics. There can be a wide range of fusion strategies at various information levels (e.g., feature, decision, and semantic) to extract meaningful information by providing the attention mechanism in terms of weighting significance of the cue to represent the intended world. In light of the recent advancement of deep-learning, this Special Issue will provide an important forum to present new fusion strategies by addressing the relevant research issues toward solving many applications requiring artificial general intelligence.
Prof. Dr. Hanseok Ko
Guest Editor
Manuscript Submission Information
Manuscripts should be submitted online at www.mdpi.com by registering and logging in to this website. Once you are registered, click here to go to the submission form. Manuscripts can be submitted until the deadline. All submissions that pass pre-check are peer-reviewed. Accepted papers will be published continuously in the journal (as soon as accepted) and will be listed together on the special issue website. Research articles, review articles as well as short communications are invited. For planned papers, a title and short abstract (about 100 words) can be sent to the Editorial Office for announcement on this website.
Submitted manuscripts should not have been published previously, nor be under consideration for publication elsewhere (except conference proceedings papers). All manuscripts are thoroughly refereed through a single-blind peer-review process. A guide for authors and other relevant information for submission of manuscripts is available on the Instructions for Authors page. Sensors is an international peer-reviewed open access semimonthly journal published by MDPI.
Please visit the Instructions for Authors page before submitting a manuscript. The Article Processing Charge (APC) for publication in this open access journal is 2600 CHF (Swiss Francs). Submitted papers should be well formatted and use good English. Authors may use MDPI's English editing service prior to publication or during author revisions.
Keywords
- camera
- microphone
- multimodal
- auditory
- visual
- fusion
- semantic
- deep-learning
- artificial general intelligence
