More natural and intuitive human-machine interaction through scene awareness
TOKYO–(BUSINESS WIRE)–Mitsubishi Electric Corporation (TOKYO:6503) announced today that the company has developed what it believes to be the world’s first technology capable of highly natural and intuitive interaction with humans based on a scene-aware capability to translate multimodal sensing information into natural language. The novel technology, Scene-Aware Interaction, incorporates Mitsubishi Electric’s proprietary Maisart® compact AI technology to analyze multimodal sensing information for highly natural and intuitive interaction with humans through context-dependent generation of natural language.
The technology recognizes contextual objects and events based on multimodal sensing information, such as images and video captured with cameras, audio information recorded with microphones, and localization information measured with LiDAR. To prioritize these different categories of information, Mitsubishi Electric developed the Attentional Multimodal Fusion technology, which is capable of automatically weighting salient unimodal information to support appropriate word selections for describing scenes with accuracy. In benchmark testing using a common test set, the Attentional Multimodal Fusion technology used audio and visual information to achieve a Consensus-Based Image Description Evaluation (CIDEr) score that was 29 percentage points higher than in the case of using visual information only. Mitsubishi Electric’s combination of Attentional Multimodal Fusion with scene understanding technology and context-based natural language generation realizes a powerful end-to-end Scene-Aware Interaction system for highly intuitive interaction with users in diverse situations.
Scene-Aware Interaction for car navigation, one target application, will provide drivers with intuitive route guidance.
For the full text, please visit: www.MitsubishiElectric.com/news/
Contacts
Customer Inquiries
Mitsubishi Electric Research Laboratories
Mitsubishi Electric Corporation
www.MitsubishiElectric.com/ssl/contact/company/rd/form.html
www.merl.com
Media Inquiries
Takumi Yurusa
Public Relations Division
Mitsubishi Electric Corporation
Tel: +81-3-3218-6758
prd.gnews@nk.MitsubishiElectric.co.jp
www.MitsubishiElectric.com/news/
KUALA LUMPUR, MALAYSIA - Media OutReach Newswire - 31 October 2024 - E-brokerage is a…
Strategic alliance poised to create new growth avenues in Thailand, Japan, and beyond. BANGKOK, THAILAND…
Leonteq announced today that it has enabled its Shari’a-compliant structured product offering on its digital…
Revolutionizing Home and Commercial Cleaning with Aqueous Ozone Solutions that are hypoallergenic & eco-friendly QUEENSLAND,…
Enjoy up to 10% rebate and chance to win business class round trip to Tokyo…
BANGKOK, THAILAND - Media OutReach Newswire - 5 November 2024 - Indorama Ventures Public Company…