Categories: Wire Stories

Mitsubishi Electric Develops Scene-Aware Interaction Technology

More natural and intuitive human-machine interaction through scene awareness

TOKYO–(BUSINESS WIRE)–Mitsubishi Electric Corporation (TOKYO:6503) announced today that the company has developed what it believes to be the world’s first technology capable of highly natural and intuitive interaction with humans based on a scene-aware capability to translate multimodal sensing information into natural language. The novel technology, Scene-Aware Interaction, incorporates Mitsubishi Electric’s proprietary Maisart® compact AI technology to analyze multimodal sensing information for highly natural and intuitive interaction with humans through context-dependent generation of natural language.

The technology recognizes contextual objects and events based on multimodal sensing information, such as images and video captured with cameras, audio information recorded with microphones, and localization information measured with LiDAR. To prioritize these different categories of information, Mitsubishi Electric developed the Attentional Multimodal Fusion technology, which is capable of automatically weighting salient unimodal information to support appropriate word selections for describing scenes with accuracy. In benchmark testing using a common test set, the Attentional Multimodal Fusion technology used audio and visual information to achieve a Consensus-Based Image Description Evaluation (CIDEr) score that was 29 percentage points higher than in the case of using visual information only. Mitsubishi Electric’s combination of Attentional Multimodal Fusion with scene understanding technology and context-based natural language generation realizes a powerful end-to-end Scene-Aware Interaction system for highly intuitive interaction with users in diverse situations.

Scene-Aware Interaction for car navigation, one target application, will provide drivers with intuitive route guidance.

For the full text, please visit: www.MitsubishiElectric.com/news/

Contacts

Customer Inquiries
Mitsubishi Electric Research Laboratories

Mitsubishi Electric Corporation

www.MitsubishiElectric.com/ssl/contact/company/rd/form.html
www.merl.com

Media Inquiries
Takumi Yurusa

Public Relations Division

Mitsubishi Electric Corporation

Tel: +81-3-3218-6758

prd.gnews@nk.MitsubishiElectric.co.jp
www.MitsubishiElectric.com/news/

Alex

Recent Posts

Traders’ attitude to charity: global broker Octa’s research

KUALA LUMPUR, MALAYSIA - Media OutReach Newswire - 31 October 2024 - E-brokerage is a…

6 hours ago

Dusit Foods partners with Japanese food industry giant Green House to drive global expansion of Epicure Catering

Strategic alliance poised to create new growth avenues in Thailand, Japan, and beyond. BANGKOK, THAILAND…

9 hours ago

Leonteq Launches Shari’a-Compliant Offering on LYNQS

Leonteq announced today that it has enabled its Shari’a-compliant structured product offering on its digital…

9 hours ago

OZONO Launches in Australia with Innovative Eco-Friendly Cleaning Technology

Revolutionizing Home and Commercial Cleaning with Aqueous Ozone Solutions that are hypoallergenic & eco-friendly QUEENSLAND,…

10 hours ago

Use More to Get More with Citi This Travel Season

Enjoy up to 10% rebate and chance to win business class round trip to Tokyo…

10 hours ago

Indorama Ventures celebrates ‘Waste Fiction Challenge’ essay competition; inspires youth to champion zero-waste schools

BANGKOK, THAILAND - Media OutReach Newswire - 5 November 2024 - Indorama Ventures Public Company…

11 hours ago