Research on Image Recognition Technology Based on Multimodal Deep Learning

Understand

This project investigates the human multi-modal behavior identification algorithm utilizing deep neural networks.

• According to the characteristics of different modal information, different deep neural networks are used to adapt to different modal video information.
• Through the integration of various deep neural networks, the algorithm successfully identifies behaviors across multiple modalities.
• In this project, multiple cameras developed by Microsoft Kinect were used to collect corresponding bone point data based on acquiring conventional images.