Towards more natural, interactive, personalized, and human-inspired AI systems. Seamless interaction between humans and AI in Multi-modal perception, Multi-modal instruction, Personalized interaction and responses, Complex control: navigation, reasoning, etc.
AI-systems that communicate and collaborate seamlessly with humans
This research line focuses on the design of AI systems to communicate and interact with people as naturally as possible, including through natural language and image recognition. The AI system must be able to build layered human-like reasoning by observing and understanding the complex environment. This allows computers to independently identify and solve problems. Humans can work with their intelligence and physical abilities in harmony with complementary machines through intuitive and social interaction. This goal is still a long way off. But in many practical applications, such as recognizing patterns and generalizing individual tasks, AI already makes a very interesting contribution.
WP1, WP2, WP3 and WP4 are work packages that feature both perception and cognition: starting from multimodal sensors, clear semantics are derived, which are used in human-like learning algorithms, with a strong personalization and interaction aspect. The results of these methodological work packages are integrated in WP5: use cases and demonstrators.
Following the objectives set forth above, this challenge can be split in two main parts, which are both addressed in two methodological work packages. The overall work package structure is illustrated in Figure above.
Multiple research groups collaborate on this research domain. This table mentions the contact person and his/her affiliation.
Management team, imec, UAntwerpen - IDLab, e-mail
Management team & WP5 Lead: Use Cases, UAntwerpen - IDLab
WP1 Lead: Audio-visual Perception and Multimodal Representations, KU Leuven
WP2 Lead: Deep Learning-based Conversational Agents, UAntwerpen - CLiPS
WP3 Lead: Interaction, Personalization and Recommendation, UAntwerpen - ADREM
WP4 Lead: Cognitive Architectures & Human-like learning, VUB