The project known as FANCI (Face and body Analysis Natural Computer Interaction) is centered around the integration of multi-modal human-machine technologies on a single platform, realizing significant cost and power savings for the implementation of these functions in embedded products. FANCI will research, innovate, architect, design, develop and validate innovative multi-modal face and body analytics and natural computer interfaces (NCI), develop a reference platform fitting a variety of applications, and provide validation through user experience evaluation and benchmarking. Initially the project will focus on the automotive industry to validate this technology.
The project will focus on intelligent user sensing methods, including face analysis, eye tracking, emotion, intention & authentication; hand gesture recognition; voice tone analysis; and head gesture & pose analysis. It will complement those with smart user intention or distraction estimation and system reaction methods, supplying visual (HUD, etc.), voice and haptic feedback as well as autonomous system actions.
FANCI will deliver these capabilities in a market- ready reference architecture, demonstrated by building a creative Automotive Application-suite Demonstrator. An Application Programming Interface (API) for software application developers of pervasive natural computer interaction devices will be supplied. The platform will empower embedded products that capture and act upon user intentions, and imaginative utility applications fusing real and virtual content.
To achieve these goals FANCI will combine multi-modal sensor data in a hardware platform to enable robust operation in natural environments, sensing explicit, implicit, and emotional actions of the user in a simple, yet powerful extensible software architecture; provide a low cost, power optimised reference design for embedded products; and validate the approach by building an automotive application demonstrator.
Each of the bodies involved brings industry-leading expertise in their chosen field: CEVA (Israel) as the provider of the CEVA-MM3101 imaging and vision platform and computer vision libraries for the human-machine technologies, HARMAN (Germany) as the automotive industry expert, KeyLemon (Switzerland) as the provider of face authentication software, nViso (Switzerland) as the provider of emotion detection software, SoftKinetic (Belgium) as the provider of 3D vision technologies and gesture software, Tobii Technology (Sweden) as the provider of eye tracking technology, and the University of Siena (Italy) as the developer of the application layer and the user API.
The FANCI project is funded by the European Commission’s Horizon 2020 framework programme for research and innovation.
Horizon 2020 is a flagship initiative aimed at securing Europe’s global competitiveness. By coupling research and innovation, Horizon 2020 is helping to achieve this with its emphasis on excellent science, industrial leadership and tackling societal challenges. The goal is to ensure that Europe produces world-class science, removes barriers to innovation and makes it easier for the public and private sectors to work together in delivering innovation.