Smart Home Appliances: Chat with Your Fridge

Understand

Current home appliances are capable to execute a limited number of voice commands such as turning devices on or off, adjusting music volume or light conditions.

• Recent progress in machine reasoning gives an opportunity to develop new types of conversational user interfaces for home appliances.
• In this paper, we apply state-of-the-art visual reasoning model and demonstrate that it is feasible to ask a smart fridge about its contents and various properties of the food with close-to-natural conversation experience.
• Our visual reasoning model answers user questions about existence, count, category and freshness of each product by analyzing photos made by the image sensor inside the smart fridge.