Researchers at ETH professor Markus Gross’ Game Technology Center, together with ETH spin-off Animatico, developed an interactive platform in which a digital version of Einstein narrates his years in Zurich. The three-dimensional animated figure answers a wide variety of questions and sometimes replies with a challenging counter-question or a humorous remark. For the artistic three-dimensional visualization, a younger Einstein was deliberately chosen to match his time in Zurich.

Behind the digital Einstein figure and his ability to see, hear and interact with his viewers is a complex algorithmic system developed by the company Animatico. Dynamic visualization, speech processing, and intention recognition are key technologies used. The screen and the comfortable armchair are also packed with technology: a camera scans the movements and reactions of the viewer while microphones filter out his or her voice from the ambient noise. Special software converts what is said into text, analyzes it, and generates a suitable response — all in real time.

Einstein and other digital characters offer an opportunity to make interaction between humans and machines more intuitive and more accessible to people who are less tech-savvy or who have disabilities. Digital humans might then be deployed at ticket counters and hotel check-ins. They could also provide product advice and act as virtual coaches in healthcare settings.

However, being able to have a completely free-form conversation is still a work in progress. Researchers at ETH are therefore continually improving the Digital Einstein platform to enhance understanding and deliver more sophisticated responses.

Visit us and get to know the digital Einstein and the technology behind it yourself.

Location: ETH Hauptgebäude, Haupthalle E30 Ost, Rämistrasse 101, 8092 Zürich
Opening hours: 20.9 until 25.9.22, Monday to Friday 08.00 am to 10.00 pm; Saturday and Sunday: 09.00am to 05:00 pm