The Muses of Poetry

The Muses of Poetry is an interactive installation that explores how interactive animated characters can transmit the intrinsic emotions conveyed in poems to an audience, expanding in this way the act of reciting poetry. It goes a step forward in the computational creativity direction by bringing into existence a Virtual Poetry Interpreter.

The combination of semantic analysis, real-time graphics, Text-to-Speech, Automatic-Speech-Recognition and human-computer interaction gives as a result an almost autonomous system. Given that no pre-recorded animations are needed, each time a new poem is added, the characters will be able to recite it while producing their animations on the fly. The affective content of the poems is transmitted through facial expressions, or visual cues, and voice rhythm.

The user can interact with the character by selecting two words that appeared together with the displayed Muse. These words help the character to decide for a poem that will be read in an emotional way.

The Muses of Poetry was funded by the Innovationsfonds Kunst of the Ministry for Science, Research and Art in Baden-Württemberg (Ministerium für Wissenschaft, Forschung und Kunst - MWK). It ended on November 2013.

Live Exhibits & Publications

  • Let me listen to Poetry, let me see Emotions. In Journal of Universal Computer Science (JUCS) special issue on “Trending Breakthroughs in Human-Computer Interaction”. (To be published)

  • The Muses of Poetry, exhibited at CHI 2014 - Interactivity