The Muses of Poetry
The Muses of Poetry is an interactive installation that explores how interactive animated characters can transmit the intrinsic emotions conveyed in poems to an audience, expanding in this way the act of reciting poetry. It goes a step forward in the computational creativity direction by bringing into existence a Virtual Poetry Interpreter.
The combination of semantic analysis, real-time graphics, Text-to-Speech, Automatic-Speech-Recognition and human-computer interaction gives as a result an almost autonomous system. Given that no pre-recorded animations are needed, each time a new poem is added, the characters will be able to recite it while producing their animations on the fly. The affective content of the poems is transmitted through facial expressions, or visual cues, and voice rhythm.
The user can interact with the character by selecting two words that appeared together with the displayed Muse. These words help the character to decide for a poem that will be read in an emotional way.
The Muses of Poetry was funded by the Innovationsfonds Kunst of the Ministry for Science, Research and Art in Baden-Württemberg (Ministerium für Wissenschaft, Forschung und Kunst - MWK). It ended on November 2013.
Live Exhibits & Publications
- Let me listen to Poetry, let me see Emotions. In Journal of Universal Computer Science (JUCS) special issue on “Trending Breakthroughs in Human-Computer Interaction”. (To be published)
- The Muses of Poetry, exhibited at CHI 2014 - Interactivity
- The Next Generation Poetic Experience, Siggraph ASIA 2013
- The Muses of Poetry, exhibited at Szenografie Biennale 2013 - "Academic Day"
- The Muses of Poetry, exhibited at FMX 2013 - Forum/Marketplace
- HCI and The Muses of Poetry: Calliope Recites Jenkins, Lilley, Langdon and Williams in collaboration with the Australian Cordite Poetry Review magazine published on February 1st, 2013.