Tungnaá: a Hyper-realistic Voice Synthesis Instrument for Real-Time Exploration of Extended Vocal Expressions

Research output: Contribution to journalConference articlepeer-review

Abstract

This demo showcases Tungnaá, a new voice synthesis system and software instrument for real-time musical exploration of “Deep Voice Synthesis”. The design of Tungnaá emphasizes real-time interaction and customization, enabling artists to manipulate various aspects of the synthesis process and to explore aesthetic artefacts unique to autoregressive neural synthesis. The synthesis engine achieves real-time streaming generation of paralinguistic and extended forms of vocal expression, while controlling them using symbolic text notations drawn from the entire unicode character set, allowing for the creation of new notation systems. The interface provides visual display and mouse-or OSC-controllable interventions into the machine vocalisations. The demo showcases Tungnaá on a laptop with headphones and a MIDI controller, allowing participants to explore the instrument via both a textual and physical interface.

Original languageEnglish
JournalProceedings of the International Conference on New Interfaces for Musical Expression
Publication statusPublished - 2024
EventInternational Conference on New Interfaces for Musical Expression, NIME 2024 - Utrecht, Netherlands
Duration: 2 Sept 20246 Sept 2024

Bibliographical note

Publisher Copyright: © 2024, International Conference on New Interfaces for Musical Expression. All rights reserved.

Other keywords

  • Autoregressive
  • Machine Learning
  • Paralinguistic
  • Realtime
  • Speech Synthesis
  • Voice

Fingerprint

Dive into the research topics of 'Tungnaá: a Hyper-realistic Voice Synthesis Instrument for Real-Time Exploration of Extended Vocal Expressions'. Together they form a unique fingerprint.

Cite this