2008, English, Article edition: From 3-D speaker cloning to text-to-audiovisual speech Elisei, Frédéric; Fagel, Sascha; Bailly, Gérard

User activity

Share to:
 
Bookmark: http://trove.nla.gov.au/version/206570
Physical Description
  • text
Published
  • HAL - CCSD
  • 2008
Language
  • English

Edition details

Title
  • From 3-D speaker cloning to text-to-audiovisual speech
Author
  • Elisei, Frédéric
  • Fagel, Sascha
  • Bailly, Gérard
Published
  • HAL - CCSD
  • 2008
Physical Description
  • text
Subjects
Notes
  • Visible speech movements were motion captured and parameterized. Coarticulated targets were extracted from VCVs and modeled to generate arbitrary German utterances by target interpolation. The system was extended to synthesize English utterances by a mapping to German phonemes. An evaluation by means of a modified rhyme test reveals that the synthetic videos of isolated words increase the recognition scores from 27 % to 47.5 % when added to audio only presentation
  • HAL:hal-00361886, version 1
  • HAL:http:/​/​hal.archives-ouvertes.fr/​hal-00361886/​en/​
  • Visible speech movements were optically motion captured and parameterized by means of a guided PCA. Co-articulated consonantal targets were extracted from VCVs, vocalic targets were extracted from these VCVs and from sustained vowels. Targets were selected or combined to derive target sequences for phone chains of arbitrary German utterances. Parameter trajectories for these utterances are generated by interpolating targets through linear to quadratic functions that reflect the degree of co-articulatory influence. Videos of test words embedded in a carrier sentence were rendered from parameter trajectories for an evaluation in the form of a rhyme test in noise. Results show that the synthetic videos - although intelligible only somewhat above chance level when played alone - significantly increase the recognition scores from 45.6% in audio alone presentation to 60.4% in audiovisual presentation.
  • HAL:hal-00361888, version 1
  • HAL:http:/​/​hal.archives-ouvertes.fr/​hal-00361888/​en/​
Language
  • English
Contributed by
OAIster

Get this edition

  • Set up My libraries

    How do I set up "My libraries"?

    In order to set up a list of libraries that you have access to, you must first login or sign up. Then set up a personal list of libraries from your profile page by clicking on your user name at the top right of any screen.

  • All (1)
  • Unknown (1)
None of your libraries hold this item.
None of your libraries hold this item.
None of your libraries hold this item.
None of your libraries hold this item.
None of your libraries hold this item.
None of your libraries hold this item.
None of your libraries hold this item.
None of your libraries hold this item.

User activity


e.g. test cricket, Perth (WA), "Parkes, Henry"

Separate different tags with a comma. To include a comma in your tag, surround the tag with double quotes.

Be the first to add a tag for this edition

Be the first to add this to a list

Comments and reviews

What are comments? Add a comment

No user comments or reviews for this version

Add a comment