: NLP Vocabulary: isochrony

computational linguistics > phonetics and phonology > phonological process > isochrony

isochrony

Isochrony requires that the duration of the source and target utterance is equal in order for the translated dialogue to exactly fit the time during which the actor speaks. (Karakanta, Bhattacharya, Nayak, Baumann, Negri & Turchi, 2020)
Still the drop in translation performance indicates that isochrony is not the only constraint affecting the translation but the need for adaptation to the articulatory movements (lip-sync) at the level of phonemes should be further explored in NMT for dubbing. (Karakanta, Bhattacharya, Nayak, Baumann, Negri & Turchi, 2020)
The authors suspect that directly optimizing isochrony (as opposed to isometry) is likely a better approach for automatic dubbing. (Brannon, Virkar & Thompson, 2023)
The high rates of isochrony that we observe in human dubs support the need for continued research on isochronic MT especially given the observed unwillingness of human dubbers to vary their speaking rate which shows that automatic dubbing systems should not simply vary speaking rates to achieve isochronic constraints. (Brannon, Virkar & Thompson, 2023)

http://data.loterre.fr/ark:/67375/8LP-HMCF0TC5-H

RDF/XML TURTLE JSON-LD

Loterre