Publication detail

Unsupervised Adaptive Speaker Recognition by Coupling-Regularized Optimal Transport

ZHANG, R. WEI, J. LU, X. LU, W. JIN, D. ZHANG, L. XU, J.

Original Title

Unsupervised Adaptive Speaker Recognition by Coupling-Regularized Optimal Transport

Type

journal article in Web of Science

Language

English

Original Abstract

Cross-domain speaker recognition (SR) can be improved by unsupervised domain adaptation (UDA) algorithms. UDA algorithms often reduce domain mismatch at the cost of decreasing the discrimination of speaker features. In contrast, optimal transport (OT) has the potential to achieve domain alignment while preserving the speaker discrimination capability in UDA applications; however, naively applying OT to measure global probability distribution discrepancies between the source and target domains may induce negative transports where samples belonging to different speakers are coupled in transportation. These negative transports reduce the SR model's discriminative power, degrading the SR performance. This paper proposes a coupling-regularized optimal transport (CROT) algorithm for cross-domain SR to reduce the negative transport during UDA. In the proposed CROT, two consecutive processing modules regularize the coupling paths for the OT solution: a progressive inter-speaker constraint (PISC) module and a coupling-smoothed regularization (CSR) module. The PISC, designed as a pseudo-label memory bank with curriculum learning, is first applied to select valid samples to guarantee that coupling samples are from the same speaker. The CSR, designed to control the information entropy of the coupling paths further, reduces the effect of negative transport in UDA. To evaluate the effectiveness of the proposed algorithm, cross-domain SR experiments were conducted under different target domains, speaker encoders, corpora, and acoustic features. Experimental results showed that CROT achieved a 50% relative reduction in equal error rates compared to conventional OT-based UDAs, outperforming the state-of-the-art UDAs.

Keywords

Speaker recognition; unsupervised domain adaptation; optimal transport; coupling regularization; Speaker recognition; unsupervised domain adaptation; optimal transport; coupling regularization

Authors

ZHANG, R.; WEI, J.; LU, X.; LU, W.; JIN, D.; ZHANG, L.; XU, J.

Released

31. 12. 2024

Publisher

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC

Location

PISCATAWAY

ISBN

2329-9290

Periodical

IEEE/ACM TRANSACTIONS ON AUDIO, SPEECH AND LANGUAGE PROCESSING

Year of study

32

Number

1

State

United States of America

Pages from

3603

Pages to

3617

Pages count

15

URL

https://xplorestaging.ieee.org/document/10596689?denied

BibTex

@article{BUT197616,
  author="Ruiteng {Zhang} and Jianguo {Wei} and Xugang {Lu} and Wenhuan {Lu} and Di {Jin} and Lin {Zhang} and Junhai {Xu}",
  title="Unsupervised Adaptive Speaker Recognition by Coupling-Regularized Optimal Transport",
  journal="IEEE/ACM TRANSACTIONS ON AUDIO, SPEECH AND LANGUAGE PROCESSING",
  year="2024",
  volume="32",
  number="1",
  pages="3603--3617",
  doi="10.1109/TASLP.2024.3426934",
  issn="2329-9290",
  url="https://xplorestaging.ieee.org/document/10596689?denied"
}