Target sample mining with modified activation residual network for speaker verification

基于改进激活残差网络的目标样本挖掘用于说话人验证

阅读:1

Abstract

In the domain of speaker verification, Softmax can be used as a backend for multi-classification, but traditional Softmax methods have some limitations that limit performance. During the training phase, Softmax is used for multi-class training, while the speaker verification stage is a binary classification validation, leading to a discrepancy between the multi-class training in the training phase and the binary classification validation in the verification stage. It is also important to notice the issue of the disparity in the number of positive and negative samples in the sampling process of a binary classification problem. The difference in positive and negative samples can lead to the dominance of negative sample gradients during machine learning training, which can affect the performance of the speaker verification system. During the process of calculating similarity between positive and negative samples, there may be encountered an issue of overlapping similarity scores. If the overlapping portion is too large, it can reduce the discriminability between positive and negative samples, affecting the speaker system's ability to distinguish between positive and negative samples. Considering the relatively compact distribution of positive and negative sample spaces, it is beneficial for enhancing the performance of the speaker system, and focusing more on the learning of difficult samples is conducive to improving the network's convergence and generalization. Thus, this paper introduces an adaptive target function capable of solving these issues (SphereSpeaker). SphereSpeaker introduces different types of hyperparameters on the basis of Softmax, making it more suitable for handling speaker verification problems. SphereSpeaker also introduces three different angular margins to update the network, further enhancing the stability and generalization ability of the network model. Meanwhile, considering the issues of gradient vanishing, gradient explosion, and model degradation that can occur in deep neural networks, this paper introduces a deep neural network, which is named as Residual Network PReLu(ResNet-P). The experimental results indicate that compared to other deep neural network methods, this method has the lowest equal error rate, significantly improving the performance of the speaker verification system.

特别声明

1、本页面内容包含部分的内容是基于公开信息的合理引用;引用内容仅为补充信息,不代表本站立场。

2、若认为本页面引用内容涉及侵权,请及时与本站联系,我们将第一时间处理。

3、其他媒体/个人如需使用本页面原创内容,需注明“来源:[生知库]”并获得授权;使用引用内容的,需自行联系原作者获得许可。

4、投稿及合作请联系:info@biocloudy.com。