Abstract: A novel acoustic module is proposed, which combines a saliency detector with multi-head self-attention equipped with a decay mask. This model aids in better focusing on spatial information when performing sound event localization & detection tasks. By utilizing the saliency detector to concentrate on highly salient regions within local information, the model pays more attention to categories with rich information content. Secondly, a decay mask is introduced into the multi-head self-attention module, enabling the model to focus more on local information. Additionally, adaptive constraints are incorporated to diversify the attention heads. Experimental results demonstrate that the proposed model outperforms the baseline models. When compared with models that fuse Transformer and Multi-scale architectures, the proposed model exhibits superior detection  & localization performance. Finally, lev- eraging video information as additional data to enhance performance, the model demonstrates excellent overall capabilities.

Key words: sound event detection &, localization;saliency detector;multi-head self-attention;adaptive constrained decay mask