2篇
您的检索式：作者名="Shuting Ge"
|
|
|
题名
|
作者
|
年代
|
出处
|
被引量
|
| 1 | Audio-Text Multimodal Speech Recognition via Dual-Tower Architecture for Mandarin Air Traffic Control Communications显示文摘In air traffic control communications (ATCC), misunderstandings between pilots and controllers could result in fatal aviation accidents. Fortunately, advanced automatic speech recognition technology has emerged as a promising means of preventing miscommunications and enhancing aviation safety. However, most existing speech recognition methods merely incorporate external language models on the decoder side, leading to insufficient semantic alignment between speech and text modalities during the encoding phase. Furthermore, it is challenging to model acoustic context dependencies over long distances due to the longer speech sequences than text, especially for the extended ATCC data. To address these issues, we propose a speech-text multimodal dual-tower architecture for speech recognition. It employs cross-modal interactions to achieve close semantic alignment during the encoding stage and strengthen its capabilities in modeling auditory long-distance context dependencies. In addition, a two-stage training strategy is elaborately devised to derive semantics-aware acoustic representations effectively. The first stage focuses on pre-training the speech-text multimodal encoding module to enhance inter-modal semantic alignment and aural long-distance context dependencies. The second stage fine-tunes the entire network to bridge the input modality variation gap between the training and inference phases and boost generalization performance. Extensive experiments demonstrate the effectiveness of the proposed speech-text multimodal speech recognition method on the ATCC and AISHELL-1 datasets. It reduces the character error rate to 6.54% and 8.73%, respectively, and exhibits substantial performance gains of 28.76% and 23.82% compared with the best baseline model. The case studies indicate that the obtained semantics-aware acoustic representations aid in accurately recognizing terms with similar pronunciations but distinctive semantics. The research provides a novel modeling paradigm for semantics-aware speech recognition in air traffic control communications, which could contribute to the advancement of intelligent and efficient aviation safety management. | Shuting Ge Jin Ren Yihua Shi Yujun Zhang Shunzhi Yang Jinfeng Yang | 2024 | Computers, Materials & Continua2024，78，3： | 0 |
| 2 | Study on the Electric Actuation of Liquid Metal Column in Confining System显示文摘Research on micro-machines is becoming popular.In this paper,the electric driving behavior of liquid metal columns in confining channel was studied.When the electric field was applied,the liquid metal near the negative electrode became flat,longer.The NaOH electrolyte(1.0 mol/L)could flow from the positive electrode to the negative electrode from a small space above the liquid metal column.Besides,the length and volume of the liquid metal would affect its motion and deformation behavior.Both cylindrical liquid column(R=5 mm,L=5 cm)and linear liquid column(R=5 mm,L=40 cm)exhibit deformable movements,which are similar to the bionic movements of earthworms.The electrically driven liquid metal in closed systems could provide a theoretical basis for droplet actuation in microtubes.It has a very wide application prospect in the field of micro-drive machines. | Shuting Liang Zengwei Wang Fengjiao Li Mengjun Huang Ge Ding | 2022 | Chinese Journal of Mechanical Engineering2022，35，3： | 0 |
您所在的机构暂未开通此部分的功能，请联系管理员