From English To More Languages Parameterefficient Model Reprogramming For Crosslingual Speech Recognition
ASecurity**arXiv ID:** 2301.07851 **Authors:** Chao-Han Huck Yang, Bo Li, Yu Zhang, Nanxin Chen, Rohit Prabhavalkar, Tara N. Sainath, Trevor Strohman **Published:** 2023-01-19T02:37:56Z **Abstract:** In this work, we propose a new parameter-efficient learning framework based on neural model reprogramming for cross-lingual speech recognition, which can \textbf{re-purpose} well-trained English automatic speech recognition (ASR) models to recognize the other languages. We design different auxiliary neura...
- 3 stars
- 0 votes
- 0 copies
- 6 views
- Added September 11, 2026
Security analysis
100/100npx -y skills add hiyenwong/ai_collection --skill from-english-to-more-languages-parameterefficient-model-reprogramming-for-crosslingual-speech-recognition --agent claude-codeAre you the author of From English To More Languages Parameterefficient Model Reprogramming For Crosslingual Speech Recognition?
Add the live security badge to your README. It updates with every re-scan.
[](https://www.skillsdirectory.com/skills/hiyenwong-from-english-to-more-languages-parameterefficient)# From English to More Languages: Parameter-Efficient Model Reprogramming for Cross-Lingual Speech Recognition
**arXiv ID:** 2301.07851
**Authors:** Chao-Han Huck Yang, Bo Li, Yu Zhang, Nanxin Chen, Rohit Prabhavalkar, Tara N. Sainath, Trevor Strohman
**Published:** 2023-01-19T02:37:56Z
**Abstract:**
In this work, we propose a new parameter-efficient learning framework based on neural model reprogramming for cross-lingual speech recognition, which can \textbf{re-purpose} well-trained English automatic speech recognition (ASR) models to recognize the other languages. We design different auxiliary neural architectures focusing on learnable pre-trained feature enhancement that, for the first time, empowers model reprogramming on ASR. Specifically, we investigate how to select trainable components (i.e., encoder) of a conformer-based RNN-Transducer, as a frozen pre-trained backbone. Experiments on a seven-language multilingual LibriSpeech speech (MLS) task show that model reprogramming only requires 4.2% (11M out of 270M) to 6.8% (45M out of 660M) of its original trainable parameters from a full ASR model to perform competitive results in a range of 11.9% to 8.1% WER averaged across different languages. In addition, we discover different setups to make large-scale pre-trained ASR succeed in both monolingual and multilingual speech recognition. Our methods outperform existing ASR tuning architectures and their extension with self-supervised losses (e.g., w2v-bert) in terms of lower WER and better training efficiency.
## Skill Description
This skill is generated from the arXiv paper: From English to More Languages: Parameter-Efficient Model Reprogramming for Cross-Lingual Speech Recognition (2301.07851).
## How to Use
[To be filled in by the user or by future automation]
## References
- [arXiv:2301.07851](http://arxiv.org/abs/2301.07851v1)
Attribution
Related skills
View all in tools →Comments
Loading comments…
Newsletter
Get the weekly list of safe new skills, and the ones we pulled.