Reliability Testing For Natural Language Processing Systems
ASecurity
**arXiv ID:** 2105.02590 **Authors:** Samson Tan, Shafiq Joty, Kathy Baxter, Araz Taeihagh, Gregory A. Bennett, Min-Yen Kan **Published:** 2021-05-06T11:24:58Z **Abstract:** Questions of fairness, robustness, and transparency are paramount to address before deploying NLP systems. Central to these concerns is the question of reliability: Can NLP systems reliably treat different demographics fairly and function correctly in diverse and noisy environments? To address this, we argue for the need ...
Installs into .claude/skills of the current project.
Sponsors
SSkills DirectorySkills Directory
Know which skills are safe — weekly.
SSkills DirectorySkills Directory
Is that skill safe to install?
Are you the author of Reliability Testing For Natural Language Processing Systems?
Add the live security badge to your README. It updates with every re-scan.
[](https://www.skillsdirectory.com/skills/hiyenwong-reliability-testing-for-natural-language-processin)
# Reliability Testing for Natural Language Processing Systems
**arXiv ID:** 2105.02590
**Authors:** Samson Tan, Shafiq Joty, Kathy Baxter, Araz Taeihagh, Gregory A. Bennett, Min-Yen Kan
**Published:** 2021-05-06T11:24:58Z
**Abstract:**
Questions of fairness, robustness, and transparency are paramount to address before deploying NLP systems. Central to these concerns is the question of reliability: Can NLP systems reliably treat different demographics fairly and function correctly in diverse and noisy environments? To address this, we argue for the need for reliability testing and contextualize it among existing work on improving accountability. We show how adversarial attacks can be reframed for this goal, via a framework for developing reliability tests. We argue that reliability testing -- with an emphasis on interdisciplinary collaboration -- will enable rigorous and targeted testing, and aid in the enactment and enforcement of industry standards.
## Skill Description
This skill is generated from the arXiv paper: Reliability Testing for Natural Language Processing Systems (2105.02590).
## How to Use
[To be filled in by the user or by future automation]
## References
- [arXiv:2105.02590](http://arxiv.org/abs/2105.02590v3)
