TextDetox Multilingual Toxicity — Hindi
A TextDetox 2024 shared task (Hindi) dataset of 5,000 Hindi posts (2,500 toxic, 2,500 non-toxic), collected by Dementieva et al. for PAN/CLEF TextDetox 2024. Each record contains post text, binary toxicity label (0=non-toxic, 1=toxic). TextDetox Hindi provides 5,000 balanced binary toxicity annotations — part of a 15-language multilingual benchmark for cross-lingual toxicity detection research. Suitable for toxicity detection, multilingual content moderation, cross-lingual NLP, hate speech classification, text detoxification.
Cite this dataset at
textdetox-hi.echo.directory
Analytics
Topic 0
Topic 1
Topic 2
Topic 3
Topic 4
Topic 5
Topic 6
Topic 7
Topic 8
Topic 9
Topic 10
Topic 11
Show all 53 topics
Topic 12
Topic 13
Topic 14
Topic 15
Topic 16
Topic 17
Topic 18
Topic 19
Topic 20
Topic 21
Topic 22
Topic 23
Topic 24
Topic 25
Topic 26
Topic 27
Topic 28
Topic 29
Topic 30
Topic 31
Topic 32
Topic 33
Topic 34
Topic 35
Topic 36
Topic 37
Topic 38
Topic 39
Topic 40
Topic 41
Topic 42
Topic 43
Topic 44
Topic 45
Topic 46
Topic 47
Topic 48
Topic 49
Topic 50
Topic 51
Topic 52
Computed over the full corpus.
Record
- Catalog key
textdetox-hi- Authors
- Dementieva, Daryna; Moskovskiy, Daniil; Logacheva, Varvara; Dale, David; Ustalov, Dmitry; Panchenko, Alexander
- Year
- 2024
- Source paper
- Overview of the Multilingual Text Detoxification Task at PAN 2024
- DOI / arXiv
- 10.1007/978-3-031-71908-0_11
- License
- OpenRAIL++ (Hugging Face card) (LicenseRef-OpenRAIL-plus-plus)
- Records
- 5,000
- Languages
- hi
- Collected
- 2024 (2020s)
- Tasks
- Toxicity detection (binary;
is_toxic) inferred - Region
- South Asia (inferred: from the language of the data)
Provenance
- Originally published at
- https://huggingface.co/datasets/textdetox/multilingual_toxicity_dataset link checked
- Hosted copy
- Mirrored on echo.directory on 2026-10-02, 781.4 KB across 1 files. Checksums in MANIFEST.json.
Citations
Overview of PAN 2024: Multi-author Writing Style Analysis, Multilingual Text Detoxification, Oppositional Thinking Analysis, and Generative AI Authorship Verification Condensed Lab Overview
A. Ayele, N. Babakov, Janek Bevendorff, Xavier Bonet Casals, Berta Chulvi
Journal Article · Conference and Labs of the Evaluation Forum · 2024
Cited by
- Overview of PAN 2025: Voight-Kampff Generative AI Detection, Multilingual Text Detoxification, Multi-author Writing Style Analysis, and Generative Plagiarism Detection
Janek Bevendorff, Daryna Dementieva et al. · Conference and Labs of the Evaluation Forum · 2025 · cited 54× - Overview of the "Voight-Kampff" Generative AI Authorship Verification Task at PAN and ELOQUENT 2025
Janek Bevendorff, Yu-Xia Wang et al. · Conference and Labs of the Evaluation Forum · 2025 · cited 43× - Diversity Boosts AI-Generated Text Detection
Advik Raj Basani, Pin-Yu Chen · Trans. Mach. Learn. Res. · 2025 · cited 9× - Generative AI Authorship Verification Based on Contrastive-Enhanced Dual-Model Decision System
Jun-Lang Liu, Lei-Lei Kong et al. · Conference and Labs of the Evaluation Forum · 2025 · cited 8× - elfen: A Python Package for Efficient Linguistic Feature Extraction for Natural Language Datasets
Maximilian Maurer · Conference of the European Chapter of the Association for Computational Linguistics · 2026 · cited 7×
Show all 10
- AIDBench: A benchmark for evaluating the authorship identification capability of large language models
Zichen Wen, Dadi Guo et al. · arXiv.org · 2024 · cited 6× - LOG-AID: Logit-Based Statistical Features for AI Text Detection
Sophie Titze, Oren Halvani · Conference and Labs of the Evaluation Forum · 2025 · cited 5× - Style Change Detection Using Graph and Structural Linguistic Features for Multi-Author Writing Analysis
Ioana-Roxana Boriceanu, Andra Băltoiu · Conference and Labs of the Evaluation Forum · 2025 · cited 5× - Unibuc - NLP at "Voight-Kampff" Generative AI Detection PAN 2025
Teodor-George Marchitan, Claudiu Creanga et al. · Conference and Labs of the Evaluation Forum · 2025 · cited 5× - Literal Re-translation as a Method for AI Text Disguise and Detection Evasion
Poojan Vachharajani · Conference and Labs of the Evaluation Forum · 2025 · cited 4×
Citation data from Semantic Scholar, retrieved 2026-10-19.
How to cite
BibTeX
@misc{echo2026,
title = {ECHO: Exploratory Compendium of Humanity Online},
author = {Switzer, Braden and Zafarani, Reza},
year = {2026},
url = {https://echo.directory},
note = {Syracuse University}
}
@inproceedings{dementieva2024overview,
title = {Overview of the Multilingual Text Detoxification Task at PAN 2024},
author = {Dementieva, Daryna and others},
booktitle = {CLEF 2024 Working Notes},
year = {2024}
} APA
Switzer, B., & Zafarani, R. (2026). ECHO: Exploratory Compendium of Humanity Online [Data repository]. Syracuse University. https://echo.directory
Dementieva, D., Moskovskiy, D., Logacheva, V., Dale, D., Ustalov, D., & Panchenko, A. (2024). TextDetox Multilingual Toxicity — Hindi [Data set]. https://doi.org/10.1007/978-3-031-71908-0_11
MLA
Switzer, Braden, and Reza Zafarani. ECHO: Exploratory Compendium of Humanity Online. Syracuse University, 2026, echo.directory.
Dementieva, Daryna, et al. TextDetox Multilingual Toxicity — Hindi. 2024, doi.org/10.1007/978-3-031-71908-0_11.