ru
ru
Source
Dialogue
DATE OF PUBLICATION
06/18/2022
Authors
Tatyana Shavrina Alena Fenogenova Alexander Panchenko Daryna Dementieva Varvara Logacheva Irina Nikishina David Dale Irina Krotova Nikita Semenov
Share

RUSSE-2022: Findings of the First Russian Detoxification Shared Task Based on Parallel Corpora

Style transfer, Detoxification, Corpus, Text generation, Evaluation, Competition, Metrics analysis

Abstract

Text detoxification is the task of rewriting a toxic text into a neutral text while preserving its original content. It
has a wide range of applications, e.g. moderation of output of neural chatbots or suggesting less emotional version of posts on social networks. This paper provides a description of RUSSE-2022 competition of detoxification methods for the Russian language. This is the first competition which features (i) parallel training data and (ii) manual evaluation. We describe the setup of the competition, the solutions of the participating teams and analyse their performance. In addition to that, the large-scale evaluation allows us to analyse the performance of automatic evaluation metrics.

Full text

Similar publications

ACL
A System for Answering Simple Questions in Multiple Languages
Anton Razzhigaev, Mikhail Salnikov, Valentin Malykh, Pavel Braslavski, Alexander Panchenko
SOURCE
EMNLP
xCOMET-lite: Bridging the Gap Between Efficiency and Quality in Learned MT Evaluation Metrics
Daniil Larionov, Mikhail Seleznyov, Vasiliy Viskov, Alexander Panchenko, Steffen Eger
SOURCE
EMNLP
SparseGrad: A Selective Method for Efficient Fine-tuning of MLP Layers
Viktoriia Chekalina, Anna Rudenko, Gleb Mezentsev, Aleksandr Mikhalev, Alexander Panchenko, Ivan Oseledets
SOURCE
EMNLP
LLMs to Replace Crowdsourcing For Parallel Data Creation: The Case of Text Detoxification
Daniil Moskovskiy, Sergey Pletenev, Alexander Panchenko
SOURCE
ACL
Fact-Checking the Output of Large Language Models via Token-Level Uncertainty Quantification
Ekaterina Fadeeva, Aleksandr Rubashevskii, Artem Shelmanov, Sergey Petrakov, Haonan Li, Hamdy Mubarak, Evgenii Tsymbalov, Gleb Kuzmin, Alexander Panchenko, Timothy Baldwin, Preslav Nakov, Maxim Panov
SOURCE
ACL
Industry vs Academia: Running a Course on Transformers in Two Setups
Irina Nikishina, Maria Tikhonova, Viktoriia Chekalina, Alexey Zaytsev , Artem Vazhentsev, Alexander Panchenko
SOURCE
ACL
MERA: A Comprehensive LLM Evaluation in Russian
Alena Fenogenova, Artem Chervyakov, Nikita Martynov, Anastasia Kozlova, Maria Tikhonova, Albina Akhmetgareeva, Anton Emelyanov, Denis Shevelev, Pavel Lebedev, Leonid Sinev, Katerina Kolomeytseva, Daniil Moskovskiy, Elizaveta Goncharova, Nikita Savushkin, Polina Mikhailova, Anastasia Minaeva, Denis Dimitrov, Alexander Panchenko, Sergei Markov
SOURCE
Contact us
Join AIRI
You can ask us a question or suggest a joint project in the field of AI

Message sent.

Thank you!

Something went wrong. Try again