Logo image
Taming the Online Software Engineering Tongue: Detecting and Reducing Offensive Language in Software Communities
Journal article   Open access   Peer reviewed

Taming the Online Software Engineering Tongue: Detecting and Reducing Offensive Language in Software Communities

Jithin Cheriyan, Bastin Tony Roy Savarimuthu and Stephen Cranefield
Journal of software, Vol.21(2), pp.45-77
28/09/2026
Handle:
https://hdl.handle.net/10523/52771

Abstract

Online Software Engineering (SE) communities offensive language recommendation system
Online Software Engineering (SE) communities such as Stack Overflow have become unwelcoming and hostile spaces, as evidenced by the presence of rude and offensive comments that are detrimental to the emotional well-being of participants. The main objective of this work is to investigate the prevalence and nature of offensive language in online SE communities, and develop approaches to classify them with the ultimate goal of reducing offensive language by proposing an Offensive Language Reduction System (OLRS-SE) that has the ability to detect, classify, and explain to the poster why a comment is offensive and also propose non-offensive alternative suggestions. Using data from 130,000 user comments on discussions held in four prominent SE platforms: Stack Overflow, GitHub, Gitter and Slack, we developed six sets of twelve (72 in total) different machine learning models (both traditional and deep learning). The F1-Score of the best performing models in the system ranges from 0.56 to 0.94, with an average F1-Score of 0.85, predominantly using Bidirectional Encoder Representations from Transformers (BERT) as the primary model for various classification tasks. Also, two language-based models were developed for paraphrasing offensive to non-offensive comments. The overall utility of the OLRS-SE was evaluated using user studies with 30 participants, which showed that the developed system is easy to use and also effective in reducing offensive language. Investigating the capabilities of different large language models for offensive language reduction is a promising avenue for future research.
pdf
JSW-V21N2-5144.27 MBDownloadView
Published (Version of record) Open Access CC BY V4.0
url
https://doi.org/10.17706/jsw.21.2.45-77View
Published (Version of record) Open CC BY V4.0

Metrics

1 Record Views

Details

Logo image