[2102.06820] Characterizing English Variation across Social Media Communities with BERT

Much previous work characterizing language variation across Internet social groups has focused on the types of words used by these groups. We extend this type of study by employing BERT to characterize variation in the senses of words as well, analyzing two months of English comments in 474 Reddit communities. The specificity of different sense clusters to a community, combined with the specificity of a community's unique word types, is used to identify cases where a social group's language deviates from the norm. We validate our metrics using user-created glossaries and draw on sociolinguistic theories to connect language variation with trends in community behavior. We find that communities with highly distinctive language are medium-sized, and their loyal and highly engaged users interact in dense networks.

2 mentions: @vjhofmann
Keywords: bert
Date: 2021/02/23 02:21

Referring Tweets

@vjhofmann Awesome upcoming TACL paper by @lucy3_li and @dbamman on investigating social variation in word meaning with BERT! I particularly like their analysis of the link between linguistic distinctiveness and network density. t.co/zDPH7RBr0S

Related Entries

Read more GitHub - adjidieng/DETM
0 users, 1 mentions 2020/01/20 00:51
Read more Cognitive Computation Group
1 users, 1 mentions 2020/03/03 23:20
Read more [2003.09772] Invariant Rationalizationopen searchopen navigation menucontact arXivarXiv Twitter
0 users, 1 mentions 2020/05/12 17:21
Read more [2005.04908] Local Self-Attention over Long Text for Efficient Document Retrievalopen searchopen nav...
0 users, 2 mentions 2020/05/13 15:51
Read more GitHub - zll17/Neural_Topic_Models: Implementation of topic models based on neural network approache...
0 users, 1 mentions 2020/11/27 15:51
Read more [2012.01316] Improved Contrastive Divergence Training of Energy Based Models
0 users, 1 mentions 2020/12/22 08:21