Computational Sentiment Analysis of User Interactions on Live Streaming Platforms Using Artificial Expert Judgment

Muhamad Sandy Saputra; Ridwan Sanjaya

doi:10.24167/sisforma.v13i1.15480

Computational Sentiment Analysis of User Interactions on Live Streaming Platforms Using Artificial Expert Judgment

Muhamad Sandy Saputra, Ridwan Sanjaya

Abstract

This study examines user interaction patterns on JKT48 Showroom live streaming using sentiment analysis on 14,857 interactions processed with a Large Language Model. The results show that most interactions are neutral (93.63%) with positive and negative sentiments appearing in smaller proportions. This suggests that user participation is mainly routine and reflects a form of “silent loyalty”. The findings highlight the importance of maintaining a stable user experience to support long term engagement.

Keywords

behavioral loyalty; computational social science; neutral sentiment; user participation

Full Text:

PDF

References

K. N. Lemon and P. C. Verhoef, “Understanding customer experience throughout the customer journey,” vol. 80, no. 6, 2016, doi: 10.1509/jm.15.0420.

M. U. Tariq, “Live Streams and Community Interaction in Digital Broadcasting,” IGI Glob. Publ., 2026, doi: 10.4018/979-8-3373-1459-4.ch008.

H. Yuliansyah, H. A. Raihan, and Murinto, “Sentiment Analysis Model for VTuber Live Stream Chat Using Decision Tree and Support Vector Machine,” vol. 7, no. 2, 2025, doi: 10.35970/jinita.v7i2.2872.

T.-H. Chu and W.-H. Chu, “Why Do Some Watch While Others Donate? An S-O-R Perspective of Live Streaming Engagement,” Elsevier, vol. 62, no. 8, 2025, doi: 10.1016/j.im.2025.104235.

P. Törnberg, “Large Language Models Outperform Expert Coders and Supervised Classifiers at Annotating Political Social Media Messages,” Sage J., vol. 43, no. 6, 2024, doi: 10.1177/08944393241286471.

K. Parkington et al., “Human Vs. LLM-Based Thematic Analysis for Digital Mental Health Research: Proof-of-Concept Comparative Study,” arXiv, 2025, doi: https://doi.org/10.48550/arXiv.2507.08 002.

A. Pilny, K. McAninch, A. Slone, and K. Moore, “From Manual to Machine: Assessing the Efficacy of Large Language Models in Content Analysis,” Taylor Francis Online, vol. 41, pp. 61–70, 2024, doi:

1080/08824096.2024.2327547.

R. Anil, sebastian Borgeaud, J.-B. Alayrac, and J. Yu, “Gemini: A Family of Highly Capable Multimodal Models,” 2023, doi: 10.48550/arXiv.2312.11805.

C.-C. Chen and Y.-C. Lin, “What drives live-stream usage intention? The perspectives of flow, entertainment, social interaction, and endorsement,” vol. 35, no. 1, pp. 293–303, 2018, doi: 10.1016/j.tele.2017.12.003.

M. Kim and H.-M. Kim, “What Online Game Spectators Want from Their Twitch Streamers: Flow and Well-Being Perspectives,” Elsevier, vol. 66, 2022, doi: 10.1016/j.jretconser.2022.102951.

K. Scheibe, F. Zimmer, K. J. Fietkiewicz, and Wolfgang G. Stock, “Interpersonal Relations and Social Actions on Live Streaming Services. A Systematic Review on Cyber-Social Relations,” Proc. 55th Hawaii Int.Conf. Syst. Sci., 2022, doi: 10.24251/HICSS.2022.410.

H. Said, B. S. Tawfik, and M. A. Makhlouf, “A Deep Learning Approach for Sentiment Classification of COVID-19 Vaccination Tweets,” Int. J. Adv. Comput. Sci. Appl., vol. 14, 2023.

L. Ma, S. Gao, and X. Zhang, “How to Use Live Streaming to Improve Consumer Purchase Intentions: Evidence from China,” 2022, doi: 10.3390/su14021045.

X. Qianyi, “Research on The Impact of User Experience Quality on Consumers’ Shopping Intention in The Field of Live E-Commerce”, doi: 10.23977/EDMS2020.020.

R. Eliviani and D. D. Wazaumi, “Exploring Sentiment Trends: Deep Learning Analysis of Social Media Reviews on Google Play Store by Netizens,” http://ijadis.org, vol. 5, 2024, doi: 10.59395/ijadis.v5i1.1318.

DOI: https://doi.org/10.24167/sisforma.v13i1.15480