Performance Optimization for Transformer Models on Text Classification Tasks

Kshitij Malvankar, Enda Fallon, Paul Connolly, Kieran Flanagan

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

2 Citations (Scopus)

Abstract

The emergence of social media has led to a new set of celebrities, known as influencers. Influencers are individuals who have built a following on social media platforms such as Instagram, YouTube, and Twitter. These individuals have the power to influence the opinions and purchasing decisions of their followers. As a result, brands have sought out partnerships with influencers to promote their products or services. However, with the rise of sponsored content, it has become increasingly difficult to discern whether a post is genuinely endorsed by an influencer or is paid for by the brand. This paper explores how machine learning models can be used to classify influencer tweets as sponsored or not sponsored. Through the use of transformer language models such as BERT, GPT 2 and GPT Neo, we can identify patterns and relations between an influencer and a brand. By analyzing the content and context of influencer tweets, machine learning models can help identify whether a tweet is a sponsored post or not. This paper also takes into consideration the performance metrics such as training time and draws comparison between the models. The use of machine learning models to classify influencer tweets as sponsored or not sponsored will aid in the development of new metrics that accurately measure the effectiveness of influencer marketing. This will, in turn, lead to a more transparent and mutually beneficial influencer marketing industry.

Original languageEnglish
Title of host publicationProceedings of the 2023 International Conference on Emerging Techniques in Computational Intelligence, ICETCI 2023
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages105-111
Number of pages7
ISBN (Electronic)9798350300604
ISBN (Print)9798350300604
DOIs
Publication statusPublished - 2023
Event3rd International Conference on Emerging Techniques in Computational Intelligence, ICETCI 2023 - Hyderabad, India
Duration: 21 Sep 202323 Sep 2023

Publication series

NameProceedings of the 2023 International Conference on Emerging Techniques in Computational Intelligence, ICETCI 2023

Conference

Conference3rd International Conference on Emerging Techniques in Computational Intelligence, ICETCI 2023
Country/TerritoryIndia
CityHyderabad
Period21/09/2323/09/23

Keywords

  • BERT
  • GPT-2
  • GPT-Neo
  • transformer models

Fingerprint

Dive into the research topics of 'Performance Optimization for Transformer Models on Text Classification Tasks'. Together they form a unique fingerprint.

Cite this