Automatically Ranking the Credibility of Tweets During Major Events

In their study, “Credibility Ranking of Tweets during High Impact Events,” authors Aditi Gupta and Ponnurangam Kumaraguru “analyzed the credibility of information in tweets corresponding to fourteen high impact news events of 2011 around the globe.” According to their analysis, “30% of total tweets  about an event contained situational information about the event while 14% was spam.” In addition, about 17% of total tweets contained situational awareness information that was credible.

Workflow

The study analyzed over 35 million tweets posted by ~8 million users based on current trending topics. From this data, the authors identified 14 major events reflected in the tweets. These included the UK riots, Libya crisis, Virginia earthquake and Hurricane Irene, for example.

“Using regression analysis, we identi ed the important content and sourced based features, which can predict the credibility of information in a tweet. Prominent content based features were number of unique characters, swear words, pronouns, and emoticons in a tweet, and user based features like the number of followers and length of username. We adopted a supervised machine learning and relevance feedback approach using the above features, to rank tweets according to their credibility score. The performance of our ranking algorithm signi cantly enhanced when we applied re-ranking strategy. Results show that extraction of credible information from Twitter can be automated with high confi dence.”

The paper is available here (PDF). For more applied research on “information forensics,” please see this link.

12 responses to “Automatically Ranking the Credibility of Tweets During Major Events

  1. The most interesting question is what percentage was active disinformation

  2. Pingback: Predicting the Credibility of Disaster Tweets Automatically | iRevolution

  3. Pingback: Analyzing the Veracity of Tweets during a Major Crisis | iRevolution

  4. Pingback: Debating The Value of Tweets For Disaster Response (Intelligently) | iRevolution

  5. Pingback: Tweet analyzer ranks trustworthy Tweets during emergencies | Tim Batchelder.com

  6. Pingback: Tweeting is Believing? Analyzing Perceptions of Credibility on Twitter | iRevolution

  7. Pingback: Humanitarianism in the Network Age: Groundbreaking Study | iRevolution

  8. Pingback: Tweet analyzer ranks trustworthy Tweets during emergencies | Tim Batchelder.com

  9. Pingback: Automatically Identifying Fake Images Shared on Twitter During Disasters | iRevolution

  10. Pingback: Analyzing Fake Content on Twitter During Boston Marathon Bombings | iRevolution

  11. Pingback: New Insights on How To Verify Social Media | iRevolution

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s