Sentiment Sweep

11 comments
Recently I developed and published an opensource web app that uses data from Twitter combined with sentiment analysis and emotion detection to create a series of data visualisations to illustrate the happy and less happy locations, topics and times....

The Final Product

Live application: http://sentiment-sweep.com/


The Aim

1. To make the uncomprehendable mass of Twitter data that available for many topic, accessible, clear and understandable for users.
2. To develop a new, faster more efficient method of calculating sentiment on the fly.
3. To use only opensource resources (and many of them!), and to then document and publish all code and findings from results back to the opensource comunity via GitHub.
4. To allow businesses and individuals to analyse the good/ bad points about what people are saying about their product or brand.

This primarily involved the research and development of a sentiment analysis module, and the implementation of it on real-time social media data, to generate a series of live visual representations of sentiment towards a specific topic or by location in order to find trends.


Screenshots

There are some screenshots of the various data visualisations here: 
https://github.com/Lissy93/twitter-sentiment-visualisation/tree/dev/docs/screenshots



Tech Stack

There is so much really cool new technologies (languages, libraries, API's, dev tools, platforms....) published opensource all the time! And I wanted this project to utilize and build upon many of these awesome projects! Below is a summary of the main tech stack:



Published Node Modules

Several open sauce node modules have been developed and published on npm as part of this project
  • sentiment-analysis - useses the AFINN-111 word list to calculate overall sentiment of a sentence
  • fetch-tweets - fetches tweets from Twitter based on topic, location, timeframe or combination
  • stream-tweets - streams live Tweets in real-time
  • remove-words - removes all non-key words from a string sentence
  • place-lookup - finds the latitude and longitude for any fuzzy place name using the Google Places API
  • hp-haven-sentiment-analysis - A Node.js client library for HP Haven OnDemand Sentiment Analysis module
  • haven-entity-extraction - Node.js client for HP Haven OnDemand Entity Extraction
  • tweet-location - calculates the location from geo-tagged Tweets using the Twitter Geo API
  • find-region-from-location - given a latitude and longitude calculates which region that point belongs in

Documentation

Thorough documentation of opensource projects is very important to ensure future maintainability, and to allow other developers to use the code in their projects, or to contribute.

The documentation can be viewed at: https://github.com/Lissy93/twitter-sentiment-visualisation/tree/dev/docs

Below are links to each of the key documentation articles written as part of the project 


Project Information

Project Planning

Development Documentation

Research




11 comments :

  1. Very Nice information!! I like this Very much !!
    #Best #social #media #listening & #monitoring #company uses # best social media #sentiment #analysis tools, media #intelligence tools, Market monitoring tools, social media #trending tools, USA, UK #Market.

    best Social media monitoring services Company Media Listening | Analytics intelligence tools USA UK

    ReplyDelete
    Replies
    1. Great Article The IEEE Xplore digital library is your gateway to trusted research—journals, conferences, standards, ebooks, and educational courses—with more than 3 million articles to help you fuel imagination, build from previous research, and inspire new ideas. Node Js Projects for Final Year IEEE will pave a new way in knowledge-sharing and spreading ideas across the globe. Project Centers in Chennai for CSE Node.js Corporate Training JavaScript Training in Chennai

      Delete
  2. If you're looking to lose kilograms then you certainly need to jump on this brand new custom keto meal plan diet.

    To create this keto diet, certified nutritionists, personal trainers, and top chefs joined together to produce keto meal plans that are efficient, convenient, cost-efficient, and enjoyable.

    Since their first launch in early 2019, thousands of clients have already remodeled their body and well-being with the benefits a smart keto meal plan diet can provide.

    Speaking of benefits; clicking this link, you'll discover 8 scientifically-tested ones provided by the keto meal plan diet.

    ReplyDelete
  3. Excellent post. I was always checking this blog, and I’m impressed! Extremely useful info specially the last part, I care for such information a lot. I was exploring this particular info for a long time. Thanks to this blog my exploration has ended.
    If you want Digital Marketing Serives :-
    Digital marketing Service in Delhi
    SMM Services
    PPC Services in Delhi
    Website Design & Development Packages
    SEO Services PackagesLocal SEO services
    E-mail marketing services
    YouTube plans

    ReplyDelete
  4. Nice Post, CnX Player offers a fantastic Video Casting feature that gives an absolute freedom to all its users to cast ANY (literally ANY) video format and ANY video codec from PC to TV within a fraction of seconds! It is a Best Media Player.

    Features @ CnX Player - Best Media Player

    * Stream ANY video from PC to Chromecast
    * Cast ALL Videos From PC To All Smart TV
    * Stream ANY video from PC to Chromecast
    * Cast Videos from iPhone iPad to Firestick TV
    * Stream any videos from PC to MI TV
    * Cast ALL Videos from PC to Android TV
    * Stream ANY Video From PC To SAMSUNG TV

    For more information visit our website at Best Media Player - CnX Player

    ReplyDelete
  5. Thanks for the always useful information. This is great information to help peoples and nice article written by writer. CnX Player is a powerful & efficient 4K ultra HD enabled video player for Windows 10 PC & Tablet, Android and iOS – iPhone & iPad.

    Download Media Player for Windows 10 - Microsoft Store
    Download Video Player for Android from Google Play
    Download Video Player for iPhone/iPad from Apple App Store

    ReplyDelete