Curated list of Sentiment Analysis methods, implementations and misc.
Sentiment Analysis is the field of study that analyzes people's opinions, sentiments, evaluations, attitudes, and emotions from written languages. (Liu 2012)
- Contents
- Objective
- Introduction
- Survey Papers
- Baseline Systems
- Resources and Corpora
- Open Source Implementations
- SaaS APIs
- Web Apps
- Contributing
The goal of this repository is to provide adequate links for scholars who want to research in this domain; and at the same time, be sufficiently accessible for developers who want to integrate sentiment analysis into their applications.
Sentiment Analysis happens at various levels:
- Document-level Sentiment Analysis evaluate sentiment of a single entity (i.e. a product) from a review document.
- Sentence-level Sentiment Analysis evaluate sentiment from a single sentence.
- Aspect-level Sentiment Analysis performs finer-grain analysis. For example, the sentence “the iPhone’s call quality is good, but its battery life is short.” evaluates two aspects: call quality and battery life, of iPhone (entity). The sentiment on iPhone’s call quality is positive, but the sentiment on its battery life is negative. (Liu 2012)
Most recent research focuses on the aspect-based approaches. But not all opensource implementations are caught up yet.
There are many different approaches to solve the problem. Lexical methods, for example, look at the frequency of words expressing positive and negative sentiment (from i.e. SentiWordNet) occurring in the given sentence. Supervised Machine Learning, such as Naive Bayes and Support Vector Machine (SVM), can be used with training data. Since training examples are difficult to obtain, Unsupervised Machine Learning, such as Latent Dirichlet Allocation (LDA) and word embeddings (Word2Vec) are also used on large unlabeled datasets. Recent works also apply Deep Learning methods such as Convolutional Neural Network (CNN) and Long Short-term Memory (LSTM), as well as their attention-based variants. You will find more details in the survey papers.
Liu, Bing. "Sentiment analysis and opinion mining." Synthesis lectures on human language technologies 5.1 (2012): 1-167. [pdf]
Vinodhini, G., and R. M. Chandrasekaran. "Sentiment analysis and opinion mining: a survey." International Journal 2.6 (2012): 282-292. [pdf]
Medhat, Walaa, Ahmed Hassan, and Hoda Korashy. "Sentiment analysis algorithms and applications: A survey." Ain Shams Engineering Journal 5.4 (2014): 1093-1113. [pdf]
Wang, Sida, and Christopher D. Manning. "Baselines and bigrams: Simple, good sentiment and topic classification." Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Short Papers-Volume 2. Association for Computational Linguistics, 2012. [pdf]
Cambria, Erik, Daniel Olsher, and Dheeraj Rajagopal. "SenticNet 3: a common and common-sense knowledge base for cognition-driven sentiment analysis." Proceedings of the twenty-eighth AAAI conference on artificial intelligence. AAAI Press, 2014. [pdf]
AFINN: List of English words rated for valence [web]
SentiWordNet: Lexical resource devised for supporting sentiment analysis. [web] [paper]
GloVe: Algorithm for obtaining word vectors. Pretrained word vectors available for download [web] [paper]
SemEval14-Task4: Annotated aspects and sentiments of laptops and restaurants reviews. [web] [paper]
Stanford Sentiment Treebank: Sentiment dataset with fine-grained sentiment annotations [web] [paper]
Multidimensional Lexicon for Interpersonal Stancetaking [web] [paper]
The characteristics of each implementation are described.
Caveats: A key problem in sentiment analysis is its sensitivity to the domain from which either training data is sourced, or on which a sentiment lexicon is built. [♠] Be careful assuming off-the-shelf implementations will work for your problem, make sure to look at the model assumptions and validate whether they’re accurate on your own domain [♦].
thisandagain/sentiment: Lexical, Dictionary-based, AFINN-based.
thinkroth/Sentimental Lexical, Dictionary-based, AFINN-based.
LingPipe: Lexical, Corpus-based, Supervised Machine Learning
CoreNLP: Supervised Machine Learning, Deep Learning
ASUM: Unsupervised Machine Learning, Latent Dirichlet Allocation. [paper]
nltk: VADER sentiment analysis tool, Lexical, Dictionary-based, Rule-based. [paper]
vivekn/sentiment: Supervised Machine Learning, Naive Bayes Classifier. [paper]
xiaohan2012/twitter-sent-dnn: Supervised Machine Learning, Deep Learning, Convolutional Neural Network. [paper]
abdulfatir/twitter-sentiment-analysis: Sentiment analysis on tweets using Naive Bayes, SVM, CNN, LSTM, etc.
kevincobain2000/sentiment_classifier: Supervised Machine Learning, Naive Bayes Classifier, Max Entropy Classifier, SentiWordNet.
pedrobalage/SemevalAspectBasedSentimentAnalysis: Aspect-Based, Supervised Machine Learning, Conditional Random Field.
ganeshjawahar/mem_absa: Aspect-Based, Supervised Machine Learning, Deep Learning, Attention-based, External Memory. [paper]
openai/generating-reviews-discovering-sentiment: Deep Learning, byte mLSTM [paper]
yiyang-gt/social-attention: Deep Learning, Attention-based. Uses authors' position in the social network to aide sentiment analysis. [paper].
thunlp/NSC: Deep Learning, Attention-based. Uses user and production information.[paper].
timjurka/sentiment: Supervised Machine Learning, Naive Bayes Classifier.
cdipaolo/sentiment: Supervised Machine Learning, Naive Bayes Classifier. Based on cdipaolo/goml.
malavbhavsar/sentimentalizer: Lexical, Dictionary-based.
7compass/sentimental: Lexical, Dictionary-based.
amrish7/Dragon: Supervised Machine Learning, Naive Bayes Classifier.
- Google Cloud Natural Language API [web]
- IBM Watson Alchemy Language [web]
- Microsoft Cognitive Service [web]
- Aylien [web]
- Indico [web]
- Rosette API [web]
- Textalytic [web]
👍🎉 First off, thanks for taking the time to contribute! 🎉👍
Steps to contribute:
- Make your awesome changes
- Submit pull request; if you add a new entry, please give a very brief explanation why you think it should be added.
