commonsense-papers

Must-read papers on commonsense knowledge and others resources and tutorials

Contributed by ADAPTers (major efforts by Zhiling Zhang(@blmoistawinde), Siyu Ren, Hongru Huang, Zelin Zhou, Yanzhu Guo)

Our list may not be complete. We will keep adding papers and improving it. Any suggestions and PRs are welcomed!

Table of Contents

• commonsense-papers
  • Statistics
  • Tutorial and Survey
  • Resources and Evaluation
    • Commonsense Knowledge Bases/Models
    • Related Knowledge Bases
    • Datasets and Benchmarks
    • Evaluation and Probing
  • Knowledge Mining (Knowledge Base Completion)
  • Applications
    • natural language inference (NLI) and commonsense reasoning (CSR)
    • Machine Reading Comprehension (MRC)
    • Generation
    • Question Answering (QA)

Statistics

Research Keywords

Non-stopping words in title, indicating the hot topics in this field.

	count
reasoning	9
language	8
question	5
graph	5
natural	3
model	3
generation	3
answering	3
inference	3
transformer	2

Researchers

Most active researchers in this field

	count
Yejin Choi	11
Chandra Bhagavatula	7
Bill Yuchen Lin	5
Antoine Bosselut	5
Ronan Le Bras	4
Dan Roth	4
Xiang Ren	3
Hannah Rashkin	3
Chaitanya Malaviya	3
Vered Shwartz	3

Tutorial and Survey

Recent Advances in Natural Language Inference: A Survey of Benchmarks, Resources, and Approaches arxiv 2019 paper

Shane Storks, Qiaozi Gao, Joyce Y. Chai

T6: Commonsense Reasoning for Natural Language Processing. ACL 2020. slides and video

Antoine Bosselut, Dan Roth, Maarten Sap, Vered Shwartz, Yejin Choi

back to table of contents

Resources and Evaluation

Commonsense Knowledge Bases/Models

CYC: Toward programs with common sense data(OpenCyc) homepage

ConceptNet 5.5: an open multilingual graph of general knowledge AAAI 2017. paper homepage

Robyn Speer, Joshua Chin, Catherine Havasi

ATOMIC: An Atlas of Machine Commonsense for If-Then Reasoning AAAI 2019. paper homepage

Maarten Sap, Ronan LeBras, Emily Allaway, Chandra Bhagavatula, Nicholas Lourie, Hannah Rashkin, Brendan Roof, Noah A. Smith, Yejin Choi

COMET: Commonsense Transformers for Automatic Knowledge Graph Construction ACL 2019 paper homepage code

Antoine Bosselut, Hannah Rashkin, Maarten Sap, Chaitanya Malaviya, Asli Celikyilmaz, Yejin Choi

ASER: A Large-scale Eventuality Knowledge Graph. WWW 2020 paper homepage code

Hongming Zhang, Xin Liu, Haojie Pan, Yangqiu Song, Cane Wing-Ki Leung

Commonsense Properties from Query Logs and Question Answering Forums (quasimodo) CIKM 2019 paper homepage code

Julien Romero, Simon Razniewski, Koninika Pal, Jeff Z. Pan, Archit Sakhadeo, Gerhard Weikum

TransOMCS: From Linguistic Graphs to Commonsense Knowledge IJCAI 2020 paper homepage code

Hongming Zhang, Daniel Khashabi, Yangqiu Song, Dan Roth

Paragraph-Level Commonsense Transformers with Recurrent Memory (PARA-COMeT) arxiv 2020 paper

Saadia Gabriel, Chandra Bhagavatula, Vered Shwartz, Ronan Le Bras, Maxwell Forbes, Yejin Choi

COMET-ATOMIC 2020: On Symbolic and Neural Commonsense Knowledge Graphs arxiv 2020 paper

Jena D. Hwang, Chandra Bhagavatula, Ronan Le Bras, Jeff Da, Keisuke Sakaguchi, Antoine Bosselut, Yejin Choi

CommonGen: A Constrained Text Generation Challenge for Generative Commonsense Reasoning EMNLP 2020 Findings paper homepage

Bill Yuchen Lin, Wangchunshu Zhou, Ming Shen, Pei Zhou, Chandra Bhagavatula, Yejin Choi, Xiang Ren

Related Knowledge Bases

WordNet: A Lexical Database for English Communications of the ACM Vol. 38, No. 11: 39-41. 1995. [homepage] (https://wordnet.princeton.edu/)

George A. Miller

Toward an Architecture for Never-Ending Language Learning (NELL). AAAI 2010 paper homepage

Andrew Carlson, Justin Betteridge, Bryan Kisiel, Burr Settles, Estevam R. Hruschka Jr., and Tom M. Mitchell

DBpedia – A Large-scale, Multilingual Knowledge Base Extracted from Wikipedia. Semantic Web 1 (2012) paper homepage

Jens Lehmann, Robert Isele, Max Jakob, Anja Jentzsch, Dimitris Kontokostas, Pablo N. Mendes, Sebastian Hellmann, Mohamed Morsey, Patrick van Kleef, Sören Auer, Christian Bizer

Datasets and Benchmarks

CommonSenseqa: A question answering challenge targeting commonsense knowledge NAACL 2019 paper homepage code

Alon Talmor, Jonathan Herzig, Nicholas Lourie, Jonathan Berant

From Recognition to Cognition: Visual Commonsense Reasoning CVPR 2019 paper code homepage

Rowan Zellers, Yonatan Bisk, Ali Farhadi, Yejin Choi

oLMpics -- On what Language Model Pre-training Captures arxiv 2019 paper code homepage

Alon Talmor, Yanai Elazar, Yoav Goldberg, Jonathan Berant

ABDUCTIVE COMMONSENSE REASONING (ART) ICLR 2020 paper homepage

Chandra Bhagavatula, Ronan Le Bras, Chaitanya Malaviya, Keisuke Sakaguchi, Ari Holtzman, Hannah Rashkin, Doug Downey, Scott Wen-tau Yih, Yejin Choi

PIQA: Reasoning about Physical Commonsense in Natural Language AAAI 2020 paper homepage

Yonatan Bisk, Rowan Zellers, Ronan Le Bras, Jianfeng Gao, Yejin Choi

Reasoning about Goals, Steps, and Temporal Ordering with WikiHow EMNLP 2020 paper code

Qing Lyu, Li Zhang, Chris Callison-Burch

Birds have four legs?! NumerSense: Probing Numerical Commonsense Knowledge of Pre-trained Language Models EMNLP 2020 paper homepage

Bill Yuchen Lin, Seyeon Lee, Rahul Khanna and Xiang Ren

back to table of contents

Evaluation and Probing

Joint Reasoning for Multi-Faceted Commonsense Knowledge AKBC 2020 paper homepage

Yohan Chalier, Simon Razniewski, Gerhard Weikum

Does BERT Solve Commonsense Task via Commonsense Knowledge? arxiv 2020 paper

Leyang Cui, Sijie Cheng, Yu Wu, Yue Zhang

back to table of contents

Knowledge Mining (Knowledge Base Completion)

Automatic Extraction of Commonsense LocatedNear Knowledge ACL 2018 paper code

Frank F. Xu, Bill Yuchen Lin, Kenny Q. Zhu

Commonsense Knowledge Mining from Pretrained Models EMNLP 2019 paper

Joe Davison, Joshua Feldman, Alexander Rush

Language Models as Knowledge Bases? EMNLP 2019 paper code

Fabio Petroni, Tim Rocktäschel, Patrick Lewis, Anton Bakhtin, Yuxiang Wu, Alexander H. Miller, Sebastian Riedel

Commonsense Knowledge Base Completion with Structural and Semantic Context AAAI 2020 paper code

Chaitanya Malaviya, Chandra Bhagavatula, Antoine Bosselut, Yejin Choi

Temporal Common Sense Acquisition with Minimal Supervision ACL 2020 paper

Ben Zhou, Qiang Ning, Daniel Khashabi, Dan Roth

back to table of contents

Applications

natural language inference (NLI) and commonsense reasoning (CSR)

Neural natural language inference models enhanced with external knowledge ACL 2018 paper code

• resource: WordNet

Qian Chen, Xiaodan Zhu, Zhen-Hua Ling, Diana Inkpen, Si Wei

Contrastive Self-Supervised Learning for Commonsense Reasoning ACL 2020 paper code

Tassilo Klein, Moin Nabi

Do Language Embeddings Capture Scales? EMNLP Findings 2020 paper code

Xikun Zhang, Deepak Ramachandran, Ian Tenney, Yanai Elazar, Dan Roth

Differentiable Open-Ended Commonsense Reasoning arxiv 2020 paper

Bill Yuchen Lin, Haitian Sun, Bhuwan Dhingra, Manzil Zaheer, Xiang Ren, William W. Cohen

Machine Reading Comprehension (MRC)

Enhancing Pre-Trained Language Representations with Rich Knowledge for Machine Reading Comprehension ACL 2019 paper code

• resource: WordNet, NELL

An Yang, Quan Wang, Jing Liu, Kai Liu, Yajuan Lyu, Hua Wu, Qiaoqiao She, Sujian Li

Generation

Diverse and Informative Dialogue Generation with Context-Specific Commonsense Knowledge Awareness ACL 2020 paper code

• resource: ConceptNet

Sixing Wu, Ying Li, Dawei Zhang, Yang Zhou, Zhonghai Wu

Language Generation with Multi-Hop Reasoning on Commonsense Knowledge Graph EMNLP 2020 paper

• resource: ConceptNet

Haozhe Ji, Pei Ke, Shaohan Huang, Furu Wei, Xiaoyan Zhu, Minlie Huang

Question Answering (QA)

Dynamic Knowledge Graph Construction for Zero-shot Commonsense Question Answering arxiv 2019 paper

• resource: COMET

Antoine Bosselut, Yejin Choi

Adversarial Training for Commonsense Inference ACL2020 RepL4NLP workshop paper

Lis Pereira, Xiaodong Liu, Fei Cheng, Masayuki Asahara, Ichiro Kobayashi

Unsupervised Commonsense Question Answering with Self-Talk EMNLP 2020 paper code

• resource: ConceptNet, COMET, Google N-grams

Vered Shwartz, Peter West, Ronan Le Bras, Chandra Bhagavatula, Yejin Choi

Scalable Multi-Hop Relational Reasoning for Knowledge-Aware Question Answering EMNLP 2020 paper code

Yanlin Feng, Xinyue Chen, Bill Yuchen Lin, Peifeng Wang, Jun Yan, Xiang Ren

back to table of contents