init commit

sbarman25 · Nov 16, 2023 · 2684036 · 2684036
1 parent caa4845
commit 2684036
Show file tree

Hide file tree

Showing 10 changed files with 78,822 additions and 1 deletion.
diff --git a/.DS_Store b/.DS_Store
diff --git a/README.md b/README.md
@@ -1 +1,22 @@
-# IfQA
+## IfQA dataset
+
+### Introduction of IfQA
+
+- IfQA if a open-domain question answering dataset where each question is based on a counterfactual presupposition via an ``if'' clause. For example, if Los Angeles was on the east coast of the U.S., what would be the time difference between Los Angeles and Paris? 
+
+- Such questions require models to go beyond retrieving direct factual knowledge from the Web: they must identify the right information to retrieve and reason about an imagined situation that may even go against the facts built into their parameters. 
+
+- The IfQA dataset contains 3,800 questions that were annotated by crowdworkers on relevant Wikipedia passages. We hope the unique challenges posed by IfQA will push open-domain QA research on both retrieval and reasoning fronts, while also helping endow counterfactual reasoning abilities to today's language understanding models.
+
+<img src="images/ifqa.png" width="600" align=center>
+
+### Citation
+
+```
+@inproceedings{yu2023ifqa,
+  title={IfQA: A Dataset for Open-domain Question Answering under Counterfactual Presuppositions},
+  author={Yu, Wenhao and Jiang, Meng and Clark, Peter and Sabharwal, Ashish},
+  booktitle={The 2023 Conference on Empirical Methods in Natural Language Processing},
+  year={2023}
+}
+```
diff --git a/dataset/.DS_Store b/dataset/.DS_Store
diff --git a/dataset/few_split/dev.json b/dataset/few_split/dev.json
diff --git a/dataset/few_split/test.json b/dataset/few_split/test.json
diff --git a/dataset/few_split/train.json b/dataset/few_split/train.json
diff --git a/dataset/full_split/dev.json b/dataset/full_split/dev.json
diff --git a/dataset/full_split/test.json b/dataset/full_split/test.json
diff --git a/dataset/full_split/train.json b/dataset/full_split/train.json
diff --git a/images/ifqa.png b/images/ifqa.png