This repository has been archived by the owner on Jul 27, 2022. It is now read-only.
-
Notifications
You must be signed in to change notification settings - Fork 19
/
Copy pathiirc.html
57 lines (51 loc) · 2.48 KB
/
iirc.html
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
---
---
<!DOCTYPE html>
<html lang="en-us">
<head>
{% include meta.html %}
<title>AllenNLP - IIRC Dataset</title>
</head>
<body id="top">
<div id="page-content">
{% include header.html %}
<div class="banner banner--interior-hero">
<div class="constrained constrained--sm">
<div class="banner--interior-hero__content">
<h2>IIRC: A Dataset of Incomplete Information Reading Comprehension Questions</h2>
<p class="t-sm">James Ferguson, Matt Gardner, Hannaneh Hajishirzi, Tushar Khot and Pradeep Dasigi<br>EMNLP 2020.</p>
</div>
</div>
</div>
<div class="constrained constrained--med">
<p>
Humans often have to read multiple documents to address their information needs. However, most existing reading comprehension tasks only focus on questions for which the contexts provide all the information required to answer them, thus not evaluating a system's performance at identifying a potential lack of sufficient information and locating the sources for that information. IIRC is a crowdsourced dataset consisting of information-seeking questions requiring models to identify and then retrieve necessary information that is missing from the original context.
</p>
<p>
Find more details in the links below.
</p>
<li>
<a href="https://www.semanticscholar.org/paper/IIRC%3A-A-Dataset-of-Incomplete-Information-Reading-Ferguson-Gardner/01a1f2df34d947d7aa5698ca6fb31c03d15a5183">Paper</a>, describing the dataset and our baseline models for it.
</li>
<li>
<a href="https://allenai.org/data/iirc">Dataset</a> with about 10.8k questions in the train set and 1.3k questions in both the dev and test sets. The data is distributed under the <a href="https://creativecommons.org/licenses/by/4.0/">CC BY 4.0</a> license.</li>
<li>
<a href="https://github.com/jferguson144/IIRC-baseline">Code</a> for the baseline described in the paper.
</li>
<p><i>Citation:</i>
<pre>
@inproceedings{Ferguson2020IIRC,
author={James Ferguson and Matt Gardner and Hannaneh Hajishirzi and Tushar Khot and Pradeep Dasigi},
title={ {IIRC}: A Dataset of Incomplete Information Reading Comprehension Questions},
booktitle={Proc. of EMNLP},
year={2020}
}
</pre>
</p>
</div>
{% include footer.html %}
</div>
{% include svg-sprite.html %}
{% include scripts.html %}
</body>
</html>