ABCDEFGHIJKLMNOPQRSTUVWXYZ
1
Created May 2017 for the "Build It Break It" QA-SRL task, explained at: https://bibinlp.umiacs.umd.edu/
2
3
"final" tab contains the finished entries that we submitted.
4
"wiki2.test" is the tab used when working and creating the examples.
5
6
UMass Amherst breaker team for QA-SRL: Carolyn Anderson, Su Lin Blodgett, Abram Handler, Katie Keith, Brendan O'Connor
7
8
Our team used a wide variety of linguistically motivated strategies to confuse natural language processing models, including, for example, adding neither/nor constructions, adding coordination, changing prepositions, shifting word senses, increasing token distances, changing word order, adding additional dates and times, pronoun resolution, etc. Individual annotators labeled examples with brief explanations, which are available in our data spreadsheet at: https://docs.google.com/spreadsheets/d/12S7lpcrL62fPZnEGyLLnqhkd2W4MyRG_NTgY4q-0buA/edit?usp=sharing
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100