Skip to content

Commit

Permalink
add domains for multirc tasks
Browse files Browse the repository at this point in the history
  • Loading branch information
@garyhlai
garyhlai committed Oct 19, 2021
1 parent 9368d76 commit f343825
Show file tree
Hide file tree
Showing 11 changed files with 2,178 additions and 2,057 deletions.
319 changes: 165 additions & 154 deletions tasks/task048_multirc_question_generation.json
View file

Large diffs are not rendered by default.

1,385 changes: 698 additions & 687 deletions tasks/task049_multirc_questions_needed_to_answer.json
View file

Large diffs are not rendered by default.

77 changes: 44 additions & 33 deletions tasks/task050_multirc_answerability.json
View file

Large diffs are not rendered by default.

61 changes: 36 additions & 25 deletions tasks/task051_multirc_correct_answer_single_sentence.json
View file
Original file line number Diff line number Diff line change
Expand Up @@ -435,7 +435,7 @@
]
},
{
"input": "Sentence: The average winter temperature is 10.1 \u00b0C (50.2 \u00b0F). \nQuestion: What is the Kathmandu Valley's average temperature in winter, in degrees Fahrenheit?",
"input": "Sentence: The average winter temperature is 10.1 °C (50.2 °F). \nQuestion: What is the Kathmandu Valley's average temperature in winter, in degrees Fahrenheit?",
"output": [
"10.1 C.",
"50.2."
Expand Down Expand Up @@ -945,7 +945,7 @@
]
},
{
"input": "Sentence: During a 2013 cold front, the winter temperatures of Kathmandu dropped to \u22124 \u00b0C (25 \u00b0F), and the lowest temperature was recorded on January 10, 2013, at \u22129.2 \u00b0C (15.4 \u00b0F). \nQuestion: On what date in 2013 was it 15.4 degrees Fahrenheit in Kathmandu?",
"input": "Sentence: During a 2013 cold front, the winter temperatures of Kathmandu dropped to −4 °C (25 °F), and the lowest temperature was recorded on January 10, 2013, at −9.2 °C (15.4 °F). \nQuestion: On what date in 2013 was it 15.4 degrees Fahrenheit in Kathmandu?",
"output": [
"JANUARY 10,2013.",
"January 10, 2013."
Expand Down Expand Up @@ -3602,7 +3602,7 @@
]
},
{
"input": "Sentence: The Tribhuvan Museum contains artifacts related to the King Tribhuvan (1906\u20131955). \nQuestion: When did Tribhuvan die?",
"input": "Sentence: The Tribhuvan Museum contains artifacts related to the King Tribhuvan (1906–1955). \nQuestion: When did Tribhuvan die?",
"output": [
"1955."
]
Expand Down Expand Up @@ -4852,7 +4852,7 @@
]
},
{
"input": "Sentence: The Mahendra Museum is dedicated to king Mahendra of Nepal (1920\u20131972). \nQuestion: What was the birth year of King Mahendra?",
"input": "Sentence: The Mahendra Museum is dedicated to king Mahendra of Nepal (1920–1972). \nQuestion: What was the birth year of King Mahendra?",
"output": [
"1920."
]
Expand Down Expand Up @@ -5150,7 +5150,7 @@
"input": "Sentence: He didn't want everyone to laugh at him at feeding time when he couldn't reach the food by himself, so he said he could not come to the party Scap was a really good friend and he knew that Scoop wanted to come to the party, so he came up with a plan. \nQuestion: Why was Scoop embarrassed to go the the party?",
"output": [
"He couldn't reach the food by himself.",
"He didn\u2019t want to be laughed at during feeding time.",
"He didn’t want to be laughed at during feeding time.",
"Scoop didn't want people to laugh at him when he couldn't reach the food by himself during feeding time."
]
},
Expand Down Expand Up @@ -5290,9 +5290,9 @@
]
},
{
"input": "Sentence: During medieval times, the city was sometimes called Kantipur (\u0915\u093e\u0928\u094d\u0924\u093f\u092a\u0941\u0930). \nQuestion: What is the ancient name of Kathmandu?",
"input": "Sentence: During medieval times, the city was sometimes called Kantipur (कान्तिपुर). \nQuestion: What is the ancient name of Kathmandu?",
"output": [
"Kantipur (\u0915\u093e\u0928\u094d\u0924\u093f\u092a\u0941\u0930)."
"Kantipur (कान्तिपुर)."
]
},
{
Expand Down Expand Up @@ -5889,7 +5889,7 @@
]
},
{
"input": "Sentence: Under K\u00f6ppen's climate classification, portions of the city with lower elevations have a humid subtropical climate (Cwa), while portions of the city with higher elevations generally have a subtropical highland climate. \nQuestion: Along with a subtropical highland climate, what climate classification covers Kathmandu?",
"input": "Sentence: Under Köppen's climate classification, portions of the city with lower elevations have a humid subtropical climate (Cwa), while portions of the city with higher elevations generally have a subtropical highland climate. \nQuestion: Along with a subtropical highland climate, what climate classification covers Kathmandu?",
"output": [
"Subtropical climate.",
"humid subtropical climate."
Expand Down Expand Up @@ -6256,9 +6256,9 @@
]
},
{
"input": "Sentence: This zone is followed by the Cool Temperate Zone with elevation varying between 2,100\u20133,300 metres (6,900\u201310,800 ft). \nQuestion: How many meters up is the Cool Temperate Zone?",
"input": "Sentence: This zone is followed by the Cool Temperate Zone with elevation varying between 2,100–3,300 metres (6,900–10,800 ft). \nQuestion: How many meters up is the Cool Temperate Zone?",
"output": [
"2,100\u20133,300 meters.",
"2,100–3,300 meters.",
"2100-3300.",
"varies between 2100-3300 meters."
]
Expand Down Expand Up @@ -7725,7 +7725,7 @@
]
},
{
"input": "Sentence: Under K\u00f6ppen's climate classification, portions of the city with lower elevations have a humid subtropical climate (Cwa), while portions of the city with higher elevations generally have a subtropical highland climate. \nQuestion: What is the K\u00f6ppen abbreviation for a humid subtropical climate?",
"input": "Sentence: Under Köppen's climate classification, portions of the city with lower elevations have a humid subtropical climate (Cwa), while portions of the city with higher elevations generally have a subtropical highland climate. \nQuestion: What is the Köppen abbreviation for a humid subtropical climate?",
"output": [
"Cwa."
]
Expand Down Expand Up @@ -7999,11 +7999,11 @@
]
},
{
"input": "Sentence: Boudhanath is known as Kh\u0101sti by Newars and as Bauddha or Bodhn\u0101th by speakers of Nepali. \nQuestion: What do the Newars call Boudhanath?",
"input": "Sentence: Boudhanath is known as Khāsti by Newars and as Bauddha or Bodhnāth by speakers of Nepali. \nQuestion: What do the Newars call Boudhanath?",
"output": [
"Khasli.",
"Khasti.",
"Kh\u0101sti."
"Khāsti."
]
},
{
Expand Down Expand Up @@ -9802,7 +9802,7 @@
]
},
{
"input": "Sentence: Under K\u00f6ppen's climate classification, portions of the city with lower elevations have a humid subtropical climate (Cwa), while portions of the city with higher elevations generally have a subtropical highland climate. \nQuestion: How many significant climate regions exist in Nepal?",
"input": "Sentence: Under Köppen's climate classification, portions of the city with lower elevations have a humid subtropical climate (Cwa), while portions of the city with higher elevations generally have a subtropical highland climate. \nQuestion: How many significant climate regions exist in Nepal?",
"output": [
"2."
]
Expand Down Expand Up @@ -10319,7 +10319,7 @@
]
},
{
"input": "Sentence: Of these, Kathmandu Valley is in the Warm Temperate Zone (elevation ranging from 1,200\u20132,300 metres (3,900\u20137,500 ft)), where the climate is fairly temperate, atypical for the region. \nQuestion: Along with a subtropical highland climate, what climate classification covers Kathmandu?",
"input": "Sentence: Of these, Kathmandu Valley is in the Warm Temperate Zone (elevation ranging from 1,200–2,300 metres (3,900–7,500 ft)), where the climate is fairly temperate, atypical for the region. \nQuestion: Along with a subtropical highland climate, what climate classification covers Kathmandu?",
"output": [
"Warm Temperate Zone."
]
Expand Down Expand Up @@ -11833,7 +11833,7 @@
]
},
{
"input": "Sentence: Kathmandu(/\u02cck\u0251\u02d0tm\u0251\u02d0n\u02c8du\u02d0/; Nepali pronunciation: [k\u0251\u0288\u02b0m\u0251\u0273\u0256u]) is the capital and largest municipality of Nepal. \nQuestion: What country is Kathmandu the capital of?",
"input": "Sentence: Kathmandu(/ˌkɑːtmɑːnˈduː/; Nepali pronunciation: [kɑʈʰmɑɳɖu]) is the capital and largest municipality of Nepal. \nQuestion: What country is Kathmandu the capital of?",
"output": [
"Nepal."
]
Expand Down Expand Up @@ -13940,7 +13940,7 @@
]
},
{
"input": "Sentence: The Boudhanath, (also written Bouddhanath, Bodhnath, Baudhanath or the Kh\u0101sa Chaitya), is one of the holiest Buddhist sites in Nepal, along with Swayambhu. \nQuestion: To what religion is Boudhanath holy?",
"input": "Sentence: The Boudhanath, (also written Bouddhanath, Bodhnath, Baudhanath or the Khāsa Chaitya), is one of the holiest Buddhist sites in Nepal, along with Swayambhu. \nQuestion: To what religion is Boudhanath holy?",
"output": [
"Boudhanath is holy to Buddhism.",
"Buddhism."
Expand Down Expand Up @@ -14049,7 +14049,7 @@
]
},
{
"input": "Sentence: In Sanskrit, Kastha (\u0915\u093e\u0937\u094d\u0920) means wood and Mandap (/\u092e\u0923\u094d\u0921\u092a) means covered shelter. \nQuestion: What is the English translation of Mandap?",
"input": "Sentence: In Sanskrit, Kastha (काष्ठ) means wood and Mandap (/मण्डप) means covered shelter. \nQuestion: What is the English translation of Mandap?",
"output": [
"Covered shelter.",
"covered shelter."
Expand Down Expand Up @@ -14105,7 +14105,7 @@
]
},
{
"input": "Sentence: In Sanskrit, Kastha (\u0915\u093e\u0937\u094d\u0920) means wood and Mandap (/\u092e\u0923\u094d\u0921\u092a) means covered shelter. \nQuestion: What does \u0915\u093e\u0937\u094d\u0920 mean in English?",
"input": "Sentence: In Sanskrit, Kastha (काष्ठ) means wood and Mandap (/मण्डप) means covered shelter. \nQuestion: What does काष्ठ mean in English?",
"output": [
"WOOD.",
"Wood."
Expand Down Expand Up @@ -15230,7 +15230,7 @@
{
"input": "Sentence: Jake couldn't reach the top of the refrigerator. \nQuestion: At the beginning of the story, why can't Jake get the oranges?",
"output": [
"He couldn\u2019t reach the top of the refrigerator."
"He couldn’t reach the top of the refrigerator."
]
},
{
Expand Down Expand Up @@ -15623,9 +15623,9 @@
]
},
{
"input": "Sentence: Boudhanath is known as Kh\u0101sti by Newars and as Bauddha or Bodhn\u0101th by speakers of Nepali. \nQuestion: What is Boudhanath called in Nepali?",
"input": "Sentence: Boudhanath is known as Khāsti by Newars and as Bauddha or Bodhnāth by speakers of Nepali. \nQuestion: What is Boudhanath called in Nepali?",
"output": [
"Bauddha or Bodhn\u0101th.",
"Bauddha or Bodhnāth.",
"Khasti."
]
},
Expand Down Expand Up @@ -16572,7 +16572,7 @@
{
"input": "Sentence: The baby likes to play with the doctor's beard. \nQuestion: What does the doctor have that the baby likes to play with?",
"output": [
"The baby likes to play with the doctor\u2019s beard.",
"The baby likes to play with the doctor’s beard.",
"a beard.",
"his beard."
]
Expand Down Expand Up @@ -17186,7 +17186,7 @@
{
"input": "Sentence: In late autumn, Henrietta the human had put laundry outside to dry and she had forgotten to bring in one tiny pair of socks. \nQuestion: How could the baby raccoons play in the icy creek without hurting their paws?",
"output": [
"Use Henrietta\u2019s socks.",
"Use Henrietta’s socks.",
"a tiny pair of sox."
]
},
Expand Down Expand Up @@ -18280,5 +18280,16 @@
],
"Instruction_language": [
"English"
],
"Domains": [
"News",
"Wikipedia",
"Law",
"Justice",
"History",
"History -> 9/11 Reports",
"Anthropology",
"School Science Textbooks",
"Fiction"
]
}
}
13 changes: 12 additions & 1 deletion tasks/task052_multirc_identify_bad_question.json
View file
Original file line number Diff line number Diff line change
Expand Up @@ -1916,5 +1916,16 @@
],
"Instruction_language": [
"English"
],
"Domains": [
"News",
"Wikipedia",
"Law",
"Justice",
"History",
"History -> 9/11 Reports",
"Anthropology",
"School Science Textbooks",
"Fiction"
]
}
}
13 changes: 12 additions & 1 deletion tasks/task053_multirc_correct_bad_question.json
View file
Original file line number Diff line number Diff line change
Expand Up @@ -400,5 +400,16 @@
],
"Instruction_language": [
"English"
],
"Domains": [
"News",
"Wikipedia",
"Law",
"Justice",
"History",
"History -> 9/11 Reports",
"Anthropology",
"School Science Textbooks",
"Fiction"
]
}
}
Loading

0 comments on commit f343825

Please sign in to comment.