forked from FlagOpen/FlagEmbedding
-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathllm_examples.json
1 lines (1 loc) · 13.1 KB
/
llm_examples.json
1
{"mnli_m": [{"input": "Premise: \"The new rights are nice enough\" Hypothesis: \"Everyone really likes the newest benefits \" Does the premise entail the hypothesis? Yes, No, or Maybe?\n", "output": "Maybe"}, {"input": "Premise: \"This site includes a list of all award winners and a searchable database of Government Executive articles.\" Hypothesis: \"The Government Executive articles housed on the website are not able to be searched.\" Does the premise entail the hypothesis? Yes, No, or Maybe?\n", "output": "No"}, {"input": "Premise: \"uh i don't know i i have mixed emotions about him uh sometimes i like him but at the same times i love to see somebody beat him\" Hypothesis: \"I like him for the most part, but would still enjoy seeing someone beat him.\" Does the premise entail the hypothesis? Yes, No, or Maybe?\n", "output": "Yes"}, {"input": "Premise: \"yeah i i think my favorite restaurant is always been the one closest you know the closest as long as it's it meets the minimum criteria you know of good food\" Hypothesis: \"My favorite restaurants are always at least a hundred miles away from my house. \" Does the premise entail the hypothesis? Yes, No, or Maybe?\n", "output": "No"}, {"input": "Premise: \"i don't know um do you do a lot of camping\" Hypothesis: \"I know exactly.\" Does the premise entail the hypothesis? Yes, No, or Maybe?\n", "output": "No"}], "mrpc": [{"input": "Here are two sentences: He said the foodservice pie business doesn 't fit the company 's long-term growth strategy . \" The foodservice pie business does not fit our long-term growth strategy . Do they have the same meaning?\n", "output": "Yes"}, {"input": "Here are two sentences: Magnarelli said Racicot hated the Iraqi regime and looked forward to using his long years of training in the war . His wife said he was \" 100 percent behind George Bush \" and looked forward to using his years of training in the war . Do they have the same meaning?\n", "output": "No"}, {"input": "Here are two sentences: The dollar was at 116.92 yen against the yen , flat on the session , and at 1.2891 against the Swiss franc , also flat . The dollar was at 116.78 yen JPY = , virtually flat on the session , and at 1.2871 against the Swiss franc CHF = , down 0.1 percent . Do they have the same meaning?\n", "output": "No"}, {"input": "Here are two sentences: The AFL-CIO is waiting until October to decide if it will endorse a candidate . The AFL-CIO announced Wednesday that it will decide in October whether to endorse a candidate before the primaries . Do they have the same meaning?\n", "output": "Yes"}, {"input": "Here are two sentences: No dates have been set for the civil or the criminal trial . No dates have been set for the criminal or civil cases , but Shanley has pleaded not guilty . Do they have the same meaning?\n", "output": "No"}], "natural_questions": [{"input": "Question: when was the last time anyone was on the moon? Answer:\n", "output": "14 December 1972 UTC"}, {"input": "Question: who wrote he ain't heavy he's my brother lyrics? Answer:\n", "output": "Bobby Scott"}, {"input": "Question: how many seasons of the bastard executioner are there? Answer:\n", "output": "one"}, {"input": "Question: when did the eagles win last super bowl? Answer:\n", "output": "2017"}, {"input": "Question: who won last year's ncaa women's basketball? Answer:\n", "output": "South Carolina"}], "squad_v1": [{"input": "Please answer a question about the following article about Super Bowl 50: Super Bowl 50 was an American football game to determine the champion of the National Football League (NFL) for the 2015 season. The American Football Conference (AFC) champion Denver Broncos defeated the National Football Conference (NFC) champion Carolina Panthers 24\u201310 to earn their third Super Bowl title. The game was played on February 7, 2016, at Levi's Stadium in the San Francisco Bay Area at Santa Clara, California. As this was the 50th Super Bowl, the league emphasized the \"golden anniversary\" with various gold-themed initiatives, as well as temporarily suspending the tradition of naming each Super Bowl game with Roman numerals (under which the game would have been known as \"Super Bowl L\"), so that the logo could prominently feature the Arabic numerals 50. Which NFL team represented the AFC at Super Bowl 50?\n", "output": "Denver Broncos"}, {"input": "Please answer a question about the following article about Super Bowl 50: Super Bowl 50 was an American football game to determine the champion of the National Football League (NFL) for the 2015 season. The American Football Conference (AFC) champion Denver Broncos defeated the National Football Conference (NFC) champion Carolina Panthers 24\u201310 to earn their third Super Bowl title. The game was played on February 7, 2016, at Levi's Stadium in the San Francisco Bay Area at Santa Clara, California. As this was the 50th Super Bowl, the league emphasized the \"golden anniversary\" with various gold-themed initiatives, as well as temporarily suspending the tradition of naming each Super Bowl game with Roman numerals (under which the game would have been known as \"Super Bowl L\"), so that the logo could prominently feature the Arabic numerals 50. Which NFL team represented the NFC at Super Bowl 50?\n", "output": "Carolina Panthers"}, {"input": "Please answer a question about the following article about Super Bowl 50: Super Bowl 50 was an American football game to determine the champion of the National Football League (NFL) for the 2015 season. The American Football Conference (AFC) champion Denver Broncos defeated the National Football Conference (NFC) champion Carolina Panthers 24\u201310 to earn their third Super Bowl title. The game was played on February 7, 2016, at Levi's Stadium in the San Francisco Bay Area at Santa Clara, California. As this was the 50th Super Bowl, the league emphasized the \"golden anniversary\" with various gold-themed initiatives, as well as temporarily suspending the tradition of naming each Super Bowl game with Roman numerals (under which the game would have been known as \"Super Bowl L\"), so that the logo could prominently feature the Arabic numerals 50. Where did Super Bowl 50 take place?\n", "output": "Santa Clara, California"}, {"input": "Please answer a question about the following article about Super Bowl 50: Super Bowl 50 was an American football game to determine the champion of the National Football League (NFL) for the 2015 season. The American Football Conference (AFC) champion Denver Broncos defeated the National Football Conference (NFC) champion Carolina Panthers 24\u201310 to earn their third Super Bowl title. The game was played on February 7, 2016, at Levi's Stadium in the San Francisco Bay Area at Santa Clara, California. As this was the 50th Super Bowl, the league emphasized the \"golden anniversary\" with various gold-themed initiatives, as well as temporarily suspending the tradition of naming each Super Bowl game with Roman numerals (under which the game would have been known as \"Super Bowl L\"), so that the logo could prominently feature the Arabic numerals 50. Which NFL team won Super Bowl 50?\n", "output": "Denver Broncos"}, {"input": "Please answer a question about the following article about Super Bowl 50: Super Bowl 50 was an American football game to determine the champion of the National Football League (NFL) for the 2015 season. The American Football Conference (AFC) champion Denver Broncos defeated the National Football Conference (NFC) champion Carolina Panthers 24\u201310 to earn their third Super Bowl title. The game was played on February 7, 2016, at Levi's Stadium in the San Francisco Bay Area at Santa Clara, California. As this was the 50th Super Bowl, the league emphasized the \"golden anniversary\" with various gold-themed initiatives, as well as temporarily suspending the tradition of naming each Super Bowl game with Roman numerals (under which the game would have been known as \"Super Bowl L\"), so that the logo could prominently feature the Arabic numerals 50. What color was used to emphasize the 50th anniversary of the Super Bowl?\n", "output": "gold"}], "sst2": [{"input": "Review: \"it 's a charming and often affecting journey . \" Is this movie review sentence negative or positive?\n", "output": "Positive"}, {"input": "Review: \"unflinchingly bleak and desperate \" Is this movie review sentence negative or positive?\n", "output": "Negative"}, {"input": "Review: \"allows us to hope that nolan is poised to embark a major career as a commercial yet inventive filmmaker . \" Is this movie review sentence negative or positive?\n", "output": "Positive"}, {"input": "Review: \"the acting , costumes , music , cinematography and sound are all astounding given the production 's austere locales . \" Is this movie review sentence negative or positive?\n", "output": "Positive"}, {"input": "Review: \"it 's slow -- very , very slow . \" Is this movie review sentence negative or positive?\n", "output": "Negative"}], "winogrande": [{"input": "How does the sentence end? Sarah was a much better surgeon than Maria so\n", "output": "Maria always got the easier cases."}, {"input": "How does the sentence end? Sarah was a much better surgeon than Maria so\n", "output": "Sarah always got the harder cases."}, {"input": "How does the sentence end? They were worried the wine would ruin the bed and the blanket, but the\n", "output": "bed was't ruined."}, {"input": "How does the sentence end? Terry tried to bake the eggplant in the toaster oven but the\n", "output": "eggplant was too big."}, {"input": "How does the sentence end? At night, Jeffrey always stays up later than Hunter to watch TV because\n", "output": "Jeffrey wakes up late."}], "ag_news": [{"input": "\"Fears for T N pension after talks Unions representing workers at Turner Newall say they are 'disappointed' after talks with stricken parent firm Federal Mogul.\" What is this text about? World, Sports, Business, or Technology?\n", "output": "Business"}, {"input": "\"The Race is On: Second Private Team Sets Launch Date for Human Spaceflight (SPACE.com) SPACE.com - TORONTO, Canada -- A second\\team of rocketeers competing for the #36;10 million Ansari X Prize, a contest for\\privately funded suborbital space flight, has officially announced the first\\launch date for its manned rocket.\" What is this text about? World, Sports, Business, or Technology?\n", "output": "Technology"}, {"input": "\"Ky. Company Wins Grant to Study Peptides (AP) AP - A company founded by a chemistry researcher at the University of Louisville won a grant to develop a method of producing better peptides, which are short chains of amino acids, the building blocks of proteins.\" What is this text about? World, Sports, Business, or Technology?\n", "output": "Technology"}, {"input": "\"Prediction Unit Helps Forecast Wildfires (AP) AP - It's barely dawn when Mike Fitzpatrick starts his shift with a blur of colorful maps, figures and endless charts, but already he knows what the day will bring. Lightning will strike in places he expects. Winds will pick up, moist places will dry and flames will roar.\" What is this text about? World, Sports, Business, or Technology?\n", "output": "Technology"}, {"input": "\"Calif. Aims to Limit Farm-Related Smog (AP) AP - Southern California's smog-fighting agency went after emissions of the bovine variety Friday, adopting the nation's first rules to reduce air pollution from dairy cow manure.\" What is this text about? World, Sports, Business, or Technology?\n", "output": "Technology"}], "common_gen": [{"input": "Concepts: field, look, stand. Write a sentence that includes all these words.\n", "output": "The player stood in the field looking at the batter."}, {"input": "Concepts: field, look, stand. Write a sentence that includes all these words.\n", "output": "The coach stands along the field, looking at the goalkeeper."}, {"input": "Concepts: field, look, stand. Write a sentence that includes all these words.\n", "output": "I stood and looked across the field, peacefully."}, {"input": "Concepts: field, look, stand. Write a sentence that includes all these words.\n", "output": "Someone stands, looking around the empty field."}, {"input": "Concepts: kid, room, dance. Write a sentence that includes all these words.\n", "output": "The silly kid loves to dance in her room."}], "hellaswag": [{"input": "What happens next in this paragraph? A man is sitting on a roof. he\n", "output": "starts pulling up roofing on a roof."}, {"input": "What happens next in this paragraph? A lady walks to a barbell. She bends down and grabs the pole. the lady\n", "output": "stands and lifts the weight over her head."}, {"input": "What happens next in this paragraph? Two women in a child are shown in a canoe while a man pulls the canoe while standing in the water, with other individuals visible in the background. the child and a different man\n", "output": "sit in a canoe while the man paddles."}, {"input": "What happens next in this paragraph? A boy is running down a track. the boy\n", "output": "lifts his body above the height of a pole."}, {"input": "What happens next in this paragraph? The boy lifts his body above the height of a pole. The boy lands on his back on to a red mat. the boy\n", "output": "gets up from the mat."}]}