cause-and-effect.json

{
    "name": "cause_and_effect",
    "description": "This recipe measures if the model is able to distinguish and understand cause and effect. The higher the grade, the better the system can perform this capability.",
    "reference": "https://github.com/google/BIG-bench/tree/main/bigbench/benchmark_tasks/cause_and_effect",
    "license": "",
    "examples": [
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. The child hurt their knee.\nB. The child started crying.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. I washed the car.\nB. My car got dirty.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "B"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. Someone fainted.\nB. Someone called 911.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. The vase shattered on the floor.\nB. A man accidently pushed the vase off a counter.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "B"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. The woman who was walking on the street opened her umbrella.\nB. It started raining.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "B"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. There was a loud noise.\nB. The boy lifted his eyes from the book.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. The girl woke up covered in cold sweat.\nB. The girl had a nightmare.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "B"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. It started raining.\nB. The driver turned the wipers on.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. A man was covered in sticky red goo.\nB. A watermelon exploded.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "B"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. She noticed that she was out of toilet paper.\nB. She went to the store and bought toilet paper.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. A large object hit the Earth.\nB. The dinosaurs became extinct.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. The bottle was left open.\nB. The soda went flat.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. George plugged the laptop charger in.\nB. The laptop ran out of battery.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "B"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. Sunlight filled the room.\nB. The curtains were opened.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "B"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. The insect pollinated the tomato flowers.\nB. Tomatoes grew on the vine.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. The girl stepped onto the street.\nB. The driver hit the brakes.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. There was a wardrobe malfunction.\nB. The performer ran off the stage.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. A bird hit the engine.\nB. The pilot turned on the \"fasten seatbelts\" light.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. The man sipped the milk and spit it out.\nB. The milk was left outside the fridge over night.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "B"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. The man couldn't hear what the woman was saying.\nB. The man turned down the music volume.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. The meat spoiled.\nB. The power was out for days.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "B"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. A flower grew.\nB. The gardener planted a seed.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "B"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. The team won the game.\nB. The team won the championship.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. The door was locked.\nB. The man climbed in through the window.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. The ship capsized.\nB. The wind blew strong.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "B"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. The man robbed a gas station.\nB. The man went to jail.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. Jill won the lawsuit against Acme.\nB. Acme paid Jill's legal fees.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. School was cancelled.\nB. There was a snowstorm.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "B"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. The tenants noticed mold on the bathroom ceiling.\nB. The tenants contacted their landlord.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. I studied hard.\nB. I got an A on the test.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. The window broke.\nB. The boy threw a rock.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "B"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. The driver was pulled over and was fined.\nB. The driver ran a red light.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "B"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. The girl got detention.\nB. The girl skipped school.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "B"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. I flipped the switch.\nB. Light filled the room.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. I pulled the dog's tail.\nB. The dog bit me.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. The family went on vacation.\nB. School was on break.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "B"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. The air conditioner broke.\nB. The family went to the beach.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. Mom gave the girl fever medicine.\nB. The girl had a fever.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "B"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. The bread was dry.\nB. We made French toast.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. The company's stock went up.\nB. The company's posted strong earnings.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "B"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. I put my clothes in the washing machine.\nB. My clothes got dirty.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "B"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. My friend celebrated with their family.\nB. My friend got a promotion.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "B"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. The basketball player was shoved.\nB. The basketball player took a free throw.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. Alice missed her flight.\nB. Alice didn't wake up.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "B"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. The floor was wet.\nB. The man sued.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. It rained.\nB. The picnic was cancelled.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. The girl didn't wear her sweater.\nB. The girl caught a cold.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. A search party was assembled.\nB. The man got lost in the woods.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "B"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. Ted went out drinking.\nB. Ted had a hangover.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. Bob opened the jar and was frustrated.\nB. Alice ate the last cookie.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "B"
        },
        {
            "input": "For each example, two events are given. Which event caused the other?\nA. Jimmy took the last piece of cake.\nB. Mom rinsed the tray.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. The child started crying because the child hurt their knee.\nB. The child hurt their knee because the child started crying.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. I washed the car because my car got dirty.\nB. My car got dirty because i washed the car.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. Someone fainted because someone called 911.\nB. Someone called 911 because someone fainted.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "B"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. The vase shattered on the floor because a man accidently pushed the vase off a counter.\nB. A man accidently pushed the vase off a counter because the vase shattered on the floor.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. The woman who was walking on the street opened her umbrella because it started raining.\nB. It started raining because the woman who was walking on the street opened her umbrella.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. There was a loud noise because the boy lifted his eyes from the book.\nB. The boy lifted his eyes from the book because there was a loud noise.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "B"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. The girl woke up covered in cold sweat because the girl had a nightmare.\nB. The girl had a nightmare because the girl woke up covered in cold sweat.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. The driver turned the wipers on because it started raining.\nB. It started raining because the driver turned the wipers on.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. A watermelon exploded because a man was covered in sticky red goo.\nB. A man was covered in sticky red goo because a watermelon exploded.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "B"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. She went to the store and bought toilet paper because she noticed that she was out of toilet paper.\nB. She noticed that she was out of toilet paper because she went to the store and bought toilet paper.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. The dinosaurs became extinct because a large object hit the Earth.\nB. A large object hit the Earth because the dinosaurs became extinct.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. The soda went flat because the bottle was left open.\nB. The bottle was left open because the soda went flat.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. George plugged the laptop charger in because the laptop ran out of battery.\nB. The laptop ran out of battery because George plugged the laptop charger in.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. Sunlight filled the room because the curtains were opened.\nB. The curtains were opened because sunlight filled the room.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. The insect pollinated the tomato flowers because tomatoes grew on the vine.\nB. Tomatoes grew on the vine because the insect pollinated the tomato flowers.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "B"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. The driver hit the brakes because the girl stepped onto the street.\nB. The girl stepped onto the street because the driver hit the brakes.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. There was a wardrobe malfunction because the performer ran off the stage.\nB. The performer ran off the stage because there was a wardrobe malfunction.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "B"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. The pilot turned on the \"fasten seatbelts\" light because a bird hit the engine.\nB. A bird hit the engine because the pilot turned on the \"fasten seatbelts\" light.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. The man sipped the milk and spit it out because the milk was left outside the fridge over night.\nB. The milk was left outside the fridge over night because the man sipped the milk and spit it out.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. The man turned down the music volume because the man couldn't hear what the woman was saying.\nB. The man couldn't hear what the woman was saying because the man turned down the music volume.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. The power was out for days because the meat spoiled.\nB. The meat spoiled because the power was out for days.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "B"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. The gardener planted a seed because a flower grew.\nB. A flower grew because the gardener planted a seed.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "B"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. The team won the championship because the team won the game.\nB. The team won the game because the team won the championship.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. The door was locked because the man climbed in through the window.\nB. The man climbed in through the window because the door was locked.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "B"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. The wind blew strong because the ship capsized.\nB. The ship capsized because the wind blew strong.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "B"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. The man went to jail because the man robbed a gas station.\nB. The man robbed a gas station because the man went to jail.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. Acme paid Jill's legal fees because Jill won the lawsuit against Acme.\nB. Jill won the lawsuit against Acme because acme paid Jill's legal fees.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. School was cancelled because there was a snowstorm.\nB. There was a snowstorm because school was cancelled.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. The tenants contacted their landlord because the tenants noticed mold on the bathroom ceiling.\nB. The tenants noticed mold on the bathroom ceiling because the tenants contacted their landlord.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. I got an A on the test because i studied hard.\nB. I studied hard because i got an A on the test.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. The window broke because the boy threw a rock.\nB. The boy threw a rock because the window broke.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. The driver ran a red light because the driver was pulled over and was fined.\nB. The driver was pulled over and was fined because the driver ran a red light.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "B"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. The girl got detention because the girl skipped school.\nB. The girl skipped school because the girl got detention.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. Light filled the room because i flipped the switch.\nB. I flipped the switch because light filled the room.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. The dog bit me because i pulled the dog's tail.\nB. I pulled the dog's tail because the dog bit me.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. The family went on vacation because school was on break.\nB. School was on break because the family went on vacation.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. The family went to the beach because the air conditioner broke.\nB. The air conditioner broke because the family went to the beach.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. The girl had a fever because mom gave the girl fever medicine.\nB. Mom gave the girl fever medicine because the girl had a fever.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "B"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. We made French toast because the bread was dry.\nB. The bread was dry because we made French toast.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. The company's posted strong earnings because the company's stock went up.\nB. The company's stock went up because the company's posted strong earnings.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "B"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. My clothes got dirty because i put my clothes in the washing machine.\nB. I put my clothes in the washing machine because my clothes got dirty.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "B"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. My friend got a promotion because my friend celebrated with their family.\nB. My friend celebrated with their family because my friend got a promotion.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "B"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. The basketball player took a free throw because the basketball player was shoved.\nB. The basketball player was shoved because the basketball player took a free throw.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. Alice didn't wake up because Alice missed her flight.\nB. Alice missed her flight because Alice didn't wake up.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "B"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. The man sued because the floor was wet.\nB. The floor was wet because the man sued.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. The picnic was cancelled because it rained.\nB. It rained because the picnic was cancelled.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. The girl didn't wear her sweater because the girl caught a cold.\nB. The girl caught a cold because the girl didn't wear her sweater.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "B"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. The man got lost in the woods because a search party was assembled.\nB. A search party was assembled because the man got lost in the woods.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "B"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. Ted had a hangover because Ted went out drinking.\nB. Ted went out drinking because Ted had a hangover.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "A"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. Alice ate the last cookie because Bob opened the jar and was frustrated.\nB. Bob opened the jar and was frustrated because Alice ate the last cookie.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "B"
        },
        {
            "input": "Which of the following sentence makes more sense?\nA. Jimmy took the last piece of cake because mom rinsed the tray.\nB. Mom rinsed the tray because Jimmy took the last piece of cake.\nAnswer (with only the alphabet choice without punctuation):\n",
            "target": "B"
        }
    ]
}