{"plan_idx": 710, "title": "spiced-guava-cake", "question_idx": 710, "steps": ["Preheat oven to 180 C / Gas 4.", "Grease and flour one 23x13cm loaf tin.", "Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.", "In another bowl, mix together guava pulp and juice.", "In another bowl, cream together butter and sugar.", "Add eggs, one at a time.", "Add flour mixture and guava mixture alternately to creamed mixture.", "Pour batter into prepared tin.", "Bake at 180 C / Gas 4 for 30-35 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 5 happen after Step 4?", "why_question": "Why is it not necessary for Step 5 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced-guava-cake\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Grease and flour one 23x13cm loaf tin.\n3. Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.\n4. In another bowl, mix together guava pulp and juice.\n5. In another bowl, cream together butter and sugar.\n6. Add eggs, one at a time.\n7. Add flour mixture and guava mixture alternately to creamed mixture.\n8. Pour batter into prepared tin.\n9. Bake at 180 C / Gas 4 for 30-35 minutes.\n\n\nMust Step 5 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "No", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 711, "title": "chocolate-chocolate-cake", "question_idx": 711, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why is it not necessary for Step 6 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 6 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 712, "title": "chicken-prawn-and-rice-soup", "question_idx": 712, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 10], "binary_question": "Must Step 11 happen after Step 4?", "why_question": "Why is it not necessary for Step 11 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\nMust Step 11 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 713, "title": "green-tofu-curry", "question_idx": 713, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why is it not necessary for Step 5 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\nMust Step 5 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 714, "title": "very-vanilla-ry-cheesecake", "question_idx": 714, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 7], "binary_question": "Must Step 8 happen after Step 5?", "why_question": "Why is it not necessary for Step 8 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\nMust Step 8 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes", "model_answer": "Yes."}
{"plan_idx": 715, "title": "smoked-salmon-and-grapefruit-salad", "question_idx": 715, "steps": ["Top and tail the grapefruits.", "Slice the skin off the grapefruit over a bowl.", "This is to catch any juices.", "Using a small knife, segment the grapefruits over the juice bowl.", "Arrange the lamb's lettuce onto each serving plate or a large salad bowl.", "Top with grapefruit segments and smoked salmon.", "Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.", "Pour over the salad and serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 5 happen after Step 2?", "why_question": "Why is it not necessary for Step 5 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: smoked-salmon-and-grapefruit-salad\n\nProcedure:\n1. Top and tail the grapefruits.\n2. Slice the skin off the grapefruit over a bowl.\n3. This is to catch any juices.\n4. Using a small knife, segment the grapefruits over the juice bowl.\n5. Arrange the lamb's lettuce onto each serving plate or a large salad bowl.\n6. Top with grapefruit segments and smoked salmon.\n7. Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.\n8. Pour over the salad and serve.\n\n\nMust Step 5 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 716, "title": "fusilli-and-meatballs", "question_idx": 716, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 15], "binary_question": "Must Step 16 happen after Step 6?", "why_question": "Why is it not necessary for Step 16 to happen after Step 6?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 16 happen after Step 6? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 717, "title": "spanish-rabbit-stew", "question_idx": 717, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 8], "binary_question": "Must Step 9 happen after Step 3?", "why_question": "Why is it not necessary for Step 9 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\nMust Step 9 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 718, "title": "green-tofu-curry", "question_idx": 718, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 8], "binary_question": "Must Step 9 happen after Step 1?", "why_question": "Why is it not necessary for Step 9 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\nMust Step 9 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 719, "title": "tangy-gammon-in-cider", "question_idx": 719, "steps": ["Preheat the oven to 200 degrees /gas mark 6.", "Start by piercing each tomato once and covering with boiling water to loosen the skins.", "Drain the onions and chop each one in half.", "Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.", "Put the onions, tomatoes and apples into a casserole dish.", "Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.", "Place in the dish and repeat with the other gammon steaks.", "Pour cider over the steaks, cover the top with a lid or tin foil.", "Cook for 1 hour."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 7 happen after Step 1?", "why_question": "Why is it not necessary for Step 7 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: tangy-gammon-in-cider\n\nProcedure:\n1. Preheat the oven to 200 degrees /gas mark 6.\n2. Start by piercing each tomato once and covering with boiling water to loosen the skins.\n3. Drain the onions and chop each one in half.\n4. Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.\n5. Put the onions, tomatoes and apples into a casserole dish.\n6. Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.\n7. Place in the dish and repeat with the other gammon steaks.\n8. Pour cider over the steaks, cover the top with a lid or tin foil.\n9. Cook for 1 hour.\n\n\nMust Step 7 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 720, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 720, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [11, 13], "binary_question": "Must Step 14 happen after Step 12?", "why_question": "Why is it not necessary for Step 14 to happen after Step 12?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\nMust Step 14 happen after Step 12? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 721, "title": "tortellini-fritto-with-almond-butter", "question_idx": 721, "steps": ["Bring a saucepan of water to the boil.", "Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.", "In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.", "If you slightly undercooked your tortellini then it's less likely to stick to the pan.", "Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.", "Continue to gently fry and stir the tortellini until golden brown.", "Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.", "Enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 7], "binary_question": "Must Step 8 happen after Step 7?", "why_question": "Why is it not necessary for Step 8 to happen after Step 7?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: tortellini-fritto-with-almond-butter\n\nProcedure:\n1. Bring a saucepan of water to the boil.\n2. Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.\n3. In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.\n4. If you slightly undercooked your tortellini then it's less likely to stick to the pan.\n5. Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.\n6. Continue to gently fry and stir the tortellini until golden brown.\n7. Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.\n8. Enjoy!\n\n\nMust Step 8 happen after Step 7? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes", "model_answer": "Yes."}
{"plan_idx": 722, "title": "almond and apple cake", "question_idx": 722, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why is it not necessary for Step 2 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\nMust Step 2 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes", "trial_1_answer": "Yes", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 723, "title": "green-tofu-curry", "question_idx": 723, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 10], "binary_question": "Must Step 11 happen after Step 7?", "why_question": "Why is it not necessary for Step 11 to happen after Step 7?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\nMust Step 11 happen after Step 7? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 724, "title": "brown sugar shortbread", "question_idx": 724, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 5 happen after Step 4?", "why_question": "Why is it not necessary for Step 5 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\nMust Step 5 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "Yes", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 725, "title": "chicken-prawn-and-rice-soup", "question_idx": 725, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 9], "binary_question": "Must Step 10 happen after Step 6?", "why_question": "Why is it not necessary for Step 10 to happen after Step 6?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\nMust Step 10 happen after Step 6? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 726, "title": "chicken and vegetable pie", "question_idx": 726, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 10], "binary_question": "Must Step 11 happen after Step 5?", "why_question": "Why is it not necessary for Step 11 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\nMust Step 11 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes", "model_answer": "Yes."}
{"plan_idx": 727, "title": "fusilli-and-meatballs", "question_idx": 727, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 11], "binary_question": "Must Step 12 happen after Step 5?", "why_question": "Why is it not necessary for Step 12 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 12 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 728, "title": "fusilli-and-meatballs", "question_idx": 728, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [12, 13], "binary_question": "Must Step 14 happen after Step 13?", "why_question": "Why is it not necessary for Step 14 to happen after Step 13?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 14 happen after Step 13? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 729, "title": "chicken and vegetable pie", "question_idx": 729, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why is it not necessary for Step 6 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\nMust Step 6 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 730, "title": "feta-and-sundried-tomato-spinach-rolls", "question_idx": 730, "steps": ["Preheat grill.", "Mix together cream cheese, feta, sundried tomatoes, basil and garlic.", "Stir until creamy, with no lumps.", "Blanch the spinach leaves.", "Wrap a dollop of cheese mix in each spinach leaf.", "Brush with olive oil.", "Sprinkle almonds on the top or alternately roll them in the almonds", "Grill spinach rolls until slightly crispy on top.", "Let cool for 10 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 7 happen after Step 1?", "why_question": "Why is it not necessary for Step 7 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: feta-and-sundried-tomato-spinach-rolls\n\nProcedure:\n1. Preheat grill.\n2. Mix together cream cheese, feta, sundried tomatoes, basil and garlic.\n3. Stir until creamy, with no lumps.\n4. Blanch the spinach leaves.\n5. Wrap a dollop of cheese mix in each spinach leaf.\n6. Brush with olive oil.\n7. Sprinkle almonds on the top or alternately roll them in the almonds\n8. Grill spinach rolls until slightly crispy on top.\n9. Let cool for 10 minutes.\n\n\nMust Step 7 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 731, "title": "green-tofu-curry", "question_idx": 731, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 10], "binary_question": "Must Step 11 happen after Step 6?", "why_question": "Why is it not necessary for Step 11 to happen after Step 6?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\nMust Step 11 happen after Step 6? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 732, "title": "chocolate-chocolate-cake", "question_idx": 732, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 10], "binary_question": "Must Step 11 happen after Step 3?", "why_question": "Why is it not necessary for Step 11 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 11 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 733, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 733, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 12], "binary_question": "Must Step 13 happen after Step 2?", "why_question": "Why is it not necessary for Step 13 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\nMust Step 13 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 734, "title": "spanish-rabbit-stew", "question_idx": 734, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 6], "binary_question": "Must Step 7 happen after Step 5?", "why_question": "Why is it not necessary for Step 7 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\nMust Step 7 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes", "trial_2_answer": "Yes", "model_answer": "Yes."}
{"plan_idx": 735, "title": "spiced-guava-cake", "question_idx": 735, "steps": ["Preheat oven to 180 C / Gas 4.", "Grease and flour one 23x13cm loaf tin.", "Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.", "In another bowl, mix together guava pulp and juice.", "In another bowl, cream together butter and sugar.", "Add eggs, one at a time.", "Add flour mixture and guava mixture alternately to creamed mixture.", "Pour batter into prepared tin.", "Bake at 180 C / Gas 4 for 30-35 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why is it not necessary for Step 5 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced-guava-cake\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Grease and flour one 23x13cm loaf tin.\n3. Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.\n4. In another bowl, mix together guava pulp and juice.\n5. In another bowl, cream together butter and sugar.\n6. Add eggs, one at a time.\n7. Add flour mixture and guava mixture alternately to creamed mixture.\n8. Pour batter into prepared tin.\n9. Bake at 180 C / Gas 4 for 30-35 minutes.\n\n\nMust Step 5 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 736, "title": "fusilli-and-meatballs", "question_idx": 736, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 8], "binary_question": "Must Step 9 happen after Step 3?", "why_question": "Why is it not necessary for Step 9 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 9 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "Yes", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 737, "title": "spanish-rabbit-stew", "question_idx": 737, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 7 happen after Step 3?", "why_question": "Why is it not necessary for Step 7 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\nMust Step 7 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "Yes", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 738, "title": "fusilli-and-meatballs", "question_idx": 738, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 6 happen after Step 3?", "why_question": "Why is it not necessary for Step 6 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 6 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 739, "title": "brown sugar shortbread", "question_idx": 739, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 5 happen after Step 3?", "why_question": "Why is it not necessary for Step 5 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\nMust Step 5 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 740, "title": "fusilli-and-meatballs", "question_idx": 740, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why is it not necessary for Step 6 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 6 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 741, "title": "spicy-tomato-anchovy-pasta", "question_idx": 741, "steps": ["Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;", "cook until lightly browned.", "Add anchovies and water, cover and simmer for 4 to 5 minutes.", "Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.", "While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.", "Add linguine and cook until al dente, about 7 to 8 minutes;", "drain.", "Toss with anchovy mixture and chilli flakes.", "If desired, season with black pepper.", "Serve immediately."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 7 happen after Step 3?", "why_question": "Why is it not necessary for Step 7 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spicy-tomato-anchovy-pasta\n\nProcedure:\n1. Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;\n2. cook until lightly browned.\n3. Add anchovies and water, cover and simmer for 4 to 5 minutes.\n4. Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.\n5. While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.\n6. Add linguine and cook until al dente, about 7 to 8 minutes;\n7. drain.\n8. Toss with anchovy mixture and chilli flakes.\n9. If desired, season with black pepper.\n10. Serve immediately.\n\n\nMust Step 7 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 742, "title": "curried bbq mussels", "question_idx": 742, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 7 happen after Step 6?", "why_question": "Why is it not necessary for Step 7 to happen after Step 6?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\nMust Step 7 happen after Step 6? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes", "trial_2_answer": "Yes", "model_answer": "Yes."}
{"plan_idx": 743, "title": "chocolate-chocolate-cake", "question_idx": 743, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 13], "binary_question": "Must Step 14 happen after Step 1?", "why_question": "Why is it not necessary for Step 14 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 14 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 744, "title": "green-tofu-curry", "question_idx": 744, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 7 happen after Step 3?", "why_question": "Why is it not necessary for Step 7 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\nMust Step 7 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 745, "title": "smoked-salmon-and-grapefruit-salad", "question_idx": 745, "steps": ["Top and tail the grapefruits.", "Slice the skin off the grapefruit over a bowl.", "This is to catch any juices.", "Using a small knife, segment the grapefruits over the juice bowl.", "Arrange the lamb's lettuce onto each serving plate or a large salad bowl.", "Top with grapefruit segments and smoked salmon.", "Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.", "Pour over the salad and serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why is it not necessary for Step 5 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: smoked-salmon-and-grapefruit-salad\n\nProcedure:\n1. Top and tail the grapefruits.\n2. Slice the skin off the grapefruit over a bowl.\n3. This is to catch any juices.\n4. Using a small knife, segment the grapefruits over the juice bowl.\n5. Arrange the lamb's lettuce onto each serving plate or a large salad bowl.\n6. Top with grapefruit segments and smoked salmon.\n7. Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.\n8. Pour over the salad and serve.\n\n\nMust Step 5 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 746, "title": "chicken-prawn-and-rice-soup", "question_idx": 746, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [8, 10], "binary_question": "Must Step 11 happen after Step 9?", "why_question": "Why is it not necessary for Step 11 to happen after Step 9?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\nMust Step 11 happen after Step 9? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 747, "title": "chocolate-chocolate-cake", "question_idx": 747, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why is it not necessary for Step 6 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 6 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 748, "title": "almond and apple cake", "question_idx": 748, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 7], "binary_question": "Must Step 8 happen after Step 3?", "why_question": "Why is it not necessary for Step 8 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\nMust Step 8 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 749, "title": "cranachan", "question_idx": 749, "steps": ["Preheat the oven to 180 C / Gas mark 4.", "Spread oats out in a thin layer on a baking tray.", "Toast in the oven for about 10 minutes, or until lightly browned.", "Set aside to cool.", "Remove them from the tray for faster cooling.", "In a medium bowl, whip the cream to firm peaks.", "Gently fold in the icing sugar, vanilla and toasted oats.", "Spoon into 4 serving bowls, and top with fresh berries.", "For an extra touch, drizzle some whisky over each serving.", "Garnish with a mint leaf."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 6 happen after Step 5?", "why_question": "Why is it not necessary for Step 6 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: cranachan\n\nProcedure:\n1. Preheat the oven to 180 C / Gas mark 4.\n2. Spread oats out in a thin layer on a baking tray.\n3. Toast in the oven for about 10 minutes, or until lightly browned.\n4. Set aside to cool.\n5. Remove them from the tray for faster cooling.\n6. In a medium bowl, whip the cream to firm peaks.\n7. Gently fold in the icing sugar, vanilla and toasted oats.\n8. Spoon into 4 serving bowls, and top with fresh berries.\n9. For an extra touch, drizzle some whisky over each serving.\n10. Garnish with a mint leaf.\n\n\nMust Step 6 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 750, "title": "fusilli-and-meatballs", "question_idx": 750, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 5 happen after Step 3?", "why_question": "Why is it not necessary for Step 5 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 5 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 751, "title": "fusilli-and-meatballs", "question_idx": 751, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 7 happen after Step 2?", "why_question": "Why is it not necessary for Step 7 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 7 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 752, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 752, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [8, 10], "binary_question": "Must Step 11 happen after Step 9?", "why_question": "Why is it not necessary for Step 11 to happen after Step 9?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\nMust Step 11 happen after Step 9? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 753, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 753, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 10], "binary_question": "Must Step 11 happen after Step 4?", "why_question": "Why is it not necessary for Step 11 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\nMust Step 11 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 754, "title": "fusilli-and-meatballs", "question_idx": 754, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 9], "binary_question": "Must Step 10 happen after Step 3?", "why_question": "Why is it not necessary for Step 10 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 10 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 755, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 755, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why is it not necessary for Step 5 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\nMust Step 5 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 756, "title": "cloud-bread", "question_idx": 756, "steps": ["Preheat oven to 150 C / Gas mark 2.", "Line a baking tray with baking paper.", "Mix cream cheese and egg yolks together until smooth.", "Place egg whites and baking powder in a glass, metal, or ceramic bowl;", "beat together until stiff peaks form.", "Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.", "Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.", "Bake in the preheated oven until golden brown, 17 to 20 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 5 happen after Step 2?", "why_question": "Why is it not necessary for Step 5 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: cloud-bread\n\nProcedure:\n1. Preheat oven to 150 C / Gas mark 2.\n2. Line a baking tray with baking paper.\n3. Mix cream cheese and egg yolks together until smooth.\n4. Place egg whites and baking powder in a glass, metal, or ceramic bowl;\n5. beat together until stiff peaks form.\n6. Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.\n7. Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.\n8. Bake in the preheated oven until golden brown, 17 to 20 minutes.\n\n\nMust Step 5 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 757, "title": "curried bbq mussels", "question_idx": 757, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 6], "binary_question": "Must Step 7 happen after Step 4?", "why_question": "Why is it not necessary for Step 7 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\nMust Step 7 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 758, "title": "vegetable-terrine", "question_idx": 758, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 6 happen after Step 3?", "why_question": "Why is it not necessary for Step 6 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\nMust Step 6 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 759, "title": "chicken and vegetable pie", "question_idx": 759, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 10], "binary_question": "Must Step 11 happen after Step 1?", "why_question": "Why is it not necessary for Step 11 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\nMust Step 11 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 760, "title": "chocolate-chocolate-cake", "question_idx": 760, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 10], "binary_question": "Must Step 11 happen after Step 5?", "why_question": "Why is it not necessary for Step 11 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 11 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 761, "title": "chicken and vegetable pie", "question_idx": 761, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 7 happen after Step 1?", "why_question": "Why is it not necessary for Step 7 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\nMust Step 7 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 762, "title": "almond and apple cake", "question_idx": 762, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 5 happen after Step 2?", "why_question": "Why is it not necessary for Step 5 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\nMust Step 5 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 763, "title": "almond and apple cake", "question_idx": 763, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 9], "binary_question": "Must Step 10 happen after Step 7?", "why_question": "Why is it not necessary for Step 10 to happen after Step 7?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\nMust Step 10 happen after Step 7? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 764, "title": "lightly spiced tomato and red lentil soup", "question_idx": 764, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 7], "binary_question": "Must Step 8 happen after Step 7?", "why_question": "Why is it not necessary for Step 8 to happen after Step 7?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\nMust Step 8 happen after Step 7? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 765, "title": "chocolate-chocolate-cake", "question_idx": 765, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 7 happen after Step 3?", "why_question": "Why is it not necessary for Step 7 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 7 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 766, "title": "curried bbq mussels", "question_idx": 766, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why is it not necessary for Step 3 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\nMust Step 3 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "No", "model_answer": "No."}
{"plan_idx": 767, "title": "spicy-tomato-anchovy-pasta", "question_idx": 767, "steps": ["Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;", "cook until lightly browned.", "Add anchovies and water, cover and simmer for 4 to 5 minutes.", "Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.", "While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.", "Add linguine and cook until al dente, about 7 to 8 minutes;", "drain.", "Toss with anchovy mixture and chilli flakes.", "If desired, season with black pepper.", "Serve immediately."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 5], "binary_question": "Must Step 6 happen after Step 4?", "why_question": "Why is it not necessary for Step 6 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spicy-tomato-anchovy-pasta\n\nProcedure:\n1. Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;\n2. cook until lightly browned.\n3. Add anchovies and water, cover and simmer for 4 to 5 minutes.\n4. Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.\n5. While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.\n6. Add linguine and cook until al dente, about 7 to 8 minutes;\n7. drain.\n8. Toss with anchovy mixture and chilli flakes.\n9. If desired, season with black pepper.\n10. Serve immediately.\n\n\nMust Step 6 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "No", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 768, "title": "chocolate-chocolate-cake", "question_idx": 768, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 14], "binary_question": "Must Step 15 happen after Step 2?", "why_question": "Why is it not necessary for Step 15 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 15 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 769, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 769, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [10, 13], "binary_question": "Must Step 14 happen after Step 11?", "why_question": "Why is it not necessary for Step 14 to happen after Step 11?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\nMust Step 14 happen after Step 11? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 770, "title": "smoked-salmon-and-grapefruit-salad", "question_idx": 770, "steps": ["Top and tail the grapefruits.", "Slice the skin off the grapefruit over a bowl.", "This is to catch any juices.", "Using a small knife, segment the grapefruits over the juice bowl.", "Arrange the lamb's lettuce onto each serving plate or a large salad bowl.", "Top with grapefruit segments and smoked salmon.", "Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.", "Pour over the salad and serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why is it not necessary for Step 3 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: smoked-salmon-and-grapefruit-salad\n\nProcedure:\n1. Top and tail the grapefruits.\n2. Slice the skin off the grapefruit over a bowl.\n3. This is to catch any juices.\n4. Using a small knife, segment the grapefruits over the juice bowl.\n5. Arrange the lamb's lettuce onto each serving plate or a large salad bowl.\n6. Top with grapefruit segments and smoked salmon.\n7. Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.\n8. Pour over the salad and serve.\n\n\nMust Step 3 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 771, "title": "chocolate-chocolate-cake", "question_idx": 771, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why is it not necessary for Step 4 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 4 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 772, "title": "spicy-tomato-anchovy-pasta", "question_idx": 772, "steps": ["Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;", "cook until lightly browned.", "Add anchovies and water, cover and simmer for 4 to 5 minutes.", "Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.", "While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.", "Add linguine and cook until al dente, about 7 to 8 minutes;", "drain.", "Toss with anchovy mixture and chilli flakes.", "If desired, season with black pepper.", "Serve immediately."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 7 happen after Step 2?", "why_question": "Why is it not necessary for Step 7 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spicy-tomato-anchovy-pasta\n\nProcedure:\n1. Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;\n2. cook until lightly browned.\n3. Add anchovies and water, cover and simmer for 4 to 5 minutes.\n4. Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.\n5. While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.\n6. Add linguine and cook until al dente, about 7 to 8 minutes;\n7. drain.\n8. Toss with anchovy mixture and chilli flakes.\n9. If desired, season with black pepper.\n10. Serve immediately.\n\n\nMust Step 7 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 773, "title": "tortellini-fritto-with-almond-butter", "question_idx": 773, "steps": ["Bring a saucepan of water to the boil.", "Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.", "In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.", "If you slightly undercooked your tortellini then it's less likely to stick to the pan.", "Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.", "Continue to gently fry and stir the tortellini until golden brown.", "Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.", "Enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why is it not necessary for Step 4 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: tortellini-fritto-with-almond-butter\n\nProcedure:\n1. Bring a saucepan of water to the boil.\n2. Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.\n3. In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.\n4. If you slightly undercooked your tortellini then it's less likely to stick to the pan.\n5. Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.\n6. Continue to gently fry and stir the tortellini until golden brown.\n7. Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.\n8. Enjoy!\n\n\nMust Step 4 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 774, "title": "fusilli-and-meatballs", "question_idx": 774, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why is it not necessary for Step 6 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 6 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 775, "title": "chocolate-chocolate-cake", "question_idx": 775, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 7], "binary_question": "Must Step 8 happen after Step 1?", "why_question": "Why is it not necessary for Step 8 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 8 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 776, "title": "vegetable-terrine", "question_idx": 776, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 4 happen after Step 3?", "why_question": "Why is it not necessary for Step 4 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\nMust Step 4 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 777, "title": "spiced-pumpkin-teabread", "question_idx": 777, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 5], "binary_question": "Must Step 6 happen after Step 4?", "why_question": "Why is it not necessary for Step 6 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\nMust Step 6 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 778, "title": "chicory-and-roquefort-salad", "question_idx": 778, "steps": ["In a bowl, toss chicory, Roquefort and pecan nuts together.", "Make the dressing by mixing together cream cheese, yoghurt and salt and pepper.", "Drizzle over salad."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why is it not necessary for Step 2 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicory-and-roquefort-salad\n\nProcedure:\n1. In a bowl, toss chicory, Roquefort and pecan nuts together.\n2. Make the dressing by mixing together cream cheese, yoghurt and salt and pepper.\n3. Drizzle over salad.\n\n\nMust Step 2 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 779, "title": "spiced-guava-cake", "question_idx": 779, "steps": ["Preheat oven to 180 C / Gas 4.", "Grease and flour one 23x13cm loaf tin.", "Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.", "In another bowl, mix together guava pulp and juice.", "In another bowl, cream together butter and sugar.", "Add eggs, one at a time.", "Add flour mixture and guava mixture alternately to creamed mixture.", "Pour batter into prepared tin.", "Bake at 180 C / Gas 4 for 30-35 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why is it not necessary for Step 6 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced-guava-cake\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Grease and flour one 23x13cm loaf tin.\n3. Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.\n4. In another bowl, mix together guava pulp and juice.\n5. In another bowl, cream together butter and sugar.\n6. Add eggs, one at a time.\n7. Add flour mixture and guava mixture alternately to creamed mixture.\n8. Pour batter into prepared tin.\n9. Bake at 180 C / Gas 4 for 30-35 minutes.\n\n\nMust Step 6 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 780, "title": "spiced-pumpkin-teabread", "question_idx": 780, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why is it not necessary for Step 6 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\nMust Step 6 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 781, "title": "chocolate-pancake-batter", "question_idx": 781, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why is it not necessary for Step 5 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\nMust Step 5 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 782, "title": "chocolate-pancake-batter", "question_idx": 782, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 5 happen after Step 2?", "why_question": "Why is it not necessary for Step 5 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\nMust Step 5 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 783, "title": "spiced butternut squash soup", "question_idx": 783, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 9], "binary_question": "Must Step 10 happen after Step 5?", "why_question": "Why is it not necessary for Step 10 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\nMust Step 10 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 784, "title": "fusilli-and-meatballs", "question_idx": 784, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 14], "binary_question": "Must Step 15 happen after Step 6?", "why_question": "Why is it not necessary for Step 15 to happen after Step 6?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 15 happen after Step 6? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 785, "title": "fusilli-and-meatballs", "question_idx": 785, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [12, 18], "binary_question": "Must Step 19 happen after Step 13?", "why_question": "Why is it not necessary for Step 19 to happen after Step 13?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 19 happen after Step 13? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 786, "title": "green-tofu-curry", "question_idx": 786, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 8], "binary_question": "Must Step 9 happen after Step 6?", "why_question": "Why is it not necessary for Step 9 to happen after Step 6?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\nMust Step 9 happen after Step 6? Select between yes or no\n\n", "trial_0_answer": "No", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 787, "title": "spiced-pumpkin-teabread", "question_idx": 787, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 8], "binary_question": "Must Step 9 happen after Step 1?", "why_question": "Why is it not necessary for Step 9 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\nMust Step 9 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 788, "title": "chocolate-chocolate-cake", "question_idx": 788, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 7 happen after Step 1?", "why_question": "Why is it not necessary for Step 7 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 7 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 789, "title": "chicken and vegetable pie", "question_idx": 789, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 7 happen after Step 3?", "why_question": "Why is it not necessary for Step 7 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\nMust Step 7 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "Yes", "trial_1_answer": "Yes", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 790, "title": "best-ever-margarita", "question_idx": 790, "steps": ["Rim 2 margarita glasses with salt if desired and fill with ice.", "Pour the tequila, lime cordial, triple sec and lemon-lime soft drink into a cocktail shaker filled with ice.", "Hold your hand firmly over over the top of the shaker so the top doesn't pop off from the fizzy soft drink and shake vigorously.", "Pour into prepared margarita glasses and serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why is it not necessary for Step 3 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: best-ever-margarita\n\nProcedure:\n1. Rim 2 margarita glasses with salt if desired and fill with ice.\n2. Pour the tequila, lime cordial, triple sec and lemon-lime soft drink into a cocktail shaker filled with ice.\n3. Hold your hand firmly over over the top of the shaker so the top doesn't pop off from the fizzy soft drink and shake vigorously.\n4. Pour into prepared margarita glasses and serve.\n\n\nMust Step 3 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 791, "title": "tangy-gammon-in-cider", "question_idx": 791, "steps": ["Preheat the oven to 200 degrees /gas mark 6.", "Start by piercing each tomato once and covering with boiling water to loosen the skins.", "Drain the onions and chop each one in half.", "Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.", "Put the onions, tomatoes and apples into a casserole dish.", "Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.", "Place in the dish and repeat with the other gammon steaks.", "Pour cider over the steaks, cover the top with a lid or tin foil.", "Cook for 1 hour."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 7], "binary_question": "Must Step 8 happen after Step 1?", "why_question": "Why is it not necessary for Step 8 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: tangy-gammon-in-cider\n\nProcedure:\n1. Preheat the oven to 200 degrees /gas mark 6.\n2. Start by piercing each tomato once and covering with boiling water to loosen the skins.\n3. Drain the onions and chop each one in half.\n4. Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.\n5. Put the onions, tomatoes and apples into a casserole dish.\n6. Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.\n7. Place in the dish and repeat with the other gammon steaks.\n8. Pour cider over the steaks, cover the top with a lid or tin foil.\n9. Cook for 1 hour.\n\n\nMust Step 8 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 792, "title": "almond and apple cake", "question_idx": 792, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 9], "binary_question": "Must Step 10 happen after Step 4?", "why_question": "Why is it not necessary for Step 10 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\nMust Step 10 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 793, "title": "simple-basic-cupcakes", "question_idx": 793, "steps": ["Preheat oven to 180 C / Gas 4.", "Beat butter and sugar together until light and fluffy.", "Add the eggs, one at a time, beating after each addition.", "If the batter is too thick, stir in some milk.", "Gradually add the flour, mixing well each time until evenly mixed.", "Spoon tablespoons of batter into a greased muffin tin.", "Bake in preheated oven for 15-20 minutes.", "The cake is done when a skewer inserted to the cake comes out clean.", "Let rest for fives minutes, then allow to cool fully on a wire rack.", "Decorate, if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why is it not necessary for Step 2 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: simple-basic-cupcakes\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Beat butter and sugar together until light and fluffy.\n3. Add the eggs, one at a time, beating after each addition.\n4. If the batter is too thick, stir in some milk.\n5. Gradually add the flour, mixing well each time until evenly mixed.\n6. Spoon tablespoons of batter into a greased muffin tin.\n7. Bake in preheated oven for 15-20 minutes.\n8. The cake is done when a skewer inserted to the cake comes out clean.\n9. Let rest for fives minutes, then allow to cool fully on a wire rack.\n10. Decorate, if desired.\n\n\nMust Step 2 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 794, "title": "no-sugar-rock-cakes", "question_idx": 794, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why is it not necessary for Step 6 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\nMust Step 6 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 795, "title": "chocolate-chocolate-cake", "question_idx": 795, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 6], "binary_question": "Must Step 7 happen after Step 5?", "why_question": "Why is it not necessary for Step 7 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 7 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 796, "title": "green-tofu-curry", "question_idx": 796, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 10], "binary_question": "Must Step 11 happen after Step 8?", "why_question": "Why is it not necessary for Step 11 to happen after Step 8?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\nMust Step 11 happen after Step 8? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 797, "title": "chocolate-chocolate-cake", "question_idx": 797, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 13], "binary_question": "Must Step 14 happen after Step 4?", "why_question": "Why is it not necessary for Step 14 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 14 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 798, "title": "fusilli-and-meatballs", "question_idx": 798, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 9], "binary_question": "Must Step 10 happen after Step 1?", "why_question": "Why is it not necessary for Step 10 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 10 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 799, "title": "curried bbq mussels", "question_idx": 799, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why is it not necessary for Step 2 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\nMust Step 2 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 800, "title": "almond and apple cake", "question_idx": 800, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [8, 9], "binary_question": "Must Step 10 happen after Step 9?", "why_question": "Why is it not necessary for Step 10 to happen after Step 9?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\nMust Step 10 happen after Step 9? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 801, "title": "chocolate-chocolate-cake", "question_idx": 801, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 8], "binary_question": "Must Step 9 happen after Step 5?", "why_question": "Why is it not necessary for Step 9 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 9 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 802, "title": "chocolate-chocolate-cake", "question_idx": 802, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why is it not necessary for Step 3 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 3 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 803, "title": "chicken and vegetable pie", "question_idx": 803, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 5 happen after Step 2?", "why_question": "Why is it not necessary for Step 5 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\nMust Step 5 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 804, "title": "fusilli-and-meatballs", "question_idx": 804, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 13], "binary_question": "Must Step 14 happen after Step 2?", "why_question": "Why is it not necessary for Step 14 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 14 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 805, "title": "warm-puy-lentil-and-tomato-salad", "question_idx": 805, "steps": ["Bring a large pan of water to the boil;", "add lentils and cook over low heat for 30 minutes.", "Put tomatoes in a small bowl and season with salt.", "Set aside for 15 minutes.", "Drain lentils and tomatoes and mix together.", "Distribute mixture evenly in 6 individual bowls or ramekins, sprinkle with chopped parsley and serve warm or chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why is it not necessary for Step 3 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: warm-puy-lentil-and-tomato-salad\n\nProcedure:\n1. Bring a large pan of water to the boil;\n2. add lentils and cook over low heat for 30 minutes.\n3. Put tomatoes in a small bowl and season with salt.\n4. Set aside for 15 minutes.\n5. Drain lentils and tomatoes and mix together.\n6. Distribute mixture evenly in 6 individual bowls or ramekins, sprinkle with chopped parsley and serve warm or chilled.\n\n\nMust Step 3 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 806, "title": "spiced butternut squash soup", "question_idx": 806, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 7], "binary_question": "Must Step 8 happen after Step 2?", "why_question": "Why is it not necessary for Step 8 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\nMust Step 8 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 807, "title": "curried bbq mussels", "question_idx": 807, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why is it not necessary for Step 6 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\nMust Step 6 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No", "trial_2_answer": "No", "model_answer": "No."}
{"plan_idx": 808, "title": "very-vanilla-ry-cheesecake", "question_idx": 808, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 9], "binary_question": "Must Step 10 happen after Step 4?", "why_question": "Why is it not necessary for Step 10 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\nMust Step 10 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 809, "title": "spiced-pumpkin-teabread", "question_idx": 809, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 5 happen after Step 2?", "why_question": "Why is it not necessary for Step 5 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\nMust Step 5 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No", "trial_1_answer": "No", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 810, "title": "fusilli-and-meatballs", "question_idx": 810, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 8], "binary_question": "Must Step 9 happen after Step 4?", "why_question": "Why is it not necessary for Step 9 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 9 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 811, "title": "chicken and vegetable pie", "question_idx": 811, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 8], "binary_question": "Must Step 9 happen after Step 4?", "why_question": "Why is it not necessary for Step 9 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\nMust Step 9 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 812, "title": "chocolate-chocolate-cake", "question_idx": 812, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [12, 14], "binary_question": "Must Step 15 happen after Step 13?", "why_question": "Why is it not necessary for Step 15 to happen after Step 13?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 15 happen after Step 13? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 813, "title": "chocolate-chocolate-cake", "question_idx": 813, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 18], "binary_question": "Must Step 19 happen after Step 7?", "why_question": "Why is it not necessary for Step 19 to happen after Step 7?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 19 happen after Step 7? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 814, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 814, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 6], "binary_question": "Must Step 7 happen after Step 5?", "why_question": "Why is it not necessary for Step 7 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\nMust Step 7 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No", "model_answer": "No."}
{"plan_idx": 815, "title": "very-vanilla-ry-cheesecake", "question_idx": 815, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 6], "binary_question": "Must Step 7 happen after Step 4?", "why_question": "Why is it not necessary for Step 7 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\nMust Step 7 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 816, "title": "no-sugar-rock-cakes", "question_idx": 816, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 5 happen after Step 2?", "why_question": "Why is it not necessary for Step 5 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\nMust Step 5 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 817, "title": "spanish-rabbit-stew", "question_idx": 817, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 9], "binary_question": "Must Step 10 happen after Step 3?", "why_question": "Why is it not necessary for Step 10 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\nMust Step 10 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 818, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 818, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 6], "binary_question": "Must Step 7 happen after Step 4?", "why_question": "Why is it not necessary for Step 7 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\nMust Step 7 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "No", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 819, "title": "chocolate-chocolate-cake", "question_idx": 819, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [18, 21], "binary_question": "Must Step 22 happen after Step 19?", "why_question": "Why is it not necessary for Step 22 to happen after Step 19?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 22 happen after Step 19? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 820, "title": "fusilli-and-meatballs", "question_idx": 820, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [8, 15], "binary_question": "Must Step 16 happen after Step 9?", "why_question": "Why is it not necessary for Step 16 to happen after Step 9?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 16 happen after Step 9? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No", "model_answer": "No."}
{"plan_idx": 821, "title": "chicken and vegetable pie", "question_idx": 821, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 10], "binary_question": "Must Step 11 happen after Step 7?", "why_question": "Why is it not necessary for Step 11 to happen after Step 7?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\nMust Step 11 happen after Step 7? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 822, "title": "chocolate-chocolate-cake", "question_idx": 822, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [9, 10], "binary_question": "Must Step 11 happen after Step 10?", "why_question": "Why is it not necessary for Step 11 to happen after Step 10?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 11 happen after Step 10? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes", "model_answer": "Yes."}
{"plan_idx": 823, "title": "chocolate-chocolate-cake", "question_idx": 823, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [8, 18], "binary_question": "Must Step 19 happen after Step 9?", "why_question": "Why is it not necessary for Step 19 to happen after Step 9?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 19 happen after Step 9? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 824, "title": "very-vanilla-ry-cheesecake", "question_idx": 824, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why is it not necessary for Step 6 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\nMust Step 6 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 825, "title": "fusilli-and-meatballs", "question_idx": 825, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [8, 18], "binary_question": "Must Step 19 happen after Step 9?", "why_question": "Why is it not necessary for Step 19 to happen after Step 9?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 19 happen after Step 9? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 826, "title": "fusilli-and-meatballs", "question_idx": 826, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 11], "binary_question": "Must Step 12 happen after Step 8?", "why_question": "Why is it not necessary for Step 12 to happen after Step 8?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 12 happen after Step 8? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 827, "title": "fusilli-and-meatballs", "question_idx": 827, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 18], "binary_question": "Must Step 19 happen after Step 2?", "why_question": "Why is it not necessary for Step 19 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 19 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 828, "title": "fusilli-and-meatballs", "question_idx": 828, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 10], "binary_question": "Must Step 11 happen after Step 8?", "why_question": "Why is it not necessary for Step 11 to happen after Step 8?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 11 happen after Step 8? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 829, "title": "spiced-pumpkin-teabread", "question_idx": 829, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 6], "binary_question": "Must Step 7 happen after Step 5?", "why_question": "Why is it not necessary for Step 7 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\nMust Step 7 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No", "model_answer": "No."}
{"plan_idx": 830, "title": "very-vanilla-ry-cheesecake", "question_idx": 830, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 7 happen after Step 1?", "why_question": "Why is it not necessary for Step 7 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\nMust Step 7 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 831, "title": "vegetable-terrine", "question_idx": 831, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 9], "binary_question": "Must Step 10 happen after Step 2?", "why_question": "Why is it not necessary for Step 10 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\nMust Step 10 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 832, "title": "green-tofu-curry", "question_idx": 832, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 8], "binary_question": "Must Step 9 happen after Step 7?", "why_question": "Why is it not necessary for Step 9 to happen after Step 7?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\nMust Step 9 happen after Step 7? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 833, "title": "almond and apple cake", "question_idx": 833, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 7 happen after Step 3?", "why_question": "Why is it not necessary for Step 7 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\nMust Step 7 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 834, "title": "chocolate-chocolate-cake", "question_idx": 834, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 13], "binary_question": "Must Step 14 happen after Step 7?", "why_question": "Why is it not necessary for Step 14 to happen after Step 7?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 14 happen after Step 7? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 835, "title": "chocolate-chocolate-cake", "question_idx": 835, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 11], "binary_question": "Must Step 12 happen after Step 2?", "why_question": "Why is it not necessary for Step 12 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 12 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 836, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 836, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 11], "binary_question": "Must Step 12 happen after Step 6?", "why_question": "Why is it not necessary for Step 12 to happen after Step 6?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\nMust Step 12 happen after Step 6? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 837, "title": "fusilli-and-meatballs", "question_idx": 837, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 13], "binary_question": "Must Step 14 happen after Step 5?", "why_question": "Why is it not necessary for Step 14 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 14 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 838, "title": "chocolate-chocolate-cake", "question_idx": 838, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 10], "binary_question": "Must Step 11 happen after Step 6?", "why_question": "Why is it not necessary for Step 11 to happen after Step 6?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 11 happen after Step 6? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 839, "title": "strawberry-tiramisu-trifle", "question_idx": 839, "steps": ["Set 3 strawberries for the garnish aside, and cut the rest into slices.", "In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.", "Then stir in the custard and finally fold in the whipped cream.", "Brush the sponge fingers with the remaining coffee.", "Line a glass bowl with one layer of the soaked sponge fingers.", "Spread half of the strawberries over the sponge fingers.", "Sprinkle half of the grated chocolate over that and then half of the custard mixture.", "Repeat the layers in order again.", "Cut the remaining 3 strawberries in half and lay them on top of the trifle.", "Cover and leave in the fridge for at least 4 hours, best overnight."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why is it not necessary for Step 4 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: strawberry-tiramisu-trifle\n\nProcedure:\n1. Set 3 strawberries for the garnish aside, and cut the rest into slices.\n2. In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.\n3. Then stir in the custard and finally fold in the whipped cream.\n4. Brush the sponge fingers with the remaining coffee.\n5. Line a glass bowl with one layer of the soaked sponge fingers.\n6. Spread half of the strawberries over the sponge fingers.\n7. Sprinkle half of the grated chocolate over that and then half of the custard mixture.\n8. Repeat the layers in order again.\n9. Cut the remaining 3 strawberries in half and lay them on top of the trifle.\n10. Cover and leave in the fridge for at least 4 hours, best overnight.\n\n\nMust Step 4 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 840, "title": "fusilli-and-meatballs", "question_idx": 840, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [9, 15], "binary_question": "Must Step 16 happen after Step 10?", "why_question": "Why is it not necessary for Step 16 to happen after Step 10?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 16 happen after Step 10? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 841, "title": "green-tofu-curry", "question_idx": 841, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 8], "binary_question": "Must Step 9 happen after Step 5?", "why_question": "Why is it not necessary for Step 9 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\nMust Step 9 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 842, "title": "smoked-salmon-and-grapefruit-salad", "question_idx": 842, "steps": ["Top and tail the grapefruits.", "Slice the skin off the grapefruit over a bowl.", "This is to catch any juices.", "Using a small knife, segment the grapefruits over the juice bowl.", "Arrange the lamb's lettuce onto each serving plate or a large salad bowl.", "Top with grapefruit segments and smoked salmon.", "Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.", "Pour over the salad and serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 7 happen after Step 6?", "why_question": "Why is it not necessary for Step 7 to happen after Step 6?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: smoked-salmon-and-grapefruit-salad\n\nProcedure:\n1. Top and tail the grapefruits.\n2. Slice the skin off the grapefruit over a bowl.\n3. This is to catch any juices.\n4. Using a small knife, segment the grapefruits over the juice bowl.\n5. Arrange the lamb's lettuce onto each serving plate or a large salad bowl.\n6. Top with grapefruit segments and smoked salmon.\n7. Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.\n8. Pour over the salad and serve.\n\n\nMust Step 7 happen after Step 6? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 843, "title": "spanish-rabbit-stew", "question_idx": 843, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 10], "binary_question": "Must Step 11 happen after Step 2?", "why_question": "Why is it not necessary for Step 11 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\nMust Step 11 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 844, "title": "spiced-pumpkin-teabread", "question_idx": 844, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 7 happen after Step 2?", "why_question": "Why is it not necessary for Step 7 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\nMust Step 7 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 845, "title": "chicken and vegetable pie", "question_idx": 845, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 7 happen after Step 2?", "why_question": "Why is it not necessary for Step 7 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\nMust Step 7 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes", "model_answer": "Yes."}
{"plan_idx": 846, "title": "fusilli-and-meatballs", "question_idx": 846, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [9, 18], "binary_question": "Must Step 19 happen after Step 10?", "why_question": "Why is it not necessary for Step 19 to happen after Step 10?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 19 happen after Step 10? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 847, "title": "cranachan", "question_idx": 847, "steps": ["Preheat the oven to 180 C / Gas mark 4.", "Spread oats out in a thin layer on a baking tray.", "Toast in the oven for about 10 minutes, or until lightly browned.", "Set aside to cool.", "Remove them from the tray for faster cooling.", "In a medium bowl, whip the cream to firm peaks.", "Gently fold in the icing sugar, vanilla and toasted oats.", "Spoon into 4 serving bowls, and top with fresh berries.", "For an extra touch, drizzle some whisky over each serving.", "Garnish with a mint leaf."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 6 happen after Step 3?", "why_question": "Why is it not necessary for Step 6 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: cranachan\n\nProcedure:\n1. Preheat the oven to 180 C / Gas mark 4.\n2. Spread oats out in a thin layer on a baking tray.\n3. Toast in the oven for about 10 minutes, or until lightly browned.\n4. Set aside to cool.\n5. Remove them from the tray for faster cooling.\n6. In a medium bowl, whip the cream to firm peaks.\n7. Gently fold in the icing sugar, vanilla and toasted oats.\n8. Spoon into 4 serving bowls, and top with fresh berries.\n9. For an extra touch, drizzle some whisky over each serving.\n10. Garnish with a mint leaf.\n\n\nMust Step 6 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 848, "title": "warm-puy-lentil-and-tomato-salad", "question_idx": 848, "steps": ["Bring a large pan of water to the boil;", "add lentils and cook over low heat for 30 minutes.", "Put tomatoes in a small bowl and season with salt.", "Set aside for 15 minutes.", "Drain lentils and tomatoes and mix together.", "Distribute mixture evenly in 6 individual bowls or ramekins, sprinkle with chopped parsley and serve warm or chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 4 happen after Step 2?", "why_question": "Why is it not necessary for Step 4 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: warm-puy-lentil-and-tomato-salad\n\nProcedure:\n1. Bring a large pan of water to the boil;\n2. add lentils and cook over low heat for 30 minutes.\n3. Put tomatoes in a small bowl and season with salt.\n4. Set aside for 15 minutes.\n5. Drain lentils and tomatoes and mix together.\n6. Distribute mixture evenly in 6 individual bowls or ramekins, sprinkle with chopped parsley and serve warm or chilled.\n\n\nMust Step 4 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 849, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 849, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [9, 10], "binary_question": "Must Step 11 happen after Step 10?", "why_question": "Why is it not necessary for Step 11 to happen after Step 10?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\nMust Step 11 happen after Step 10? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 850, "title": "no-sugar-rock-cakes", "question_idx": 850, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 3 happen after Step 2?", "why_question": "Why is it not necessary for Step 3 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\nMust Step 3 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 851, "title": "spanish-rabbit-stew", "question_idx": 851, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why is it not necessary for Step 6 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\nMust Step 6 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 852, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 852, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 11], "binary_question": "Must Step 12 happen after Step 1?", "why_question": "Why is it not necessary for Step 12 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\nMust Step 12 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 853, "title": "fusilli-and-meatballs", "question_idx": 853, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 9], "binary_question": "Must Step 10 happen after Step 4?", "why_question": "Why is it not necessary for Step 10 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 10 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 854, "title": "no-sugar-rock-cakes", "question_idx": 854, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why is it not necessary for Step 2 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\nMust Step 2 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 855, "title": "curried bbq mussels", "question_idx": 855, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 7 happen after Step 3?", "why_question": "Why is it not necessary for Step 7 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\nMust Step 7 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 856, "title": "chocolate-chocolate-cake", "question_idx": 856, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 11], "binary_question": "Must Step 12 happen after Step 8?", "why_question": "Why is it not necessary for Step 12 to happen after Step 8?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 12 happen after Step 8? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 857, "title": "green-tofu-curry", "question_idx": 857, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 9], "binary_question": "Must Step 10 happen after Step 4?", "why_question": "Why is it not necessary for Step 10 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\nMust Step 10 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 858, "title": "almond and apple cake", "question_idx": 858, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 9], "binary_question": "Must Step 10 happen after Step 1?", "why_question": "Why is it not necessary for Step 10 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\nMust Step 10 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 859, "title": "smoked-salmon-and-grapefruit-salad", "question_idx": 859, "steps": ["Top and tail the grapefruits.", "Slice the skin off the grapefruit over a bowl.", "This is to catch any juices.", "Using a small knife, segment the grapefruits over the juice bowl.", "Arrange the lamb's lettuce onto each serving plate or a large salad bowl.", "Top with grapefruit segments and smoked salmon.", "Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.", "Pour over the salad and serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 7], "binary_question": "Must Step 8 happen after Step 3?", "why_question": "Why is it not necessary for Step 8 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: smoked-salmon-and-grapefruit-salad\n\nProcedure:\n1. Top and tail the grapefruits.\n2. Slice the skin off the grapefruit over a bowl.\n3. This is to catch any juices.\n4. Using a small knife, segment the grapefruits over the juice bowl.\n5. Arrange the lamb's lettuce onto each serving plate or a large salad bowl.\n6. Top with grapefruit segments and smoked salmon.\n7. Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.\n8. Pour over the salad and serve.\n\n\nMust Step 8 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 860, "title": "spiced butternut squash soup", "question_idx": 860, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 9], "binary_question": "Must Step 10 happen after Step 3?", "why_question": "Why is it not necessary for Step 10 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\nMust Step 10 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 861, "title": "chicken and vegetable pie", "question_idx": 861, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 9], "binary_question": "Must Step 10 happen after Step 2?", "why_question": "Why is it not necessary for Step 10 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\nMust Step 10 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 862, "title": "spicy-tomato-anchovy-pasta", "question_idx": 862, "steps": ["Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;", "cook until lightly browned.", "Add anchovies and water, cover and simmer for 4 to 5 minutes.", "Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.", "While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.", "Add linguine and cook until al dente, about 7 to 8 minutes;", "drain.", "Toss with anchovy mixture and chilli flakes.", "If desired, season with black pepper.", "Serve immediately."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 5 happen after Step 2?", "why_question": "Why is it not necessary for Step 5 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spicy-tomato-anchovy-pasta\n\nProcedure:\n1. Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;\n2. cook until lightly browned.\n3. Add anchovies and water, cover and simmer for 4 to 5 minutes.\n4. Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.\n5. While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.\n6. Add linguine and cook until al dente, about 7 to 8 minutes;\n7. drain.\n8. Toss with anchovy mixture and chilli flakes.\n9. If desired, season with black pepper.\n10. Serve immediately.\n\n\nMust Step 5 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 863, "title": "fusilli-and-meatballs", "question_idx": 863, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 18], "binary_question": "Must Step 19 happen after Step 5?", "why_question": "Why is it not necessary for Step 19 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 19 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 864, "title": "vegetable-terrine", "question_idx": 864, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 8], "binary_question": "Must Step 9 happen after Step 3?", "why_question": "Why is it not necessary for Step 9 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\nMust Step 9 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes", "model_answer": "Yes."}
{"plan_idx": 865, "title": "chocolate-chocolate-cake", "question_idx": 865, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 14], "binary_question": "Must Step 15 happen after Step 1?", "why_question": "Why is it not necessary for Step 15 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 15 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 866, "title": "fusilli-and-meatballs", "question_idx": 866, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 13], "binary_question": "Must Step 14 happen after Step 1?", "why_question": "Why is it not necessary for Step 14 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 14 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 867, "title": "green-tofu-curry", "question_idx": 867, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 9], "binary_question": "Must Step 10 happen after Step 8?", "why_question": "Why is it not necessary for Step 10 to happen after Step 8?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\nMust Step 10 happen after Step 8? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No", "model_answer": "No."}
{"plan_idx": 868, "title": "curried bbq mussels", "question_idx": 868, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why is it not necessary for Step 5 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\nMust Step 5 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 869, "title": "fusilli-and-meatballs", "question_idx": 869, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why is it not necessary for Step 5 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 5 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 870, "title": "chicken-prawn-and-rice-soup", "question_idx": 870, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 9], "binary_question": "Must Step 10 happen after Step 5?", "why_question": "Why is it not necessary for Step 10 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\nMust Step 10 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 871, "title": "smoked-salmon-and-grapefruit-salad", "question_idx": 871, "steps": ["Top and tail the grapefruits.", "Slice the skin off the grapefruit over a bowl.", "This is to catch any juices.", "Using a small knife, segment the grapefruits over the juice bowl.", "Arrange the lamb's lettuce onto each serving plate or a large salad bowl.", "Top with grapefruit segments and smoked salmon.", "Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.", "Pour over the salad and serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 5 happen after Step 4?", "why_question": "Why is it not necessary for Step 5 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: smoked-salmon-and-grapefruit-salad\n\nProcedure:\n1. Top and tail the grapefruits.\n2. Slice the skin off the grapefruit over a bowl.\n3. This is to catch any juices.\n4. Using a small knife, segment the grapefruits over the juice bowl.\n5. Arrange the lamb's lettuce onto each serving plate or a large salad bowl.\n6. Top with grapefruit segments and smoked salmon.\n7. Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.\n8. Pour over the salad and serve.\n\n\nMust Step 5 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "Yes", "trial_1_answer": "Yes.", "trial_2_answer": "Yes", "model_answer": "Yes."}
{"plan_idx": 872, "title": "almond and apple cake", "question_idx": 872, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why is it not necessary for Step 6 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\nMust Step 6 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 873, "title": "brown sugar shortbread", "question_idx": 873, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 8], "binary_question": "Must Step 9 happen after Step 1?", "why_question": "Why is it not necessary for Step 9 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\nMust Step 9 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 874, "title": "very-vanilla-ry-cheesecake", "question_idx": 874, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 6], "binary_question": "Must Step 7 happen after Step 5?", "why_question": "Why is it not necessary for Step 7 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\nMust Step 7 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 875, "title": "vegetable-terrine", "question_idx": 875, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why is it not necessary for Step 2 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\nMust Step 2 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 876, "title": "chicken and vegetable pie", "question_idx": 876, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 6 happen after Step 3?", "why_question": "Why is it not necessary for Step 6 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\nMust Step 6 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 877, "title": "cloud-bread", "question_idx": 877, "steps": ["Preheat oven to 150 C / Gas mark 2.", "Line a baking tray with baking paper.", "Mix cream cheese and egg yolks together until smooth.", "Place egg whites and baking powder in a glass, metal, or ceramic bowl;", "beat together until stiff peaks form.", "Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.", "Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.", "Bake in the preheated oven until golden brown, 17 to 20 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why is it not necessary for Step 6 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: cloud-bread\n\nProcedure:\n1. Preheat oven to 150 C / Gas mark 2.\n2. Line a baking tray with baking paper.\n3. Mix cream cheese and egg yolks together until smooth.\n4. Place egg whites and baking powder in a glass, metal, or ceramic bowl;\n5. beat together until stiff peaks form.\n6. Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.\n7. Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.\n8. Bake in the preheated oven until golden brown, 17 to 20 minutes.\n\n\nMust Step 6 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 878, "title": "strawberry-tiramisu-trifle", "question_idx": 878, "steps": ["Set 3 strawberries for the garnish aside, and cut the rest into slices.", "In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.", "Then stir in the custard and finally fold in the whipped cream.", "Brush the sponge fingers with the remaining coffee.", "Line a glass bowl with one layer of the soaked sponge fingers.", "Spread half of the strawberries over the sponge fingers.", "Sprinkle half of the grated chocolate over that and then half of the custard mixture.", "Repeat the layers in order again.", "Cut the remaining 3 strawberries in half and lay them on top of the trifle.", "Cover and leave in the fridge for at least 4 hours, best overnight."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 4 happen after Step 2?", "why_question": "Why is it not necessary for Step 4 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: strawberry-tiramisu-trifle\n\nProcedure:\n1. Set 3 strawberries for the garnish aside, and cut the rest into slices.\n2. In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.\n3. Then stir in the custard and finally fold in the whipped cream.\n4. Brush the sponge fingers with the remaining coffee.\n5. Line a glass bowl with one layer of the soaked sponge fingers.\n6. Spread half of the strawberries over the sponge fingers.\n7. Sprinkle half of the grated chocolate over that and then half of the custard mixture.\n8. Repeat the layers in order again.\n9. Cut the remaining 3 strawberries in half and lay them on top of the trifle.\n10. Cover and leave in the fridge for at least 4 hours, best overnight.\n\n\nMust Step 4 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 879, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 879, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 11], "binary_question": "Must Step 12 happen after Step 4?", "why_question": "Why is it not necessary for Step 12 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\nMust Step 12 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No", "model_answer": "No."}
{"plan_idx": 880, "title": "chocolate-chocolate-cake", "question_idx": 880, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [14, 18], "binary_question": "Must Step 19 happen after Step 15?", "why_question": "Why is it not necessary for Step 19 to happen after Step 15?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 19 happen after Step 15? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 881, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 881, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 7 happen after Step 1?", "why_question": "Why is it not necessary for Step 7 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\nMust Step 7 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 882, "title": "brown sugar shortbread", "question_idx": 882, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 7], "binary_question": "Must Step 8 happen after Step 1?", "why_question": "Why is it not necessary for Step 8 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\nMust Step 8 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 883, "title": "vegetable-terrine", "question_idx": 883, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 7 happen after Step 3?", "why_question": "Why is it not necessary for Step 7 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\nMust Step 7 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 884, "title": "fusilli-and-meatballs", "question_idx": 884, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 7], "binary_question": "Must Step 8 happen after Step 3?", "why_question": "Why is it not necessary for Step 8 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 8 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 885, "title": "spicy-tomato-anchovy-pasta", "question_idx": 885, "steps": ["Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;", "cook until lightly browned.", "Add anchovies and water, cover and simmer for 4 to 5 minutes.", "Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.", "While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.", "Add linguine and cook until al dente, about 7 to 8 minutes;", "drain.", "Toss with anchovy mixture and chilli flakes.", "If desired, season with black pepper.", "Serve immediately."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 5 happen after Step 3?", "why_question": "Why is it not necessary for Step 5 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spicy-tomato-anchovy-pasta\n\nProcedure:\n1. Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;\n2. cook until lightly browned.\n3. Add anchovies and water, cover and simmer for 4 to 5 minutes.\n4. Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.\n5. While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.\n6. Add linguine and cook until al dente, about 7 to 8 minutes;\n7. drain.\n8. Toss with anchovy mixture and chilli flakes.\n9. If desired, season with black pepper.\n10. Serve immediately.\n\n\nMust Step 5 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 886, "title": "spicy-tomato-anchovy-pasta", "question_idx": 886, "steps": ["Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;", "cook until lightly browned.", "Add anchovies and water, cover and simmer for 4 to 5 minutes.", "Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.", "While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.", "Add linguine and cook until al dente, about 7 to 8 minutes;", "drain.", "Toss with anchovy mixture and chilli flakes.", "If desired, season with black pepper.", "Serve immediately."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 5 happen after Step 4?", "why_question": "Why is it not necessary for Step 5 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spicy-tomato-anchovy-pasta\n\nProcedure:\n1. Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;\n2. cook until lightly browned.\n3. Add anchovies and water, cover and simmer for 4 to 5 minutes.\n4. Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.\n5. While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.\n6. Add linguine and cook until al dente, about 7 to 8 minutes;\n7. drain.\n8. Toss with anchovy mixture and chilli flakes.\n9. If desired, season with black pepper.\n10. Serve immediately.\n\n\nMust Step 5 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 887, "title": "chocolate-pancake-batter", "question_idx": 887, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 6 happen after Step 3?", "why_question": "Why is it not necessary for Step 6 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\nMust Step 6 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No", "trial_1_answer": "No", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 888, "title": "chocolate-chocolate-cake", "question_idx": 888, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 10], "binary_question": "Must Step 11 happen after Step 1?", "why_question": "Why is it not necessary for Step 11 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 11 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 889, "title": "no-sugar-rock-cakes", "question_idx": 889, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why is it not necessary for Step 4 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\nMust Step 4 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 890, "title": "chicken and vegetable pie", "question_idx": 890, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 8], "binary_question": "Must Step 9 happen after Step 1?", "why_question": "Why is it not necessary for Step 9 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\nMust Step 9 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 891, "title": "cloud-bread", "question_idx": 891, "steps": ["Preheat oven to 150 C / Gas mark 2.", "Line a baking tray with baking paper.", "Mix cream cheese and egg yolks together until smooth.", "Place egg whites and baking powder in a glass, metal, or ceramic bowl;", "beat together until stiff peaks form.", "Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.", "Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.", "Bake in the preheated oven until golden brown, 17 to 20 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why is it not necessary for Step 6 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: cloud-bread\n\nProcedure:\n1. Preheat oven to 150 C / Gas mark 2.\n2. Line a baking tray with baking paper.\n3. Mix cream cheese and egg yolks together until smooth.\n4. Place egg whites and baking powder in a glass, metal, or ceramic bowl;\n5. beat together until stiff peaks form.\n6. Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.\n7. Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.\n8. Bake in the preheated oven until golden brown, 17 to 20 minutes.\n\n\nMust Step 6 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 892, "title": "green-tofu-curry", "question_idx": 892, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 7], "binary_question": "Must Step 8 happen after Step 4?", "why_question": "Why is it not necessary for Step 8 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\nMust Step 8 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 893, "title": "kid-s-cheese-and-veg-kebab", "question_idx": 893, "steps": ["Shave the carrots into wide ribbons / waves using a potato peeler.", "Cut the red pepper into star shapes using a star cookie cutter.", "Cut the bread into flowers using a cookie cutter.", "Assemble all onto a skewer with bread flowers top and bottom and carrot curls, cheesy chunks and pepper stars seen as layers between."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why is it not necessary for Step 3 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: kid-s-cheese-and-veg-kebab\n\nProcedure:\n1. Shave the carrots into wide ribbons / waves using a potato peeler.\n2. Cut the red pepper into star shapes using a star cookie cutter.\n3. Cut the bread into flowers using a cookie cutter.\n4. Assemble all onto a skewer with bread flowers top and bottom and carrot curls, cheesy chunks and pepper stars seen as layers between.\n\n\nMust Step 3 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 894, "title": "banana-split-cake", "question_idx": 894, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why is it not necessary for Step 3 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\nMust Step 3 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 895, "title": "chocolate-chocolate-cake", "question_idx": 895, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 18], "binary_question": "Must Step 19 happen after Step 2?", "why_question": "Why is it not necessary for Step 19 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 19 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 896, "title": "creamy-chayote-squash-soup", "question_idx": 896, "steps": ["Dissolve the stock in the hot water.", "Melt the butter in a large saucepan over medium heat.", "Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.", "Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.", "Stir in the stock and 1 tablespoon coriander;", "cover.", "Simmer about 20 minutes.", "Pour the mixture into a liquidiser and puree until smooth.", "Pour into bowls and garnish with a sprig of coriander to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why is it not necessary for Step 2 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: creamy-chayote-squash-soup\n\nProcedure:\n1. Dissolve the stock in the hot water.\n2. Melt the butter in a large saucepan over medium heat.\n3. Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.\n4. Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.\n5. Stir in the stock and 1 tablespoon coriander;\n6. cover.\n7. Simmer about 20 minutes.\n8. Pour the mixture into a liquidiser and puree until smooth.\n9. Pour into bowls and garnish with a sprig of coriander to serve.\n\n\nMust Step 2 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 897, "title": "spanish-rabbit-stew", "question_idx": 897, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 6 happen after Step 5?", "why_question": "Why is it not necessary for Step 6 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\nMust Step 6 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes", "trial_2_answer": "Yes", "model_answer": "Yes."}
{"plan_idx": 898, "title": "very-vanilla-ry-cheesecake", "question_idx": 898, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 6 happen after Step 5?", "why_question": "Why is it not necessary for Step 6 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\nMust Step 6 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes", "model_answer": "Yes."}
{"plan_idx": 899, "title": "fusilli-and-meatballs", "question_idx": 899, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 12], "binary_question": "Must Step 13 happen after Step 6?", "why_question": "Why is it not necessary for Step 13 to happen after Step 6?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 13 happen after Step 6? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 900, "title": "strawberry-tiramisu-trifle", "question_idx": 900, "steps": ["Set 3 strawberries for the garnish aside, and cut the rest into slices.", "In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.", "Then stir in the custard and finally fold in the whipped cream.", "Brush the sponge fingers with the remaining coffee.", "Line a glass bowl with one layer of the soaked sponge fingers.", "Spread half of the strawberries over the sponge fingers.", "Sprinkle half of the grated chocolate over that and then half of the custard mixture.", "Repeat the layers in order again.", "Cut the remaining 3 strawberries in half and lay them on top of the trifle.", "Cover and leave in the fridge for at least 4 hours, best overnight."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why is it not necessary for Step 6 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: strawberry-tiramisu-trifle\n\nProcedure:\n1. Set 3 strawberries for the garnish aside, and cut the rest into slices.\n2. In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.\n3. Then stir in the custard and finally fold in the whipped cream.\n4. Brush the sponge fingers with the remaining coffee.\n5. Line a glass bowl with one layer of the soaked sponge fingers.\n6. Spread half of the strawberries over the sponge fingers.\n7. Sprinkle half of the grated chocolate over that and then half of the custard mixture.\n8. Repeat the layers in order again.\n9. Cut the remaining 3 strawberries in half and lay them on top of the trifle.\n10. Cover and leave in the fridge for at least 4 hours, best overnight.\n\n\nMust Step 6 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 901, "title": "very-vanilla-ry-cheesecake", "question_idx": 901, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 7], "binary_question": "Must Step 8 happen after Step 3?", "why_question": "Why is it not necessary for Step 8 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\nMust Step 8 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 902, "title": "spiced-pumpkin-teabread", "question_idx": 902, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why is it not necessary for Step 4 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\nMust Step 4 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 903, "title": "chicken and vegetable pie", "question_idx": 903, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 8], "binary_question": "Must Step 9 happen after Step 2?", "why_question": "Why is it not necessary for Step 9 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\nMust Step 9 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 904, "title": "creamy-chayote-squash-soup", "question_idx": 904, "steps": ["Dissolve the stock in the hot water.", "Melt the butter in a large saucepan over medium heat.", "Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.", "Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.", "Stir in the stock and 1 tablespoon coriander;", "cover.", "Simmer about 20 minutes.", "Pour the mixture into a liquidiser and puree until smooth.", "Pour into bowls and garnish with a sprig of coriander to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why is it not necessary for Step 4 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: creamy-chayote-squash-soup\n\nProcedure:\n1. Dissolve the stock in the hot water.\n2. Melt the butter in a large saucepan over medium heat.\n3. Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.\n4. Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.\n5. Stir in the stock and 1 tablespoon coriander;\n6. cover.\n7. Simmer about 20 minutes.\n8. Pour the mixture into a liquidiser and puree until smooth.\n9. Pour into bowls and garnish with a sprig of coriander to serve.\n\n\nMust Step 4 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No", "model_answer": "No."}
{"plan_idx": 905, "title": "vegetable-terrine", "question_idx": 905, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why is it not necessary for Step 6 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\nMust Step 6 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 906, "title": "chocolate-chocolate-cake", "question_idx": 906, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 7], "binary_question": "Must Step 8 happen after Step 3?", "why_question": "Why is it not necessary for Step 8 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 8 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 907, "title": "spicy-tomato-anchovy-pasta", "question_idx": 907, "steps": ["Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;", "cook until lightly browned.", "Add anchovies and water, cover and simmer for 4 to 5 minutes.", "Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.", "While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.", "Add linguine and cook until al dente, about 7 to 8 minutes;", "drain.", "Toss with anchovy mixture and chilli flakes.", "If desired, season with black pepper.", "Serve immediately."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why is it not necessary for Step 6 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spicy-tomato-anchovy-pasta\n\nProcedure:\n1. Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;\n2. cook until lightly browned.\n3. Add anchovies and water, cover and simmer for 4 to 5 minutes.\n4. Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.\n5. While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.\n6. Add linguine and cook until al dente, about 7 to 8 minutes;\n7. drain.\n8. Toss with anchovy mixture and chilli flakes.\n9. If desired, season with black pepper.\n10. Serve immediately.\n\n\nMust Step 6 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 908, "title": "brown sugar shortbread", "question_idx": 908, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why is it not necessary for Step 4 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\nMust Step 4 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 909, "title": "banana-split-cake", "question_idx": 909, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why is it not necessary for Step 2 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\nMust Step 2 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 910, "title": "fusilli-and-meatballs", "question_idx": 910, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 15], "binary_question": "Must Step 16 happen after Step 5?", "why_question": "Why is it not necessary for Step 16 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 16 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 911, "title": "spanish-rabbit-stew", "question_idx": 911, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 6 happen after Step 3?", "why_question": "Why is it not necessary for Step 6 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\nMust Step 6 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "Yes", "trial_1_answer": "No.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 912, "title": "spiced-guava-cake", "question_idx": 912, "steps": ["Preheat oven to 180 C / Gas 4.", "Grease and flour one 23x13cm loaf tin.", "Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.", "In another bowl, mix together guava pulp and juice.", "In another bowl, cream together butter and sugar.", "Add eggs, one at a time.", "Add flour mixture and guava mixture alternately to creamed mixture.", "Pour batter into prepared tin.", "Bake at 180 C / Gas 4 for 30-35 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 4 happen after Step 2?", "why_question": "Why is it not necessary for Step 4 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced-guava-cake\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Grease and flour one 23x13cm loaf tin.\n3. Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.\n4. In another bowl, mix together guava pulp and juice.\n5. In another bowl, cream together butter and sugar.\n6. Add eggs, one at a time.\n7. Add flour mixture and guava mixture alternately to creamed mixture.\n8. Pour batter into prepared tin.\n9. Bake at 180 C / Gas 4 for 30-35 minutes.\n\n\nMust Step 4 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 913, "title": "spanish-rabbit-stew", "question_idx": 913, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 4 happen after Step 3?", "why_question": "Why is it not necessary for Step 4 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\nMust Step 4 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes", "model_answer": "Yes."}
{"plan_idx": 914, "title": "spiced-guava-cake", "question_idx": 914, "steps": ["Preheat oven to 180 C / Gas 4.", "Grease and flour one 23x13cm loaf tin.", "Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.", "In another bowl, mix together guava pulp and juice.", "In another bowl, cream together butter and sugar.", "Add eggs, one at a time.", "Add flour mixture and guava mixture alternately to creamed mixture.", "Pour batter into prepared tin.", "Bake at 180 C / Gas 4 for 30-35 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 5 happen after Step 3?", "why_question": "Why is it not necessary for Step 5 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced-guava-cake\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Grease and flour one 23x13cm loaf tin.\n3. Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.\n4. In another bowl, mix together guava pulp and juice.\n5. In another bowl, cream together butter and sugar.\n6. Add eggs, one at a time.\n7. Add flour mixture and guava mixture alternately to creamed mixture.\n8. Pour batter into prepared tin.\n9. Bake at 180 C / Gas 4 for 30-35 minutes.\n\n\nMust Step 5 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No", "trial_1_answer": "No", "trial_2_answer": "No", "model_answer": "No."}
{"plan_idx": 915, "title": "chicken and vegetable pie", "question_idx": 915, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 10], "binary_question": "Must Step 11 happen after Step 6?", "why_question": "Why is it not necessary for Step 11 to happen after Step 6?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\nMust Step 11 happen after Step 6? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes", "model_answer": "Yes."}
{"plan_idx": 916, "title": "almond and apple cake", "question_idx": 916, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 8], "binary_question": "Must Step 9 happen after Step 1?", "why_question": "Why is it not necessary for Step 9 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\nMust Step 9 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No", "model_answer": "No."}
{"plan_idx": 917, "title": "spanish-rabbit-stew", "question_idx": 917, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why is it not necessary for Step 3 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\nMust Step 3 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 918, "title": "green-tofu-curry", "question_idx": 918, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 9], "binary_question": "Must Step 10 happen after Step 5?", "why_question": "Why is it not necessary for Step 10 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\nMust Step 10 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 919, "title": "very-vanilla-ry-cheesecake", "question_idx": 919, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 9], "binary_question": "Must Step 10 happen after Step 7?", "why_question": "Why is it not necessary for Step 10 to happen after Step 7?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\nMust Step 10 happen after Step 7? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 920, "title": "vegetable-terrine", "question_idx": 920, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 7 happen after Step 2?", "why_question": "Why is it not necessary for Step 7 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\nMust Step 7 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 921, "title": "chicken and vegetable pie", "question_idx": 921, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 12], "binary_question": "Must Step 13 happen after Step 1?", "why_question": "Why is it not necessary for Step 13 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\nMust Step 13 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 922, "title": "chicken and vegetable pie", "question_idx": 922, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 9], "binary_question": "Must Step 10 happen after Step 4?", "why_question": "Why is it not necessary for Step 10 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\nMust Step 10 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 923, "title": "spiced-pumpkin-teabread", "question_idx": 923, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 6 happen after Step 3?", "why_question": "Why is it not necessary for Step 6 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\nMust Step 6 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 924, "title": "chocolate-chocolate-cake", "question_idx": 924, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [9, 13], "binary_question": "Must Step 14 happen after Step 10?", "why_question": "Why is it not necessary for Step 14 to happen after Step 10?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 14 happen after Step 10? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 925, "title": "fusilli-and-meatballs", "question_idx": 925, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 14], "binary_question": "Must Step 15 happen after Step 7?", "why_question": "Why is it not necessary for Step 15 to happen after Step 7?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 15 happen after Step 7? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 926, "title": "chicken-prawn-and-rice-soup", "question_idx": 926, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 10], "binary_question": "Must Step 11 happen after Step 1?", "why_question": "Why is it not necessary for Step 11 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\nMust Step 11 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 927, "title": "spiced butternut squash soup", "question_idx": 927, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 10], "binary_question": "Must Step 11 happen after Step 6?", "why_question": "Why is it not necessary for Step 11 to happen after Step 6?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\nMust Step 11 happen after Step 6? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 928, "title": "fusilli-and-meatballs", "question_idx": 928, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 7 happen after Step 1?", "why_question": "Why is it not necessary for Step 7 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 7 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 929, "title": "fusilli-and-meatballs", "question_idx": 929, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [9, 10], "binary_question": "Must Step 11 happen after Step 10?", "why_question": "Why is it not necessary for Step 11 to happen after Step 10?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 11 happen after Step 10? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 930, "title": "green-tofu-curry", "question_idx": 930, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 7], "binary_question": "Must Step 8 happen after Step 2?", "why_question": "Why is it not necessary for Step 8 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\nMust Step 8 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 931, "title": "strawberry-tiramisu-trifle", "question_idx": 931, "steps": ["Set 3 strawberries for the garnish aside, and cut the rest into slices.", "In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.", "Then stir in the custard and finally fold in the whipped cream.", "Brush the sponge fingers with the remaining coffee.", "Line a glass bowl with one layer of the soaked sponge fingers.", "Spread half of the strawberries over the sponge fingers.", "Sprinkle half of the grated chocolate over that and then half of the custard mixture.", "Repeat the layers in order again.", "Cut the remaining 3 strawberries in half and lay them on top of the trifle.", "Cover and leave in the fridge for at least 4 hours, best overnight."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 4 happen after Step 3?", "why_question": "Why is it not necessary for Step 4 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: strawberry-tiramisu-trifle\n\nProcedure:\n1. Set 3 strawberries for the garnish aside, and cut the rest into slices.\n2. In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.\n3. Then stir in the custard and finally fold in the whipped cream.\n4. Brush the sponge fingers with the remaining coffee.\n5. Line a glass bowl with one layer of the soaked sponge fingers.\n6. Spread half of the strawberries over the sponge fingers.\n7. Sprinkle half of the grated chocolate over that and then half of the custard mixture.\n8. Repeat the layers in order again.\n9. Cut the remaining 3 strawberries in half and lay them on top of the trifle.\n10. Cover and leave in the fridge for at least 4 hours, best overnight.\n\n\nMust Step 4 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 932, "title": "strawberry-tiramisu-trifle", "question_idx": 932, "steps": ["Set 3 strawberries for the garnish aside, and cut the rest into slices.", "In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.", "Then stir in the custard and finally fold in the whipped cream.", "Brush the sponge fingers with the remaining coffee.", "Line a glass bowl with one layer of the soaked sponge fingers.", "Spread half of the strawberries over the sponge fingers.", "Sprinkle half of the grated chocolate over that and then half of the custard mixture.", "Repeat the layers in order again.", "Cut the remaining 3 strawberries in half and lay them on top of the trifle.", "Cover and leave in the fridge for at least 4 hours, best overnight."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why is it not necessary for Step 5 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: strawberry-tiramisu-trifle\n\nProcedure:\n1. Set 3 strawberries for the garnish aside, and cut the rest into slices.\n2. In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.\n3. Then stir in the custard and finally fold in the whipped cream.\n4. Brush the sponge fingers with the remaining coffee.\n5. Line a glass bowl with one layer of the soaked sponge fingers.\n6. Spread half of the strawberries over the sponge fingers.\n7. Sprinkle half of the grated chocolate over that and then half of the custard mixture.\n8. Repeat the layers in order again.\n9. Cut the remaining 3 strawberries in half and lay them on top of the trifle.\n10. Cover and leave in the fridge for at least 4 hours, best overnight.\n\n\nMust Step 5 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 933, "title": "green-tofu-curry", "question_idx": 933, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 8], "binary_question": "Must Step 9 happen after Step 2?", "why_question": "Why is it not necessary for Step 9 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\nMust Step 9 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 934, "title": "chicken-prawn-and-rice-soup", "question_idx": 934, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 10], "binary_question": "Must Step 11 happen after Step 7?", "why_question": "Why is it not necessary for Step 11 to happen after Step 7?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\nMust Step 11 happen after Step 7? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 935, "title": "fusilli-and-meatballs", "question_idx": 935, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 10], "binary_question": "Must Step 11 happen after Step 7?", "why_question": "Why is it not necessary for Step 11 to happen after Step 7?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 11 happen after Step 7? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 936, "title": "almond and apple cake", "question_idx": 936, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why is it not necessary for Step 5 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\nMust Step 5 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 937, "title": "brown sugar shortbread", "question_idx": 937, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why is it not necessary for Step 6 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\nMust Step 6 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 938, "title": "spiced butternut squash soup", "question_idx": 938, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 7 happen after Step 1?", "why_question": "Why is it not necessary for Step 7 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\nMust Step 7 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 939, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 939, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 7 happen after Step 1?", "why_question": "Why is it not necessary for Step 7 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\nMust Step 7 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 940, "title": "chocolate-chocolate-cake", "question_idx": 940, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 9], "binary_question": "Must Step 10 happen after Step 1?", "why_question": "Why is it not necessary for Step 10 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 10 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 941, "title": "spanish-rabbit-stew", "question_idx": 941, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 4 happen after Step 2?", "why_question": "Why is it not necessary for Step 4 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\nMust Step 4 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 942, "title": "banana-split-cake", "question_idx": 942, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 6 happen after Step 3?", "why_question": "Why is it not necessary for Step 6 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\nMust Step 6 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 943, "title": "chocolate-chocolate-cake", "question_idx": 943, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why is it not necessary for Step 5 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 5 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 944, "title": "fusilli-and-meatballs", "question_idx": 944, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 10], "binary_question": "Must Step 11 happen after Step 4?", "why_question": "Why is it not necessary for Step 11 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 11 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 945, "title": "spiced-guava-cake", "question_idx": 945, "steps": ["Preheat oven to 180 C / Gas 4.", "Grease and flour one 23x13cm loaf tin.", "Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.", "In another bowl, mix together guava pulp and juice.", "In another bowl, cream together butter and sugar.", "Add eggs, one at a time.", "Add flour mixture and guava mixture alternately to creamed mixture.", "Pour batter into prepared tin.", "Bake at 180 C / Gas 4 for 30-35 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 3 happen after Step 2?", "why_question": "Why is it not necessary for Step 3 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced-guava-cake\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Grease and flour one 23x13cm loaf tin.\n3. Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.\n4. In another bowl, mix together guava pulp and juice.\n5. In another bowl, cream together butter and sugar.\n6. Add eggs, one at a time.\n7. Add flour mixture and guava mixture alternately to creamed mixture.\n8. Pour batter into prepared tin.\n9. Bake at 180 C / Gas 4 for 30-35 minutes.\n\n\nMust Step 3 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 946, "title": "chocolate-chocolate-cake", "question_idx": 946, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 18], "binary_question": "Must Step 19 happen after Step 1?", "why_question": "Why is it not necessary for Step 19 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 19 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 947, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 947, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 10], "binary_question": "Must Step 11 happen after Step 6?", "why_question": "Why is it not necessary for Step 11 to happen after Step 6?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\nMust Step 11 happen after Step 6? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 948, "title": "spiced-pumpkin-teabread", "question_idx": 948, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 9], "binary_question": "Must Step 10 happen after Step 1?", "why_question": "Why is it not necessary for Step 10 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\nMust Step 10 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 949, "title": "fusilli-and-meatballs", "question_idx": 949, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 18], "binary_question": "Must Step 19 happen after Step 3?", "why_question": "Why is it not necessary for Step 19 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 19 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 950, "title": "fusilli-and-meatballs", "question_idx": 950, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 13], "binary_question": "Must Step 14 happen after Step 7?", "why_question": "Why is it not necessary for Step 14 to happen after Step 7?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 14 happen after Step 7? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 951, "title": "chicken-prawn-and-rice-soup", "question_idx": 951, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 10], "binary_question": "Must Step 11 happen after Step 6?", "why_question": "Why is it not necessary for Step 11 to happen after Step 6?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\nMust Step 11 happen after Step 6? Select between yes or no\n\n", "trial_0_answer": "No", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 952, "title": "vegetable-terrine", "question_idx": 952, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 5 happen after Step 4?", "why_question": "Why is it not necessary for Step 5 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\nMust Step 5 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 953, "title": "fusilli-and-meatballs", "question_idx": 953, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [8, 13], "binary_question": "Must Step 14 happen after Step 9?", "why_question": "Why is it not necessary for Step 14 to happen after Step 9?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 14 happen after Step 9? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 954, "title": "spiced-guava-cake", "question_idx": 954, "steps": ["Preheat oven to 180 C / Gas 4.", "Grease and flour one 23x13cm loaf tin.", "Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.", "In another bowl, mix together guava pulp and juice.", "In another bowl, cream together butter and sugar.", "Add eggs, one at a time.", "Add flour mixture and guava mixture alternately to creamed mixture.", "Pour batter into prepared tin.", "Bake at 180 C / Gas 4 for 30-35 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 7], "binary_question": "Must Step 8 happen after Step 1?", "why_question": "Why is it not necessary for Step 8 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced-guava-cake\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Grease and flour one 23x13cm loaf tin.\n3. Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.\n4. In another bowl, mix together guava pulp and juice.\n5. In another bowl, cream together butter and sugar.\n6. Add eggs, one at a time.\n7. Add flour mixture and guava mixture alternately to creamed mixture.\n8. Pour batter into prepared tin.\n9. Bake at 180 C / Gas 4 for 30-35 minutes.\n\n\nMust Step 8 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 955, "title": "halloumi-and-figs", "question_idx": 955, "steps": ["Preheat a grill for high heat.", "Break up the halloumi cheese, and toss with the fresh figs and walnuts in a small dish.", "Grill under the preheated grill until the halloumi is browned and the figs begin to caramelise, about 3 minutes.", "Drizzle with the honey."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why is it not necessary for Step 2 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: halloumi-and-figs\n\nProcedure:\n1. Preheat a grill for high heat.\n2. Break up the halloumi cheese, and toss with the fresh figs and walnuts in a small dish.\n3. Grill under the preheated grill until the halloumi is browned and the figs begin to caramelise, about 3 minutes.\n4. Drizzle with the honey.\n\n\nMust Step 2 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 956, "title": "chocolate-chocolate-cake", "question_idx": 956, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 13], "binary_question": "Must Step 14 happen after Step 3?", "why_question": "Why is it not necessary for Step 14 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 14 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 957, "title": "spanish-rabbit-stew", "question_idx": 957, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 8], "binary_question": "Must Step 9 happen after Step 2?", "why_question": "Why is it not necessary for Step 9 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\nMust Step 9 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No", "model_answer": "No."}
{"plan_idx": 958, "title": "lightly spiced tomato and red lentil soup", "question_idx": 958, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 7 happen after Step 1?", "why_question": "Why is it not necessary for Step 7 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\nMust Step 7 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 959, "title": "chocolate-chocolate-cake", "question_idx": 959, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 13], "binary_question": "Must Step 14 happen after Step 2?", "why_question": "Why is it not necessary for Step 14 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 14 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 960, "title": "feta-and-sundried-tomato-spinach-rolls", "question_idx": 960, "steps": ["Preheat grill.", "Mix together cream cheese, feta, sundried tomatoes, basil and garlic.", "Stir until creamy, with no lumps.", "Blanch the spinach leaves.", "Wrap a dollop of cheese mix in each spinach leaf.", "Brush with olive oil.", "Sprinkle almonds on the top or alternately roll them in the almonds", "Grill spinach rolls until slightly crispy on top.", "Let cool for 10 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why is it not necessary for Step 3 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: feta-and-sundried-tomato-spinach-rolls\n\nProcedure:\n1. Preheat grill.\n2. Mix together cream cheese, feta, sundried tomatoes, basil and garlic.\n3. Stir until creamy, with no lumps.\n4. Blanch the spinach leaves.\n5. Wrap a dollop of cheese mix in each spinach leaf.\n6. Brush with olive oil.\n7. Sprinkle almonds on the top or alternately roll them in the almonds\n8. Grill spinach rolls until slightly crispy on top.\n9. Let cool for 10 minutes.\n\n\nMust Step 3 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 961, "title": "sardine spread", "question_idx": 961, "steps": ["Place the sardines in a bowl and roughly mash with a fork.", "Add in all of the remaining ingredients and stir well.", "Enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why is it not necessary for Step 3 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: sardine spread\n\nProcedure:\n1. Place the sardines in a bowl and roughly mash with a fork.\n2. Add in all of the remaining ingredients and stir well.\n3. Enjoy!\n\n\nMust Step 3 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 962, "title": "chicken and vegetable pie", "question_idx": 962, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why is it not necessary for Step 4 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\nMust Step 4 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No", "model_answer": "No."}
{"plan_idx": 963, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 963, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [9, 11], "binary_question": "Must Step 12 happen after Step 10?", "why_question": "Why is it not necessary for Step 12 to happen after Step 10?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\nMust Step 12 happen after Step 10? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 964, "title": "very-vanilla-ry-cheesecake", "question_idx": 964, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 7 happen after Step 2?", "why_question": "Why is it not necessary for Step 7 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\nMust Step 7 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 965, "title": "chocolate-chocolate-cake", "question_idx": 965, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 14], "binary_question": "Must Step 15 happen after Step 6?", "why_question": "Why is it not necessary for Step 15 to happen after Step 6?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 15 happen after Step 6? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 966, "title": "brown sugar shortbread", "question_idx": 966, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 5 happen after Step 2?", "why_question": "Why is it not necessary for Step 5 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\nMust Step 5 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 967, "title": "spiced butternut squash soup", "question_idx": 967, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 7], "binary_question": "Must Step 8 happen after Step 3?", "why_question": "Why is it not necessary for Step 8 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\nMust Step 8 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 968, "title": "spiced-guava-cake", "question_idx": 968, "steps": ["Preheat oven to 180 C / Gas 4.", "Grease and flour one 23x13cm loaf tin.", "Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.", "In another bowl, mix together guava pulp and juice.", "In another bowl, cream together butter and sugar.", "Add eggs, one at a time.", "Add flour mixture and guava mixture alternately to creamed mixture.", "Pour batter into prepared tin.", "Bake at 180 C / Gas 4 for 30-35 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 7 happen after Step 2?", "why_question": "Why is it not necessary for Step 7 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced-guava-cake\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Grease and flour one 23x13cm loaf tin.\n3. Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.\n4. In another bowl, mix together guava pulp and juice.\n5. In another bowl, cream together butter and sugar.\n6. Add eggs, one at a time.\n7. Add flour mixture and guava mixture alternately to creamed mixture.\n8. Pour batter into prepared tin.\n9. Bake at 180 C / Gas 4 for 30-35 minutes.\n\n\nMust Step 7 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 969, "title": "balsamic-and-mozzarella-chicken", "question_idx": 969, "steps": ["Place chicken in a shallow dish or large resealable plastic bag.", "Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.", "Coat a large frying pan lightly with oil, and set over low heat.", "Remove the chicken from the marinade and discard the marinade.", "Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.", "Arrange chicken on a serving platter.", "Place a generous slice of fresh mozzarella on top of each piece.", "Place a leaf of basil on top of the cheese, and cover with a slice of tomato.", "Drizzle balsamic vinegar over the platter, then season with salt and pepper.", "Serve!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 4 happen after Step 3?", "why_question": "Why is it not necessary for Step 4 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: balsamic-and-mozzarella-chicken\n\nProcedure:\n1. Place chicken in a shallow dish or large resealable plastic bag.\n2. Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.\n3. Coat a large frying pan lightly with oil, and set over low heat.\n4. Remove the chicken from the marinade and discard the marinade.\n5. Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.\n6. Arrange chicken on a serving platter.\n7. Place a generous slice of fresh mozzarella on top of each piece.\n8. Place a leaf of basil on top of the cheese, and cover with a slice of tomato.\n9. Drizzle balsamic vinegar over the platter, then season with salt and pepper.\n10. Serve!\n\n\nMust Step 4 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 970, "title": "cranachan", "question_idx": 970, "steps": ["Preheat the oven to 180 C / Gas mark 4.", "Spread oats out in a thin layer on a baking tray.", "Toast in the oven for about 10 minutes, or until lightly browned.", "Set aside to cool.", "Remove them from the tray for faster cooling.", "In a medium bowl, whip the cream to firm peaks.", "Gently fold in the icing sugar, vanilla and toasted oats.", "Spoon into 4 serving bowls, and top with fresh berries.", "For an extra touch, drizzle some whisky over each serving.", "Garnish with a mint leaf."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why is it not necessary for Step 6 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: cranachan\n\nProcedure:\n1. Preheat the oven to 180 C / Gas mark 4.\n2. Spread oats out in a thin layer on a baking tray.\n3. Toast in the oven for about 10 minutes, or until lightly browned.\n4. Set aside to cool.\n5. Remove them from the tray for faster cooling.\n6. In a medium bowl, whip the cream to firm peaks.\n7. Gently fold in the icing sugar, vanilla and toasted oats.\n8. Spoon into 4 serving bowls, and top with fresh berries.\n9. For an extra touch, drizzle some whisky over each serving.\n10. Garnish with a mint leaf.\n\n\nMust Step 6 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 971, "title": "chocolate-chocolate-cake", "question_idx": 971, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 10], "binary_question": "Must Step 11 happen after Step 7?", "why_question": "Why is it not necessary for Step 11 to happen after Step 7?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 11 happen after Step 7? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 972, "title": "fusilli-and-meatballs", "question_idx": 972, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 6], "binary_question": "Must Step 7 happen after Step 4?", "why_question": "Why is it not necessary for Step 7 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 7 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 973, "title": "fusilli-and-meatballs", "question_idx": 973, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 12], "binary_question": "Must Step 13 happen after Step 7?", "why_question": "Why is it not necessary for Step 13 to happen after Step 7?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 13 happen after Step 7? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 974, "title": "cloud-bread", "question_idx": 974, "steps": ["Preheat oven to 150 C / Gas mark 2.", "Line a baking tray with baking paper.", "Mix cream cheese and egg yolks together until smooth.", "Place egg whites and baking powder in a glass, metal, or ceramic bowl;", "beat together until stiff peaks form.", "Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.", "Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.", "Bake in the preheated oven until golden brown, 17 to 20 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 7 happen after Step 1?", "why_question": "Why is it not necessary for Step 7 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: cloud-bread\n\nProcedure:\n1. Preheat oven to 150 C / Gas mark 2.\n2. Line a baking tray with baking paper.\n3. Mix cream cheese and egg yolks together until smooth.\n4. Place egg whites and baking powder in a glass, metal, or ceramic bowl;\n5. beat together until stiff peaks form.\n6. Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.\n7. Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.\n8. Bake in the preheated oven until golden brown, 17 to 20 minutes.\n\n\nMust Step 7 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 975, "title": "green-tofu-curry", "question_idx": 975, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 10], "binary_question": "Must Step 11 happen after Step 3?", "why_question": "Why is it not necessary for Step 11 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\nMust Step 11 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 976, "title": "almond and apple cake", "question_idx": 976, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 4 happen after Step 3?", "why_question": "Why is it not necessary for Step 4 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\nMust Step 4 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 977, "title": "chicken and vegetable pie", "question_idx": 977, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 11], "binary_question": "Must Step 12 happen after Step 1?", "why_question": "Why is it not necessary for Step 12 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\nMust Step 12 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 978, "title": "spiced-guava-cake", "question_idx": 978, "steps": ["Preheat oven to 180 C / Gas 4.", "Grease and flour one 23x13cm loaf tin.", "Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.", "In another bowl, mix together guava pulp and juice.", "In another bowl, cream together butter and sugar.", "Add eggs, one at a time.", "Add flour mixture and guava mixture alternately to creamed mixture.", "Pour batter into prepared tin.", "Bake at 180 C / Gas 4 for 30-35 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 4 happen after Step 3?", "why_question": "Why is it not necessary for Step 4 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced-guava-cake\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Grease and flour one 23x13cm loaf tin.\n3. Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.\n4. In another bowl, mix together guava pulp and juice.\n5. In another bowl, cream together butter and sugar.\n6. Add eggs, one at a time.\n7. Add flour mixture and guava mixture alternately to creamed mixture.\n8. Pour batter into prepared tin.\n9. Bake at 180 C / Gas 4 for 30-35 minutes.\n\n\nMust Step 4 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 979, "title": "spanish-rabbit-stew", "question_idx": 979, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 5 happen after Step 2?", "why_question": "Why is it not necessary for Step 5 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\nMust Step 5 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 980, "title": "green-tofu-curry", "question_idx": 980, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why is it not necessary for Step 6 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\nMust Step 6 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 981, "title": "chocolate-chocolate-cake", "question_idx": 981, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [12, 18], "binary_question": "Must Step 19 happen after Step 13?", "why_question": "Why is it not necessary for Step 19 to happen after Step 13?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 19 happen after Step 13? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 982, "title": "spiced butternut squash soup", "question_idx": 982, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 10], "binary_question": "Must Step 11 happen after Step 3?", "why_question": "Why is it not necessary for Step 11 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\nMust Step 11 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "Yes", "model_answer": "Yes."}
{"plan_idx": 983, "title": "tangy-gammon-in-cider", "question_idx": 983, "steps": ["Preheat the oven to 200 degrees /gas mark 6.", "Start by piercing each tomato once and covering with boiling water to loosen the skins.", "Drain the onions and chop each one in half.", "Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.", "Put the onions, tomatoes and apples into a casserole dish.", "Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.", "Place in the dish and repeat with the other gammon steaks.", "Pour cider over the steaks, cover the top with a lid or tin foil.", "Cook for 1 hour."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why is it not necessary for Step 4 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: tangy-gammon-in-cider\n\nProcedure:\n1. Preheat the oven to 200 degrees /gas mark 6.\n2. Start by piercing each tomato once and covering with boiling water to loosen the skins.\n3. Drain the onions and chop each one in half.\n4. Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.\n5. Put the onions, tomatoes and apples into a casserole dish.\n6. Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.\n7. Place in the dish and repeat with the other gammon steaks.\n8. Pour cider over the steaks, cover the top with a lid or tin foil.\n9. Cook for 1 hour.\n\n\nMust Step 4 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 984, "title": "green-tofu-curry", "question_idx": 984, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 7], "binary_question": "Must Step 8 happen after Step 1?", "why_question": "Why is it not necessary for Step 8 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\nMust Step 8 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No", "model_answer": "No."}
{"plan_idx": 985, "title": "busters-liver-dinner", "question_idx": 985, "steps": ["Put all ingredients into a slow cooker, mix together.", "Put slow cooker on high for 4 to 5 hours or low all day.", "( If mixture starts to look too dry just add a little hot water.", ")", "Once cooked, divide between several plastic microwaveable tubs with lids.", "This mixture usually makes 6 to 7 meals, I freeze 4 and put the rest in the fridge.", "When ready to eat microwave with lid half off for 2 to 3 minutes on medium high."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 5 happen after Step 4?", "why_question": "Why is it not necessary for Step 5 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: busters-liver-dinner\n\nProcedure:\n1. Put all ingredients into a slow cooker, mix together.\n2. Put slow cooker on high for 4 to 5 hours or low all day.\n3. ( If mixture starts to look too dry just add a little hot water.\n4. )\n5. Once cooked, divide between several plastic microwaveable tubs with lids.\n6. This mixture usually makes 6 to 7 meals, I freeze 4 and put the rest in the fridge.\n7. When ready to eat microwave with lid half off for 2 to 3 minutes on medium high.\n\n\nMust Step 5 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes", "model_answer": "Yes."}
{"plan_idx": 986, "title": "warm-puy-lentil-and-tomato-salad", "question_idx": 986, "steps": ["Bring a large pan of water to the boil;", "add lentils and cook over low heat for 30 minutes.", "Put tomatoes in a small bowl and season with salt.", "Set aside for 15 minutes.", "Drain lentils and tomatoes and mix together.", "Distribute mixture evenly in 6 individual bowls or ramekins, sprinkle with chopped parsley and serve warm or chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 3 happen after Step 2?", "why_question": "Why is it not necessary for Step 3 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: warm-puy-lentil-and-tomato-salad\n\nProcedure:\n1. Bring a large pan of water to the boil;\n2. add lentils and cook over low heat for 30 minutes.\n3. Put tomatoes in a small bowl and season with salt.\n4. Set aside for 15 minutes.\n5. Drain lentils and tomatoes and mix together.\n6. Distribute mixture evenly in 6 individual bowls or ramekins, sprinkle with chopped parsley and serve warm or chilled.\n\n\nMust Step 3 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 987, "title": "spiced-pumpkin-teabread", "question_idx": 987, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 7 happen after Step 3?", "why_question": "Why is it not necessary for Step 7 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\nMust Step 7 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 988, "title": "cloud-bread", "question_idx": 988, "steps": ["Preheat oven to 150 C / Gas mark 2.", "Line a baking tray with baking paper.", "Mix cream cheese and egg yolks together until smooth.", "Place egg whites and baking powder in a glass, metal, or ceramic bowl;", "beat together until stiff peaks form.", "Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.", "Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.", "Bake in the preheated oven until golden brown, 17 to 20 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why is it not necessary for Step 4 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: cloud-bread\n\nProcedure:\n1. Preheat oven to 150 C / Gas mark 2.\n2. Line a baking tray with baking paper.\n3. Mix cream cheese and egg yolks together until smooth.\n4. Place egg whites and baking powder in a glass, metal, or ceramic bowl;\n5. beat together until stiff peaks form.\n6. Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.\n7. Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.\n8. Bake in the preheated oven until golden brown, 17 to 20 minutes.\n\n\nMust Step 4 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 989, "title": "chicken-prawn-and-rice-soup", "question_idx": 989, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 9], "binary_question": "Must Step 10 happen after Step 8?", "why_question": "Why is it not necessary for Step 10 to happen after Step 8?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\nMust Step 10 happen after Step 8? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 990, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 990, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [9, 12], "binary_question": "Must Step 13 happen after Step 10?", "why_question": "Why is it not necessary for Step 13 to happen after Step 10?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\nMust Step 13 happen after Step 10? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 991, "title": "chocolate-chocolate-cake", "question_idx": 991, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [13, 18], "binary_question": "Must Step 19 happen after Step 14?", "why_question": "Why is it not necessary for Step 19 to happen after Step 14?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 19 happen after Step 14? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 992, "title": "almost no fat banana bread", "question_idx": 992, "steps": ["Preheat oven to 180 C / Gas mark 4.", "Lightly grease a 20x10cm (8x4 in) loaf tin.", "In a large bowl, stir together flour, sugar, baking powder, bicarbonate of soda and cinnamon.", "Add egg whites, bananas and apple pur\u00c3\u00a9e; stir just until combined.", "Pour batter into prepared tin.", "Bake in preheated oven for 50 to 55 minutes, until a skewer inserted into centre of loaf comes out clean.", "Turn out onto wire rack and allow to cool before slicing."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 3 happen after Step 2?", "why_question": "Why is it not necessary for Step 3 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: almost no fat banana bread\n\nProcedure:\n1. Preheat oven to 180 C / Gas mark 4.\n2. Lightly grease a 20x10cm (8x4 in) loaf tin.\n3. In a large bowl, stir together flour, sugar, baking powder, bicarbonate of soda and cinnamon.\n4. Add egg whites, bananas and apple pur\u00c3\u00a9e; stir just until combined.\n5. Pour batter into prepared tin.\n6. Bake in preheated oven for 50 to 55 minutes, until a skewer inserted into centre of loaf comes out clean.\n7. Turn out onto wire rack and allow to cool before slicing.\n\n\nMust Step 3 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 993, "title": "fusilli-and-meatballs", "question_idx": 993, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 7], "binary_question": "Must Step 8 happen after Step 1?", "why_question": "Why is it not necessary for Step 8 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 8 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 994, "title": "vegetable-terrine", "question_idx": 994, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 7], "binary_question": "Must Step 8 happen after Step 2?", "why_question": "Why is it not necessary for Step 8 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\nMust Step 8 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 995, "title": "almost no fat banana bread", "question_idx": 995, "steps": ["Preheat oven to 180 C / Gas mark 4.", "Lightly grease a 20x10cm (8x4 in) loaf tin.", "In a large bowl, stir together flour, sugar, baking powder, bicarbonate of soda and cinnamon.", "Add egg whites, bananas and apple pur\u00c3\u00a9e; stir just until combined.", "Pour batter into prepared tin.", "Bake in preheated oven for 50 to 55 minutes, until a skewer inserted into centre of loaf comes out clean.", "Turn out onto wire rack and allow to cool before slicing."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why is it not necessary for Step 5 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: almost no fat banana bread\n\nProcedure:\n1. Preheat oven to 180 C / Gas mark 4.\n2. Lightly grease a 20x10cm (8x4 in) loaf tin.\n3. In a large bowl, stir together flour, sugar, baking powder, bicarbonate of soda and cinnamon.\n4. Add egg whites, bananas and apple pur\u00c3\u00a9e; stir just until combined.\n5. Pour batter into prepared tin.\n6. Bake in preheated oven for 50 to 55 minutes, until a skewer inserted into centre of loaf comes out clean.\n7. Turn out onto wire rack and allow to cool before slicing.\n\n\nMust Step 5 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 996, "title": "very-vanilla-ry-cheesecake", "question_idx": 996, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 7], "binary_question": "Must Step 8 happen after Step 4?", "why_question": "Why is it not necessary for Step 8 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\nMust Step 8 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 997, "title": "chocolate-chocolate-cake", "question_idx": 997, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [11, 13], "binary_question": "Must Step 14 happen after Step 12?", "why_question": "Why is it not necessary for Step 14 to happen after Step 12?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 14 happen after Step 12? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 998, "title": "almond and apple cake", "question_idx": 998, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 7], "binary_question": "Must Step 8 happen after Step 2?", "why_question": "Why is it not necessary for Step 8 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\nMust Step 8 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 999, "title": "spanish-rabbit-stew", "question_idx": 999, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 8], "binary_question": "Must Step 9 happen after Step 5?", "why_question": "Why is it not necessary for Step 9 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\nMust Step 9 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1000, "title": "chicken and vegetable pie", "question_idx": 1000, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 9], "binary_question": "Must Step 10 happen after Step 5?", "why_question": "Why is it not necessary for Step 10 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\nMust Step 10 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1001, "title": "tortellini-fritto-with-almond-butter", "question_idx": 1001, "steps": ["Bring a saucepan of water to the boil.", "Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.", "In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.", "If you slightly undercooked your tortellini then it's less likely to stick to the pan.", "Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.", "Continue to gently fry and stir the tortellini until golden brown.", "Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.", "Enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 4 happen after Step 3?", "why_question": "Why is it not necessary for Step 4 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: tortellini-fritto-with-almond-butter\n\nProcedure:\n1. Bring a saucepan of water to the boil.\n2. Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.\n3. In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.\n4. If you slightly undercooked your tortellini then it's less likely to stick to the pan.\n5. Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.\n6. Continue to gently fry and stir the tortellini until golden brown.\n7. Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.\n8. Enjoy!\n\n\nMust Step 4 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "Yes", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1002, "title": "spicy-tomato-anchovy-pasta", "question_idx": 1002, "steps": ["Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;", "cook until lightly browned.", "Add anchovies and water, cover and simmer for 4 to 5 minutes.", "Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.", "While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.", "Add linguine and cook until al dente, about 7 to 8 minutes;", "drain.", "Toss with anchovy mixture and chilli flakes.", "If desired, season with black pepper.", "Serve immediately."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 6], "binary_question": "Must Step 7 happen after Step 4?", "why_question": "Why is it not necessary for Step 7 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spicy-tomato-anchovy-pasta\n\nProcedure:\n1. Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;\n2. cook until lightly browned.\n3. Add anchovies and water, cover and simmer for 4 to 5 minutes.\n4. Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.\n5. While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.\n6. Add linguine and cook until al dente, about 7 to 8 minutes;\n7. drain.\n8. Toss with anchovy mixture and chilli flakes.\n9. If desired, season with black pepper.\n10. Serve immediately.\n\n\nMust Step 7 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1003, "title": "spiced-guava-cake", "question_idx": 1003, "steps": ["Preheat oven to 180 C / Gas 4.", "Grease and flour one 23x13cm loaf tin.", "Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.", "In another bowl, mix together guava pulp and juice.", "In another bowl, cream together butter and sugar.", "Add eggs, one at a time.", "Add flour mixture and guava mixture alternately to creamed mixture.", "Pour batter into prepared tin.", "Bake at 180 C / Gas 4 for 30-35 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why is it not necessary for Step 6 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced-guava-cake\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Grease and flour one 23x13cm loaf tin.\n3. Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.\n4. In another bowl, mix together guava pulp and juice.\n5. In another bowl, cream together butter and sugar.\n6. Add eggs, one at a time.\n7. Add flour mixture and guava mixture alternately to creamed mixture.\n8. Pour batter into prepared tin.\n9. Bake at 180 C / Gas 4 for 30-35 minutes.\n\n\nMust Step 6 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1004, "title": "spanish-rabbit-stew", "question_idx": 1004, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 7 happen after Step 6?", "why_question": "Why is it not necessary for Step 7 to happen after Step 6?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\nMust Step 7 happen after Step 6? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes", "trial_2_answer": "Yes", "model_answer": "Yes."}
{"plan_idx": 1005, "title": "fusilli-and-meatballs", "question_idx": 1005, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 11], "binary_question": "Must Step 12 happen after Step 6?", "why_question": "Why is it not necessary for Step 12 to happen after Step 6?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 12 happen after Step 6? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1006, "title": "almond and apple cake", "question_idx": 1006, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 8], "binary_question": "Must Step 9 happen after Step 3?", "why_question": "Why is it not necessary for Step 9 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\nMust Step 9 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1007, "title": "chocolate-chocolate-cake", "question_idx": 1007, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 18], "binary_question": "Must Step 19 happen after Step 5?", "why_question": "Why is it not necessary for Step 19 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 19 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1008, "title": "very-vanilla-ry-cheesecake", "question_idx": 1008, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [8, 9], "binary_question": "Must Step 10 happen after Step 9?", "why_question": "Why is it not necessary for Step 10 to happen after Step 9?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\nMust Step 10 happen after Step 9? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1009, "title": "chicken-prawn-and-rice-soup", "question_idx": 1009, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 10], "binary_question": "Must Step 11 happen after Step 8?", "why_question": "Why is it not necessary for Step 11 to happen after Step 8?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\nMust Step 11 happen after Step 8? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1010, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1010, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 10], "binary_question": "Must Step 11 happen after Step 7?", "why_question": "Why is it not necessary for Step 11 to happen after Step 7?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\nMust Step 11 happen after Step 7? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1011, "title": "chocolate-chocolate-cake", "question_idx": 1011, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 11], "binary_question": "Must Step 12 happen after Step 5?", "why_question": "Why is it not necessary for Step 12 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 12 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1012, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1012, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 11], "binary_question": "Must Step 12 happen after Step 5?", "why_question": "Why is it not necessary for Step 12 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\nMust Step 12 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1013, "title": "spanish-rabbit-stew", "question_idx": 1013, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 7], "binary_question": "Must Step 8 happen after Step 5?", "why_question": "Why is it not necessary for Step 8 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\nMust Step 8 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No", "model_answer": "No."}
{"plan_idx": 1014, "title": "fusilli-and-meatballs", "question_idx": 1014, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 15], "binary_question": "Must Step 16 happen after Step 8?", "why_question": "Why is it not necessary for Step 16 to happen after Step 8?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 16 happen after Step 8? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1015, "title": "chocolate-chocolate-cake", "question_idx": 1015, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 11], "binary_question": "Must Step 12 happen after Step 3?", "why_question": "Why is it not necessary for Step 12 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 12 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1016, "title": "spiced butternut squash soup", "question_idx": 1016, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 7 happen after Step 3?", "why_question": "Why is it not necessary for Step 7 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\nMust Step 7 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1017, "title": "fusilli-and-meatballs", "question_idx": 1017, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [8, 12], "binary_question": "Must Step 13 happen after Step 9?", "why_question": "Why is it not necessary for Step 13 to happen after Step 9?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 13 happen after Step 9? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1018, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1018, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 12], "binary_question": "Must Step 13 happen after Step 1?", "why_question": "Why is it not necessary for Step 13 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\nMust Step 13 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1019, "title": "chicken and vegetable pie", "question_idx": 1019, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 9], "binary_question": "Must Step 10 happen after Step 6?", "why_question": "Why is it not necessary for Step 10 to happen after Step 6?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\nMust Step 10 happen after Step 6? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1020, "title": "almond and apple cake", "question_idx": 1020, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 7], "binary_question": "Must Step 8 happen after Step 1?", "why_question": "Why is it not necessary for Step 8 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\nMust Step 8 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1021, "title": "vegetable-terrine", "question_idx": 1021, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why is it not necessary for Step 5 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\nMust Step 5 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1022, "title": "very-vanilla-ry-cheesecake", "question_idx": 1022, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why is it not necessary for Step 6 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\nMust Step 6 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1023, "title": "spanish-rabbit-stew", "question_idx": 1023, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 10], "binary_question": "Must Step 11 happen after Step 8?", "why_question": "Why is it not necessary for Step 11 to happen after Step 8?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\nMust Step 11 happen after Step 8? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1024, "title": "feta-and-sundried-tomato-spinach-rolls", "question_idx": 1024, "steps": ["Preheat grill.", "Mix together cream cheese, feta, sundried tomatoes, basil and garlic.", "Stir until creamy, with no lumps.", "Blanch the spinach leaves.", "Wrap a dollop of cheese mix in each spinach leaf.", "Brush with olive oil.", "Sprinkle almonds on the top or alternately roll them in the almonds", "Grill spinach rolls until slightly crispy on top.", "Let cool for 10 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why is it not necessary for Step 2 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: feta-and-sundried-tomato-spinach-rolls\n\nProcedure:\n1. Preheat grill.\n2. Mix together cream cheese, feta, sundried tomatoes, basil and garlic.\n3. Stir until creamy, with no lumps.\n4. Blanch the spinach leaves.\n5. Wrap a dollop of cheese mix in each spinach leaf.\n6. Brush with olive oil.\n7. Sprinkle almonds on the top or alternately roll them in the almonds\n8. Grill spinach rolls until slightly crispy on top.\n9. Let cool for 10 minutes.\n\n\nMust Step 2 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1025, "title": "chocolate-chocolate-cake", "question_idx": 1025, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 11], "binary_question": "Must Step 12 happen after Step 4?", "why_question": "Why is it not necessary for Step 12 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 12 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1026, "title": "spiced butternut squash soup", "question_idx": 1026, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 8], "binary_question": "Must Step 9 happen after Step 6?", "why_question": "Why is it not necessary for Step 9 to happen after Step 6?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\nMust Step 9 happen after Step 6? Select between yes or no\n\n", "trial_0_answer": "Yes", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1027, "title": "tangy-gammon-in-cider", "question_idx": 1027, "steps": ["Preheat the oven to 200 degrees /gas mark 6.", "Start by piercing each tomato once and covering with boiling water to loosen the skins.", "Drain the onions and chop each one in half.", "Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.", "Put the onions, tomatoes and apples into a casserole dish.", "Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.", "Place in the dish and repeat with the other gammon steaks.", "Pour cider over the steaks, cover the top with a lid or tin foil.", "Cook for 1 hour."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why is it not necessary for Step 2 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: tangy-gammon-in-cider\n\nProcedure:\n1. Preheat the oven to 200 degrees /gas mark 6.\n2. Start by piercing each tomato once and covering with boiling water to loosen the skins.\n3. Drain the onions and chop each one in half.\n4. Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.\n5. Put the onions, tomatoes and apples into a casserole dish.\n6. Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.\n7. Place in the dish and repeat with the other gammon steaks.\n8. Pour cider over the steaks, cover the top with a lid or tin foil.\n9. Cook for 1 hour.\n\n\nMust Step 2 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1028, "title": "green-tofu-curry", "question_idx": 1028, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 9], "binary_question": "Must Step 10 happen after Step 6?", "why_question": "Why is it not necessary for Step 10 to happen after Step 6?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\nMust Step 10 happen after Step 6? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1029, "title": "spicy-tomato-anchovy-pasta", "question_idx": 1029, "steps": ["Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;", "cook until lightly browned.", "Add anchovies and water, cover and simmer for 4 to 5 minutes.", "Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.", "While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.", "Add linguine and cook until al dente, about 7 to 8 minutes;", "drain.", "Toss with anchovy mixture and chilli flakes.", "If desired, season with black pepper.", "Serve immediately."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why is it not necessary for Step 5 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spicy-tomato-anchovy-pasta\n\nProcedure:\n1. Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;\n2. cook until lightly browned.\n3. Add anchovies and water, cover and simmer for 4 to 5 minutes.\n4. Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.\n5. While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.\n6. Add linguine and cook until al dente, about 7 to 8 minutes;\n7. drain.\n8. Toss with anchovy mixture and chilli flakes.\n9. If desired, season with black pepper.\n10. Serve immediately.\n\n\nMust Step 5 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1030, "title": "spanish-rabbit-stew", "question_idx": 1030, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 8], "binary_question": "Must Step 9 happen after Step 6?", "why_question": "Why is it not necessary for Step 9 to happen after Step 6?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\nMust Step 9 happen after Step 6? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1031, "title": "strawberry-tiramisu-trifle", "question_idx": 1031, "steps": ["Set 3 strawberries for the garnish aside, and cut the rest into slices.", "In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.", "Then stir in the custard and finally fold in the whipped cream.", "Brush the sponge fingers with the remaining coffee.", "Line a glass bowl with one layer of the soaked sponge fingers.", "Spread half of the strawberries over the sponge fingers.", "Sprinkle half of the grated chocolate over that and then half of the custard mixture.", "Repeat the layers in order again.", "Cut the remaining 3 strawberries in half and lay them on top of the trifle.", "Cover and leave in the fridge for at least 4 hours, best overnight."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 6 happen after Step 3?", "why_question": "Why is it not necessary for Step 6 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: strawberry-tiramisu-trifle\n\nProcedure:\n1. Set 3 strawberries for the garnish aside, and cut the rest into slices.\n2. In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.\n3. Then stir in the custard and finally fold in the whipped cream.\n4. Brush the sponge fingers with the remaining coffee.\n5. Line a glass bowl with one layer of the soaked sponge fingers.\n6. Spread half of the strawberries over the sponge fingers.\n7. Sprinkle half of the grated chocolate over that and then half of the custard mixture.\n8. Repeat the layers in order again.\n9. Cut the remaining 3 strawberries in half and lay them on top of the trifle.\n10. Cover and leave in the fridge for at least 4 hours, best overnight.\n\n\nMust Step 6 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1032, "title": "chocolate-pancake-batter", "question_idx": 1032, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why is it not necessary for Step 6 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\nMust Step 6 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1033, "title": "fusilli-and-meatballs", "question_idx": 1033, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 5 happen after Step 2?", "why_question": "Why is it not necessary for Step 5 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 5 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1034, "title": "chocolate-chocolate-cake", "question_idx": 1034, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 6 happen after Step 5?", "why_question": "Why is it not necessary for Step 6 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 6 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1035, "title": "spanish-rabbit-stew", "question_idx": 1035, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 9], "binary_question": "Must Step 10 happen after Step 6?", "why_question": "Why is it not necessary for Step 10 to happen after Step 6?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\nMust Step 10 happen after Step 6? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1036, "title": "spiced-guava-cake", "question_idx": 1036, "steps": ["Preheat oven to 180 C / Gas 4.", "Grease and flour one 23x13cm loaf tin.", "Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.", "In another bowl, mix together guava pulp and juice.", "In another bowl, cream together butter and sugar.", "Add eggs, one at a time.", "Add flour mixture and guava mixture alternately to creamed mixture.", "Pour batter into prepared tin.", "Bake at 180 C / Gas 4 for 30-35 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 6 happen after Step 3?", "why_question": "Why is it not necessary for Step 6 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced-guava-cake\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Grease and flour one 23x13cm loaf tin.\n3. Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.\n4. In another bowl, mix together guava pulp and juice.\n5. In another bowl, cream together butter and sugar.\n6. Add eggs, one at a time.\n7. Add flour mixture and guava mixture alternately to creamed mixture.\n8. Pour batter into prepared tin.\n9. Bake at 180 C / Gas 4 for 30-35 minutes.\n\n\nMust Step 6 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No", "model_answer": "No."}
{"plan_idx": 1037, "title": "spiced-guava-cake", "question_idx": 1037, "steps": ["Preheat oven to 180 C / Gas 4.", "Grease and flour one 23x13cm loaf tin.", "Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.", "In another bowl, mix together guava pulp and juice.", "In another bowl, cream together butter and sugar.", "Add eggs, one at a time.", "Add flour mixture and guava mixture alternately to creamed mixture.", "Pour batter into prepared tin.", "Bake at 180 C / Gas 4 for 30-35 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 5], "binary_question": "Must Step 6 happen after Step 4?", "why_question": "Why is it not necessary for Step 6 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced-guava-cake\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Grease and flour one 23x13cm loaf tin.\n3. Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.\n4. In another bowl, mix together guava pulp and juice.\n5. In another bowl, cream together butter and sugar.\n6. Add eggs, one at a time.\n7. Add flour mixture and guava mixture alternately to creamed mixture.\n8. Pour batter into prepared tin.\n9. Bake at 180 C / Gas 4 for 30-35 minutes.\n\n\nMust Step 6 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1038, "title": "green-tofu-curry", "question_idx": 1038, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 9], "binary_question": "Must Step 10 happen after Step 7?", "why_question": "Why is it not necessary for Step 10 to happen after Step 7?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\nMust Step 10 happen after Step 7? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1039, "title": "vegetable-terrine", "question_idx": 1039, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 9], "binary_question": "Must Step 10 happen after Step 8?", "why_question": "Why is it not necessary for Step 10 to happen after Step 8?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\nMust Step 10 happen after Step 8? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1040, "title": "lamb-curry--serves-4-", "question_idx": 1040, "steps": ["Blend the garlic, ginger and one of the onions in a food processor then mix with the curry paste.", "Fry the lamb in a little oil, then add the remaining onion.", "Gently fry for a minute, then add the paste and cook for a couple of minutes.", "Add the water, tin of tomatoes, sugar, mushrooms and potatoes, and gently simmer covered for a few hours, until everything is tender.", "Add the two fresh tomatoes and the spinach and cook for a couple of minutes, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why is it not necessary for Step 2 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lamb-curry--serves-4-\n\nProcedure:\n1. Blend the garlic, ginger and one of the onions in a food processor then mix with the curry paste.\n2. Fry the lamb in a little oil, then add the remaining onion.\n3. Gently fry for a minute, then add the paste and cook for a couple of minutes.\n4. Add the water, tin of tomatoes, sugar, mushrooms and potatoes, and gently simmer covered for a few hours, until everything is tender.\n5. Add the two fresh tomatoes and the spinach and cook for a couple of minutes, then serve.\n\n\nMust Step 2 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1041, "title": "chocolate-chocolate-cake", "question_idx": 1041, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 6 happen after Step 3?", "why_question": "Why is it not necessary for Step 6 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 6 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1042, "title": "chocolate-chocolate-cake", "question_idx": 1042, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [10, 13], "binary_question": "Must Step 14 happen after Step 11?", "why_question": "Why is it not necessary for Step 14 to happen after Step 11?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 14 happen after Step 11? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1043, "title": "tangy-gammon-in-cider", "question_idx": 1043, "steps": ["Preheat the oven to 200 degrees /gas mark 6.", "Start by piercing each tomato once and covering with boiling water to loosen the skins.", "Drain the onions and chop each one in half.", "Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.", "Put the onions, tomatoes and apples into a casserole dish.", "Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.", "Place in the dish and repeat with the other gammon steaks.", "Pour cider over the steaks, cover the top with a lid or tin foil.", "Cook for 1 hour."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 3 happen after Step 2?", "why_question": "Why is it not necessary for Step 3 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: tangy-gammon-in-cider\n\nProcedure:\n1. Preheat the oven to 200 degrees /gas mark 6.\n2. Start by piercing each tomato once and covering with boiling water to loosen the skins.\n3. Drain the onions and chop each one in half.\n4. Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.\n5. Put the onions, tomatoes and apples into a casserole dish.\n6. Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.\n7. Place in the dish and repeat with the other gammon steaks.\n8. Pour cider over the steaks, cover the top with a lid or tin foil.\n9. Cook for 1 hour.\n\n\nMust Step 3 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1044, "title": "almond and apple cake", "question_idx": 1044, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 10], "binary_question": "Must Step 11 happen after Step 1?", "why_question": "Why is it not necessary for Step 11 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\nMust Step 11 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1045, "title": "chocolate-chocolate-cake", "question_idx": 1045, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 7], "binary_question": "Must Step 8 happen after Step 4?", "why_question": "Why is it not necessary for Step 8 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 8 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1046, "title": "spiced-guava-cake", "question_idx": 1046, "steps": ["Preheat oven to 180 C / Gas 4.", "Grease and flour one 23x13cm loaf tin.", "Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.", "In another bowl, mix together guava pulp and juice.", "In another bowl, cream together butter and sugar.", "Add eggs, one at a time.", "Add flour mixture and guava mixture alternately to creamed mixture.", "Pour batter into prepared tin.", "Bake at 180 C / Gas 4 for 30-35 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why is it not necessary for Step 2 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced-guava-cake\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Grease and flour one 23x13cm loaf tin.\n3. Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.\n4. In another bowl, mix together guava pulp and juice.\n5. In another bowl, cream together butter and sugar.\n6. Add eggs, one at a time.\n7. Add flour mixture and guava mixture alternately to creamed mixture.\n8. Pour batter into prepared tin.\n9. Bake at 180 C / Gas 4 for 30-35 minutes.\n\n\nMust Step 2 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "Yes", "model_answer": "Yes."}
{"plan_idx": 1047, "title": "very-vanilla-ry-cheesecake", "question_idx": 1047, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why is it not necessary for Step 4 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\nMust Step 4 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1048, "title": "chicken-prawn-and-rice-soup", "question_idx": 1048, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 9], "binary_question": "Must Step 10 happen after Step 1?", "why_question": "Why is it not necessary for Step 10 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\nMust Step 10 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1049, "title": "spanish-rabbit-stew", "question_idx": 1049, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 9], "binary_question": "Must Step 10 happen after Step 5?", "why_question": "Why is it not necessary for Step 10 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\nMust Step 10 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1050, "title": "chocolate-chocolate-cake", "question_idx": 1050, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 15], "binary_question": "Must Step 16 happen after Step 1?", "why_question": "Why is it not necessary for Step 16 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 16 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1051, "title": "vegetable-terrine", "question_idx": 1051, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 9], "binary_question": "Must Step 10 happen after Step 6?", "why_question": "Why is it not necessary for Step 10 to happen after Step 6?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\nMust Step 10 happen after Step 6? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1052, "title": "very-vanilla-ry-cheesecake", "question_idx": 1052, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 7 happen after Step 3?", "why_question": "Why is it not necessary for Step 7 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\nMust Step 7 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1053, "title": "vegetable-terrine", "question_idx": 1053, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 9], "binary_question": "Must Step 10 happen after Step 3?", "why_question": "Why is it not necessary for Step 10 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\nMust Step 10 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1054, "title": "chicken-prawn-and-rice-soup", "question_idx": 1054, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 10], "binary_question": "Must Step 11 happen after Step 5?", "why_question": "Why is it not necessary for Step 11 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\nMust Step 11 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1055, "title": "spiced butternut squash soup", "question_idx": 1055, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 7], "binary_question": "Must Step 8 happen after Step 4?", "why_question": "Why is it not necessary for Step 8 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\nMust Step 8 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1056, "title": "chicken and vegetable pie", "question_idx": 1056, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 9], "binary_question": "Must Step 10 happen after Step 3?", "why_question": "Why is it not necessary for Step 10 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\nMust Step 10 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "No", "model_answer": "No."}
{"plan_idx": 1057, "title": "spanish-rabbit-stew", "question_idx": 1057, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 9], "binary_question": "Must Step 10 happen after Step 8?", "why_question": "Why is it not necessary for Step 10 to happen after Step 8?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\nMust Step 10 happen after Step 8? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1058, "title": "spiced-guava-cake", "question_idx": 1058, "steps": ["Preheat oven to 180 C / Gas 4.", "Grease and flour one 23x13cm loaf tin.", "Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.", "In another bowl, mix together guava pulp and juice.", "In another bowl, cream together butter and sugar.", "Add eggs, one at a time.", "Add flour mixture and guava mixture alternately to creamed mixture.", "Pour batter into prepared tin.", "Bake at 180 C / Gas 4 for 30-35 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 7 happen after Step 1?", "why_question": "Why is it not necessary for Step 7 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced-guava-cake\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Grease and flour one 23x13cm loaf tin.\n3. Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.\n4. In another bowl, mix together guava pulp and juice.\n5. In another bowl, cream together butter and sugar.\n6. Add eggs, one at a time.\n7. Add flour mixture and guava mixture alternately to creamed mixture.\n8. Pour batter into prepared tin.\n9. Bake at 180 C / Gas 4 for 30-35 minutes.\n\n\nMust Step 7 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1059, "title": "chicken and vegetable pie", "question_idx": 1059, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why is it not necessary for Step 5 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\nMust Step 5 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1060, "title": "strawberry-tiramisu-trifle", "question_idx": 1060, "steps": ["Set 3 strawberries for the garnish aside, and cut the rest into slices.", "In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.", "Then stir in the custard and finally fold in the whipped cream.", "Brush the sponge fingers with the remaining coffee.", "Line a glass bowl with one layer of the soaked sponge fingers.", "Spread half of the strawberries over the sponge fingers.", "Sprinkle half of the grated chocolate over that and then half of the custard mixture.", "Repeat the layers in order again.", "Cut the remaining 3 strawberries in half and lay them on top of the trifle.", "Cover and leave in the fridge for at least 4 hours, best overnight."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 5 happen after Step 3?", "why_question": "Why is it not necessary for Step 5 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: strawberry-tiramisu-trifle\n\nProcedure:\n1. Set 3 strawberries for the garnish aside, and cut the rest into slices.\n2. In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.\n3. Then stir in the custard and finally fold in the whipped cream.\n4. Brush the sponge fingers with the remaining coffee.\n5. Line a glass bowl with one layer of the soaked sponge fingers.\n6. Spread half of the strawberries over the sponge fingers.\n7. Sprinkle half of the grated chocolate over that and then half of the custard mixture.\n8. Repeat the layers in order again.\n9. Cut the remaining 3 strawberries in half and lay them on top of the trifle.\n10. Cover and leave in the fridge for at least 4 hours, best overnight.\n\n\nMust Step 5 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1061, "title": "spanish-rabbit-stew", "question_idx": 1061, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 5 happen after Step 3?", "why_question": "Why is it not necessary for Step 5 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\nMust Step 5 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1062, "title": "chocolate-chocolate-cake", "question_idx": 1062, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 13], "binary_question": "Must Step 14 happen after Step 6?", "why_question": "Why is it not necessary for Step 14 to happen after Step 6?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 14 happen after Step 6? Select between yes or no\n\n", "trial_0_answer": "No", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1063, "title": "cloud-bread", "question_idx": 1063, "steps": ["Preheat oven to 150 C / Gas mark 2.", "Line a baking tray with baking paper.", "Mix cream cheese and egg yolks together until smooth.", "Place egg whites and baking powder in a glass, metal, or ceramic bowl;", "beat together until stiff peaks form.", "Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.", "Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.", "Bake in the preheated oven until golden brown, 17 to 20 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why is it not necessary for Step 5 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: cloud-bread\n\nProcedure:\n1. Preheat oven to 150 C / Gas mark 2.\n2. Line a baking tray with baking paper.\n3. Mix cream cheese and egg yolks together until smooth.\n4. Place egg whites and baking powder in a glass, metal, or ceramic bowl;\n5. beat together until stiff peaks form.\n6. Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.\n7. Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.\n8. Bake in the preheated oven until golden brown, 17 to 20 minutes.\n\n\nMust Step 5 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1064, "title": "spanish-rabbit-stew", "question_idx": 1064, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why is it not necessary for Step 2 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\nMust Step 2 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes", "trial_1_answer": "Yes", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1065, "title": "chocolate-chocolate-cake", "question_idx": 1065, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 11], "binary_question": "Must Step 12 happen after Step 6?", "why_question": "Why is it not necessary for Step 12 to happen after Step 6?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 12 happen after Step 6? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1066, "title": "fusilli-and-meatballs", "question_idx": 1066, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [9, 14], "binary_question": "Must Step 15 happen after Step 10?", "why_question": "Why is it not necessary for Step 15 to happen after Step 10?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 15 happen after Step 10? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1067, "title": "kid-s-cheese-and-veg-kebab", "question_idx": 1067, "steps": ["Shave the carrots into wide ribbons / waves using a potato peeler.", "Cut the red pepper into star shapes using a star cookie cutter.", "Cut the bread into flowers using a cookie cutter.", "Assemble all onto a skewer with bread flowers top and bottom and carrot curls, cheesy chunks and pepper stars seen as layers between."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 3 happen after Step 2?", "why_question": "Why is it not necessary for Step 3 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: kid-s-cheese-and-veg-kebab\n\nProcedure:\n1. Shave the carrots into wide ribbons / waves using a potato peeler.\n2. Cut the red pepper into star shapes using a star cookie cutter.\n3. Cut the bread into flowers using a cookie cutter.\n4. Assemble all onto a skewer with bread flowers top and bottom and carrot curls, cheesy chunks and pepper stars seen as layers between.\n\n\nMust Step 3 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1068, "title": "spanish-rabbit-stew", "question_idx": 1068, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 3 happen after Step 2?", "why_question": "Why is it not necessary for Step 3 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\nMust Step 3 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "Yes", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1069, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1069, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 10], "binary_question": "Must Step 11 happen after Step 3?", "why_question": "Why is it not necessary for Step 11 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\nMust Step 11 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1070, "title": "spiced butternut squash soup", "question_idx": 1070, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 9], "binary_question": "Must Step 10 happen after Step 6?", "why_question": "Why is it not necessary for Step 10 to happen after Step 6?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\nMust Step 10 happen after Step 6? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1071, "title": "chocolate-chocolate-cake", "question_idx": 1071, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 7 happen after Step 2?", "why_question": "Why is it not necessary for Step 7 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 7 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1072, "title": "banana-split-cake", "question_idx": 1072, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 7 happen after Step 1?", "why_question": "Why is it not necessary for Step 7 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\nMust Step 7 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1073, "title": "fusilli-and-meatballs", "question_idx": 1073, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 18], "binary_question": "Must Step 19 happen after Step 7?", "why_question": "Why is it not necessary for Step 19 to happen after Step 7?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 19 happen after Step 7? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1074, "title": "green-tofu-curry", "question_idx": 1074, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 10], "binary_question": "Must Step 11 happen after Step 2?", "why_question": "Why is it not necessary for Step 11 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\nMust Step 11 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1075, "title": "chocolate-pancake-batter", "question_idx": 1075, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 5 happen after Step 3?", "why_question": "Why is it not necessary for Step 5 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\nMust Step 5 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1076, "title": "green-tofu-curry", "question_idx": 1076, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 6 happen after Step 3?", "why_question": "Why is it not necessary for Step 6 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\nMust Step 6 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1077, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1077, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 10], "binary_question": "Must Step 11 happen after Step 1?", "why_question": "Why is it not necessary for Step 11 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\nMust Step 11 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1078, "title": "lightly spiced tomato and red lentil soup", "question_idx": 1078, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 8], "binary_question": "Must Step 9 happen after Step 7?", "why_question": "Why is it not necessary for Step 9 to happen after Step 7?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\nMust Step 9 happen after Step 7? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1079, "title": "very-vanilla-ry-cheesecake", "question_idx": 1079, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 9], "binary_question": "Must Step 10 happen after Step 2?", "why_question": "Why is it not necessary for Step 10 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\nMust Step 10 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1080, "title": "simple-basic-cupcakes", "question_idx": 1080, "steps": ["Preheat oven to 180 C / Gas 4.", "Beat butter and sugar together until light and fluffy.", "Add the eggs, one at a time, beating after each addition.", "If the batter is too thick, stir in some milk.", "Gradually add the flour, mixing well each time until evenly mixed.", "Spoon tablespoons of batter into a greased muffin tin.", "Bake in preheated oven for 15-20 minutes.", "The cake is done when a skewer inserted to the cake comes out clean.", "Let rest for fives minutes, then allow to cool fully on a wire rack.", "Decorate, if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why is it not necessary for Step 6 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: simple-basic-cupcakes\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Beat butter and sugar together until light and fluffy.\n3. Add the eggs, one at a time, beating after each addition.\n4. If the batter is too thick, stir in some milk.\n5. Gradually add the flour, mixing well each time until evenly mixed.\n6. Spoon tablespoons of batter into a greased muffin tin.\n7. Bake in preheated oven for 15-20 minutes.\n8. The cake is done when a skewer inserted to the cake comes out clean.\n9. Let rest for fives minutes, then allow to cool fully on a wire rack.\n10. Decorate, if desired.\n\n\nMust Step 6 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1081, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1081, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [8, 11], "binary_question": "Must Step 12 happen after Step 9?", "why_question": "Why is it not necessary for Step 12 to happen after Step 9?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\nMust Step 12 happen after Step 9? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1082, "title": "spiced butternut squash soup", "question_idx": 1082, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 7 happen after Step 2?", "why_question": "Why is it not necessary for Step 7 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\nMust Step 7 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1083, "title": "green-tofu-curry", "question_idx": 1083, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 5 happen after Step 4?", "why_question": "Why is it not necessary for Step 5 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\nMust Step 5 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1084, "title": "fusilli-and-meatballs", "question_idx": 1084, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [13, 18], "binary_question": "Must Step 19 happen after Step 14?", "why_question": "Why is it not necessary for Step 19 to happen after Step 14?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 19 happen after Step 14? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1085, "title": "feta-and-sundried-tomato-spinach-rolls", "question_idx": 1085, "steps": ["Preheat grill.", "Mix together cream cheese, feta, sundried tomatoes, basil and garlic.", "Stir until creamy, with no lumps.", "Blanch the spinach leaves.", "Wrap a dollop of cheese mix in each spinach leaf.", "Brush with olive oil.", "Sprinkle almonds on the top or alternately roll them in the almonds", "Grill spinach rolls until slightly crispy on top.", "Let cool for 10 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why is it not necessary for Step 5 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: feta-and-sundried-tomato-spinach-rolls\n\nProcedure:\n1. Preheat grill.\n2. Mix together cream cheese, feta, sundried tomatoes, basil and garlic.\n3. Stir until creamy, with no lumps.\n4. Blanch the spinach leaves.\n5. Wrap a dollop of cheese mix in each spinach leaf.\n6. Brush with olive oil.\n7. Sprinkle almonds on the top or alternately roll them in the almonds\n8. Grill spinach rolls until slightly crispy on top.\n9. Let cool for 10 minutes.\n\n\nMust Step 5 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1086, "title": "fusilli-and-meatballs", "question_idx": 1086, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 18], "binary_question": "Must Step 19 happen after Step 4?", "why_question": "Why is it not necessary for Step 19 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 19 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1087, "title": "chicken-prawn-and-rice-soup", "question_idx": 1087, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 9], "binary_question": "Must Step 10 happen after Step 4?", "why_question": "Why is it not necessary for Step 10 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\nMust Step 10 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1088, "title": "green-tofu-curry", "question_idx": 1088, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 9], "binary_question": "Must Step 10 happen after Step 1?", "why_question": "Why is it not necessary for Step 10 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\nMust Step 10 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1089, "title": "chicken and vegetable pie", "question_idx": 1089, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 5 happen after Step 3?", "why_question": "Why is it not necessary for Step 5 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\nMust Step 5 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1090, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1090, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [12, 13], "binary_question": "Must Step 14 happen after Step 13?", "why_question": "Why is it not necessary for Step 14 to happen after Step 13?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\nMust Step 14 happen after Step 13? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1091, "title": "spiced butternut squash soup", "question_idx": 1091, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 7 happen after Step 6?", "why_question": "Why is it not necessary for Step 7 to happen after Step 6?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\nMust Step 7 happen after Step 6? Select between yes or no\n\n", "trial_0_answer": "Yes", "trial_1_answer": "Yes.", "trial_2_answer": "Yes", "model_answer": "Yes."}
{"plan_idx": 1092, "title": "green-tofu-curry", "question_idx": 1092, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 5 happen after Step 3?", "why_question": "Why is it not necessary for Step 5 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\nMust Step 5 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1093, "title": "no-sugar-rock-cakes", "question_idx": 1093, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why is it not necessary for Step 5 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\nMust Step 5 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1094, "title": "banana-split-cake", "question_idx": 1094, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 6], "binary_question": "Must Step 7 happen after Step 4?", "why_question": "Why is it not necessary for Step 7 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\nMust Step 7 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1095, "title": "lightly spiced tomato and red lentil soup", "question_idx": 1095, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 10], "binary_question": "Must Step 11 happen after Step 7?", "why_question": "Why is it not necessary for Step 11 to happen after Step 7?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\nMust Step 11 happen after Step 7? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1096, "title": "spiced-pumpkin-teabread", "question_idx": 1096, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 7], "binary_question": "Must Step 8 happen after Step 1?", "why_question": "Why is it not necessary for Step 8 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\nMust Step 8 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1097, "title": "spiced butternut squash soup", "question_idx": 1097, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 9], "binary_question": "Must Step 10 happen after Step 2?", "why_question": "Why is it not necessary for Step 10 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\nMust Step 10 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1098, "title": "chicken and vegetable pie", "question_idx": 1098, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 7], "binary_question": "Must Step 8 happen after Step 2?", "why_question": "Why is it not necessary for Step 8 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\nMust Step 8 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1099, "title": "spiced butternut squash soup", "question_idx": 1099, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 8], "binary_question": "Must Step 9 happen after Step 2?", "why_question": "Why is it not necessary for Step 9 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\nMust Step 9 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1100, "title": "spiced butternut squash soup", "question_idx": 1100, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 9], "binary_question": "Must Step 10 happen after Step 1?", "why_question": "Why is it not necessary for Step 10 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\nMust Step 10 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1101, "title": "green-tofu-curry", "question_idx": 1101, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 8], "binary_question": "Must Step 9 happen after Step 8?", "why_question": "Why is it not necessary for Step 9 to happen after Step 8?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\nMust Step 9 happen after Step 8? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1102, "title": "banana-split-cake", "question_idx": 1102, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 6 happen after Step 5?", "why_question": "Why is it not necessary for Step 6 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\nMust Step 6 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "Yes", "trial_1_answer": "Yes", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1103, "title": "lightly spiced tomato and red lentil soup", "question_idx": 1103, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 6], "binary_question": "Must Step 7 happen after Step 4?", "why_question": "Why is it not necessary for Step 7 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\nMust Step 7 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1104, "title": "almond and apple cake", "question_idx": 1104, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why is it not necessary for Step 6 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\nMust Step 6 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1105, "title": "tortellini-fritto-with-almond-butter", "question_idx": 1105, "steps": ["Bring a saucepan of water to the boil.", "Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.", "In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.", "If you slightly undercooked your tortellini then it's less likely to stick to the pan.", "Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.", "Continue to gently fry and stir the tortellini until golden brown.", "Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.", "Enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 5 happen after Step 4?", "why_question": "Why is it not necessary for Step 5 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: tortellini-fritto-with-almond-butter\n\nProcedure:\n1. Bring a saucepan of water to the boil.\n2. Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.\n3. In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.\n4. If you slightly undercooked your tortellini then it's less likely to stick to the pan.\n5. Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.\n6. Continue to gently fry and stir the tortellini until golden brown.\n7. Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.\n8. Enjoy!\n\n\nMust Step 5 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes", "trial_2_answer": "Yes", "model_answer": "Yes."}
{"plan_idx": 1106, "title": "spiced butternut squash soup", "question_idx": 1106, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 7], "binary_question": "Must Step 8 happen after Step 5?", "why_question": "Why is it not necessary for Step 8 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\nMust Step 8 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1107, "title": "fusilli-and-meatballs", "question_idx": 1107, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 13], "binary_question": "Must Step 14 happen after Step 8?", "why_question": "Why is it not necessary for Step 14 to happen after Step 8?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 14 happen after Step 8? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1108, "title": "creamy-chayote-squash-soup", "question_idx": 1108, "steps": ["Dissolve the stock in the hot water.", "Melt the butter in a large saucepan over medium heat.", "Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.", "Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.", "Stir in the stock and 1 tablespoon coriander;", "cover.", "Simmer about 20 minutes.", "Pour the mixture into a liquidiser and puree until smooth.", "Pour into bowls and garnish with a sprig of coriander to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why is it not necessary for Step 3 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: creamy-chayote-squash-soup\n\nProcedure:\n1. Dissolve the stock in the hot water.\n2. Melt the butter in a large saucepan over medium heat.\n3. Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.\n4. Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.\n5. Stir in the stock and 1 tablespoon coriander;\n6. cover.\n7. Simmer about 20 minutes.\n8. Pour the mixture into a liquidiser and puree until smooth.\n9. Pour into bowls and garnish with a sprig of coriander to serve.\n\n\nMust Step 3 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1109, "title": "fusilli-and-meatballs", "question_idx": 1109, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 14], "binary_question": "Must Step 15 happen after Step 8?", "why_question": "Why is it not necessary for Step 15 to happen after Step 8?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 15 happen after Step 8? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1110, "title": "banana-split-cake", "question_idx": 1110, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why is it not necessary for Step 6 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\nMust Step 6 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1111, "title": "tangy-gammon-in-cider", "question_idx": 1111, "steps": ["Preheat the oven to 200 degrees /gas mark 6.", "Start by piercing each tomato once and covering with boiling water to loosen the skins.", "Drain the onions and chop each one in half.", "Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.", "Put the onions, tomatoes and apples into a casserole dish.", "Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.", "Place in the dish and repeat with the other gammon steaks.", "Pour cider over the steaks, cover the top with a lid or tin foil.", "Cook for 1 hour."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why is it not necessary for Step 6 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: tangy-gammon-in-cider\n\nProcedure:\n1. Preheat the oven to 200 degrees /gas mark 6.\n2. Start by piercing each tomato once and covering with boiling water to loosen the skins.\n3. Drain the onions and chop each one in half.\n4. Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.\n5. Put the onions, tomatoes and apples into a casserole dish.\n6. Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.\n7. Place in the dish and repeat with the other gammon steaks.\n8. Pour cider over the steaks, cover the top with a lid or tin foil.\n9. Cook for 1 hour.\n\n\nMust Step 6 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1112, "title": "simple-basic-cupcakes", "question_idx": 1112, "steps": ["Preheat oven to 180 C / Gas 4.", "Beat butter and sugar together until light and fluffy.", "Add the eggs, one at a time, beating after each addition.", "If the batter is too thick, stir in some milk.", "Gradually add the flour, mixing well each time until evenly mixed.", "Spoon tablespoons of batter into a greased muffin tin.", "Bake in preheated oven for 15-20 minutes.", "The cake is done when a skewer inserted to the cake comes out clean.", "Let rest for fives minutes, then allow to cool fully on a wire rack.", "Decorate, if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why is it not necessary for Step 3 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: simple-basic-cupcakes\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Beat butter and sugar together until light and fluffy.\n3. Add the eggs, one at a time, beating after each addition.\n4. If the batter is too thick, stir in some milk.\n5. Gradually add the flour, mixing well each time until evenly mixed.\n6. Spoon tablespoons of batter into a greased muffin tin.\n7. Bake in preheated oven for 15-20 minutes.\n8. The cake is done when a skewer inserted to the cake comes out clean.\n9. Let rest for fives minutes, then allow to cool fully on a wire rack.\n10. Decorate, if desired.\n\n\nMust Step 3 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1113, "title": "tortellini-fritto-with-almond-butter", "question_idx": 1113, "steps": ["Bring a saucepan of water to the boil.", "Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.", "In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.", "If you slightly undercooked your tortellini then it's less likely to stick to the pan.", "Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.", "Continue to gently fry and stir the tortellini until golden brown.", "Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.", "Enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 7], "binary_question": "Must Step 8 happen after Step 2?", "why_question": "Why is it not necessary for Step 8 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: tortellini-fritto-with-almond-butter\n\nProcedure:\n1. Bring a saucepan of water to the boil.\n2. Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.\n3. In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.\n4. If you slightly undercooked your tortellini then it's less likely to stick to the pan.\n5. Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.\n6. Continue to gently fry and stir the tortellini until golden brown.\n7. Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.\n8. Enjoy!\n\n\nMust Step 8 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1114, "title": "chocolate-chocolate-cake", "question_idx": 1114, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [8, 10], "binary_question": "Must Step 11 happen after Step 9?", "why_question": "Why is it not necessary for Step 11 to happen after Step 9?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 11 happen after Step 9? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1115, "title": "spiced butternut squash soup", "question_idx": 1115, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 6], "binary_question": "Must Step 7 happen after Step 4?", "why_question": "Why is it not necessary for Step 7 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\nMust Step 7 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1116, "title": "smoked-salmon-and-grapefruit-salad", "question_idx": 1116, "steps": ["Top and tail the grapefruits.", "Slice the skin off the grapefruit over a bowl.", "This is to catch any juices.", "Using a small knife, segment the grapefruits over the juice bowl.", "Arrange the lamb's lettuce onto each serving plate or a large salad bowl.", "Top with grapefruit segments and smoked salmon.", "Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.", "Pour over the salad and serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 6], "binary_question": "Must Step 7 happen after Step 5?", "why_question": "Why is it not necessary for Step 7 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: smoked-salmon-and-grapefruit-salad\n\nProcedure:\n1. Top and tail the grapefruits.\n2. Slice the skin off the grapefruit over a bowl.\n3. This is to catch any juices.\n4. Using a small knife, segment the grapefruits over the juice bowl.\n5. Arrange the lamb's lettuce onto each serving plate or a large salad bowl.\n6. Top with grapefruit segments and smoked salmon.\n7. Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.\n8. Pour over the salad and serve.\n\n\nMust Step 7 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1117, "title": "feta-and-sundried-tomato-spinach-rolls", "question_idx": 1117, "steps": ["Preheat grill.", "Mix together cream cheese, feta, sundried tomatoes, basil and garlic.", "Stir until creamy, with no lumps.", "Blanch the spinach leaves.", "Wrap a dollop of cheese mix in each spinach leaf.", "Brush with olive oil.", "Sprinkle almonds on the top or alternately roll them in the almonds", "Grill spinach rolls until slightly crispy on top.", "Let cool for 10 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why is it not necessary for Step 4 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: feta-and-sundried-tomato-spinach-rolls\n\nProcedure:\n1. Preheat grill.\n2. Mix together cream cheese, feta, sundried tomatoes, basil and garlic.\n3. Stir until creamy, with no lumps.\n4. Blanch the spinach leaves.\n5. Wrap a dollop of cheese mix in each spinach leaf.\n6. Brush with olive oil.\n7. Sprinkle almonds on the top or alternately roll them in the almonds\n8. Grill spinach rolls until slightly crispy on top.\n9. Let cool for 10 minutes.\n\n\nMust Step 4 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1118, "title": "fusilli-and-meatballs", "question_idx": 1118, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 12], "binary_question": "Must Step 13 happen after Step 8?", "why_question": "Why is it not necessary for Step 13 to happen after Step 8?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 13 happen after Step 8? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1119, "title": "fusilli-and-meatballs", "question_idx": 1119, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [10, 18], "binary_question": "Must Step 19 happen after Step 11?", "why_question": "Why is it not necessary for Step 19 to happen after Step 11?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 19 happen after Step 11? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1120, "title": "chicken and vegetable pie", "question_idx": 1120, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why is it not necessary for Step 3 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\nMust Step 3 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1121, "title": "no-sugar-rock-cakes", "question_idx": 1121, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 7 happen after Step 1?", "why_question": "Why is it not necessary for Step 7 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\nMust Step 7 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1122, "title": "fusilli-and-meatballs", "question_idx": 1122, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 10], "binary_question": "Must Step 11 happen after Step 5?", "why_question": "Why is it not necessary for Step 11 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 11 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1123, "title": "no-sugar-rock-cakes", "question_idx": 1123, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why is it not necessary for Step 3 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\nMust Step 3 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1124, "title": "chocolate-chocolate-cake", "question_idx": 1124, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 13], "binary_question": "Must Step 14 happen after Step 8?", "why_question": "Why is it not necessary for Step 14 to happen after Step 8?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 14 happen after Step 8? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1125, "title": "chocolate-chocolate-cake", "question_idx": 1125, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 7], "binary_question": "Must Step 8 happen after Step 5?", "why_question": "Why is it not necessary for Step 8 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 8 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1126, "title": "chicken-prawn-and-rice-soup", "question_idx": 1126, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why is it not necessary for Step 2 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\nMust Step 2 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1127, "title": "fusilli-and-meatballs", "question_idx": 1127, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 7], "binary_question": "Must Step 8 happen after Step 2?", "why_question": "Why is it not necessary for Step 8 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 8 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1128, "title": "cloud-bread", "question_idx": 1128, "steps": ["Preheat oven to 150 C / Gas mark 2.", "Line a baking tray with baking paper.", "Mix cream cheese and egg yolks together until smooth.", "Place egg whites and baking powder in a glass, metal, or ceramic bowl;", "beat together until stiff peaks form.", "Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.", "Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.", "Bake in the preheated oven until golden brown, 17 to 20 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 4 happen after Step 3?", "why_question": "Why is it not necessary for Step 4 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: cloud-bread\n\nProcedure:\n1. Preheat oven to 150 C / Gas mark 2.\n2. Line a baking tray with baking paper.\n3. Mix cream cheese and egg yolks together until smooth.\n4. Place egg whites and baking powder in a glass, metal, or ceramic bowl;\n5. beat together until stiff peaks form.\n6. Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.\n7. Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.\n8. Bake in the preheated oven until golden brown, 17 to 20 minutes.\n\n\nMust Step 4 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1129, "title": "fusilli-and-meatballs", "question_idx": 1129, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 7 happen after Step 3?", "why_question": "Why is it not necessary for Step 7 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 7 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1130, "title": "green-tofu-curry", "question_idx": 1130, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 10], "binary_question": "Must Step 11 happen after Step 5?", "why_question": "Why is it not necessary for Step 11 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\nMust Step 11 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1131, "title": "spiced-pumpkin-teabread", "question_idx": 1131, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 4 happen after Step 2?", "why_question": "Why is it not necessary for Step 4 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\nMust Step 4 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1132, "title": "chocolate-chocolate-cake", "question_idx": 1132, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 14], "binary_question": "Must Step 15 happen after Step 3?", "why_question": "Why is it not necessary for Step 15 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 15 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1133, "title": "chocolate-chocolate-cake", "question_idx": 1133, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [12, 13], "binary_question": "Must Step 14 happen after Step 13?", "why_question": "Why is it not necessary for Step 14 to happen after Step 13?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 14 happen after Step 13? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1134, "title": "chocolate-chocolate-cake", "question_idx": 1134, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 6], "binary_question": "Must Step 7 happen after Step 4?", "why_question": "Why is it not necessary for Step 7 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 7 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "Yes", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1135, "title": "almost no fat banana bread", "question_idx": 1135, "steps": ["Preheat oven to 180 C / Gas mark 4.", "Lightly grease a 20x10cm (8x4 in) loaf tin.", "In a large bowl, stir together flour, sugar, baking powder, bicarbonate of soda and cinnamon.", "Add egg whites, bananas and apple pur\u00c3\u00a9e; stir just until combined.", "Pour batter into prepared tin.", "Bake in preheated oven for 50 to 55 minutes, until a skewer inserted into centre of loaf comes out clean.", "Turn out onto wire rack and allow to cool before slicing."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why is it not necessary for Step 4 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: almost no fat banana bread\n\nProcedure:\n1. Preheat oven to 180 C / Gas mark 4.\n2. Lightly grease a 20x10cm (8x4 in) loaf tin.\n3. In a large bowl, stir together flour, sugar, baking powder, bicarbonate of soda and cinnamon.\n4. Add egg whites, bananas and apple pur\u00c3\u00a9e; stir just until combined.\n5. Pour batter into prepared tin.\n6. Bake in preheated oven for 50 to 55 minutes, until a skewer inserted into centre of loaf comes out clean.\n7. Turn out onto wire rack and allow to cool before slicing.\n\n\nMust Step 4 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1136, "title": "smoked-salmon-and-grapefruit-salad", "question_idx": 1136, "steps": ["Top and tail the grapefruits.", "Slice the skin off the grapefruit over a bowl.", "This is to catch any juices.", "Using a small knife, segment the grapefruits over the juice bowl.", "Arrange the lamb's lettuce onto each serving plate or a large salad bowl.", "Top with grapefruit segments and smoked salmon.", "Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.", "Pour over the salad and serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 5 happen after Step 3?", "why_question": "Why is it not necessary for Step 5 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: smoked-salmon-and-grapefruit-salad\n\nProcedure:\n1. Top and tail the grapefruits.\n2. Slice the skin off the grapefruit over a bowl.\n3. This is to catch any juices.\n4. Using a small knife, segment the grapefruits over the juice bowl.\n5. Arrange the lamb's lettuce onto each serving plate or a large salad bowl.\n6. Top with grapefruit segments and smoked salmon.\n7. Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.\n8. Pour over the salad and serve.\n\n\nMust Step 5 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1137, "title": "very-vanilla-ry-cheesecake", "question_idx": 1137, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why is it not necessary for Step 2 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\nMust Step 2 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "No", "model_answer": "No."}
{"plan_idx": 1138, "title": "fusilli-and-meatballs", "question_idx": 1138, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [10, 13], "binary_question": "Must Step 14 happen after Step 11?", "why_question": "Why is it not necessary for Step 14 to happen after Step 11?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 14 happen after Step 11? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1139, "title": "chicken-prawn-and-rice-soup", "question_idx": 1139, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 10], "binary_question": "Must Step 11 happen after Step 3?", "why_question": "Why is it not necessary for Step 11 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\nMust Step 11 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1140, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1140, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 10], "binary_question": "Must Step 11 happen after Step 2?", "why_question": "Why is it not necessary for Step 11 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\nMust Step 11 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No", "model_answer": "No."}
{"plan_idx": 1141, "title": "spanish-rabbit-stew", "question_idx": 1141, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why is it not necessary for Step 6 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\nMust Step 6 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "No", "model_answer": "No."}
{"plan_idx": 1142, "title": "vegetable-terrine", "question_idx": 1142, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why is it not necessary for Step 3 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\nMust Step 3 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1143, "title": "green-tofu-curry", "question_idx": 1143, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 9], "binary_question": "Must Step 10 happen after Step 2?", "why_question": "Why is it not necessary for Step 10 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\nMust Step 10 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1144, "title": "chocolate-chocolate-cake", "question_idx": 1144, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [17, 18], "binary_question": "Must Step 19 happen after Step 18?", "why_question": "Why is it not necessary for Step 19 to happen after Step 18?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 19 happen after Step 18? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No,", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1145, "title": "spiced butternut squash soup", "question_idx": 1145, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 10], "binary_question": "Must Step 11 happen after Step 5?", "why_question": "Why is it not necessary for Step 11 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\nMust Step 11 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1146, "title": "chocolate-chocolate-cake", "question_idx": 1146, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 11], "binary_question": "Must Step 12 happen after Step 7?", "why_question": "Why is it not necessary for Step 12 to happen after Step 7?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 12 happen after Step 7? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1147, "title": "chocolate-chocolate-cake", "question_idx": 1147, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 11], "binary_question": "Must Step 12 happen after Step 1?", "why_question": "Why is it not necessary for Step 12 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 12 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1148, "title": "chocolate-chocolate-cake", "question_idx": 1148, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 10], "binary_question": "Must Step 11 happen after Step 4?", "why_question": "Why is it not necessary for Step 11 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 11 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1149, "title": "fusilli-and-meatballs", "question_idx": 1149, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 13], "binary_question": "Must Step 14 happen after Step 6?", "why_question": "Why is it not necessary for Step 14 to happen after Step 6?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 14 happen after Step 6? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1150, "title": "chocolate-chocolate-cake", "question_idx": 1150, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [9, 18], "binary_question": "Must Step 19 happen after Step 10?", "why_question": "Why is it not necessary for Step 19 to happen after Step 10?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 19 happen after Step 10? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1151, "title": "vegetable-terrine", "question_idx": 1151, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 7], "binary_question": "Must Step 8 happen after Step 3?", "why_question": "Why is it not necessary for Step 8 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\nMust Step 8 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1152, "title": "brown sugar shortbread", "question_idx": 1152, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why is it not necessary for Step 2 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\nMust Step 2 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1153, "title": "spiced-pumpkin-teabread", "question_idx": 1153, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 7], "binary_question": "Must Step 8 happen after Step 2?", "why_question": "Why is it not necessary for Step 8 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\nMust Step 8 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1154, "title": "simple-basic-cupcakes", "question_idx": 1154, "steps": ["Preheat oven to 180 C / Gas 4.", "Beat butter and sugar together until light and fluffy.", "Add the eggs, one at a time, beating after each addition.", "If the batter is too thick, stir in some milk.", "Gradually add the flour, mixing well each time until evenly mixed.", "Spoon tablespoons of batter into a greased muffin tin.", "Bake in preheated oven for 15-20 minutes.", "The cake is done when a skewer inserted to the cake comes out clean.", "Let rest for fives minutes, then allow to cool fully on a wire rack.", "Decorate, if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why is it not necessary for Step 4 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: simple-basic-cupcakes\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Beat butter and sugar together until light and fluffy.\n3. Add the eggs, one at a time, beating after each addition.\n4. If the batter is too thick, stir in some milk.\n5. Gradually add the flour, mixing well each time until evenly mixed.\n6. Spoon tablespoons of batter into a greased muffin tin.\n7. Bake in preheated oven for 15-20 minutes.\n8. The cake is done when a skewer inserted to the cake comes out clean.\n9. Let rest for fives minutes, then allow to cool fully on a wire rack.\n10. Decorate, if desired.\n\n\nMust Step 4 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1155, "title": "fusilli-and-meatballs", "question_idx": 1155, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [16, 18], "binary_question": "Must Step 19 happen after Step 17?", "why_question": "Why is it not necessary for Step 19 to happen after Step 17?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 19 happen after Step 17? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1156, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1156, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 10], "binary_question": "Must Step 11 happen after Step 5?", "why_question": "Why is it not necessary for Step 11 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\nMust Step 11 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1157, "title": "lightly spiced tomato and red lentil soup", "question_idx": 1157, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 6], "binary_question": "Must Step 7 happen after Step 5?", "why_question": "Why is it not necessary for Step 7 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\nMust Step 7 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1158, "title": "fusilli-and-meatballs", "question_idx": 1158, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 11], "binary_question": "Must Step 12 happen after Step 7?", "why_question": "Why is it not necessary for Step 12 to happen after Step 7?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 12 happen after Step 7? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1159, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1159, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 11], "binary_question": "Must Step 12 happen after Step 2?", "why_question": "Why is it not necessary for Step 12 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\nMust Step 12 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1160, "title": "vegetable-terrine", "question_idx": 1160, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 9], "binary_question": "Must Step 10 happen after Step 4?", "why_question": "Why is it not necessary for Step 10 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\nMust Step 10 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1161, "title": "almost no fat banana bread", "question_idx": 1161, "steps": ["Preheat oven to 180 C / Gas mark 4.", "Lightly grease a 20x10cm (8x4 in) loaf tin.", "In a large bowl, stir together flour, sugar, baking powder, bicarbonate of soda and cinnamon.", "Add egg whites, bananas and apple pur\u00c3\u00a9e; stir just until combined.", "Pour batter into prepared tin.", "Bake in preheated oven for 50 to 55 minutes, until a skewer inserted into centre of loaf comes out clean.", "Turn out onto wire rack and allow to cool before slicing."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why is it not necessary for Step 3 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: almost no fat banana bread\n\nProcedure:\n1. Preheat oven to 180 C / Gas mark 4.\n2. Lightly grease a 20x10cm (8x4 in) loaf tin.\n3. In a large bowl, stir together flour, sugar, baking powder, bicarbonate of soda and cinnamon.\n4. Add egg whites, bananas and apple pur\u00c3\u00a9e; stir just until combined.\n5. Pour batter into prepared tin.\n6. Bake in preheated oven for 50 to 55 minutes, until a skewer inserted into centre of loaf comes out clean.\n7. Turn out onto wire rack and allow to cool before slicing.\n\n\nMust Step 3 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1162, "title": "cloud-bread", "question_idx": 1162, "steps": ["Preheat oven to 150 C / Gas mark 2.", "Line a baking tray with baking paper.", "Mix cream cheese and egg yolks together until smooth.", "Place egg whites and baking powder in a glass, metal, or ceramic bowl;", "beat together until stiff peaks form.", "Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.", "Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.", "Bake in the preheated oven until golden brown, 17 to 20 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 3 happen after Step 2?", "why_question": "Why is it not necessary for Step 3 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: cloud-bread\n\nProcedure:\n1. Preheat oven to 150 C / Gas mark 2.\n2. Line a baking tray with baking paper.\n3. Mix cream cheese and egg yolks together until smooth.\n4. Place egg whites and baking powder in a glass, metal, or ceramic bowl;\n5. beat together until stiff peaks form.\n6. Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.\n7. Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.\n8. Bake in the preheated oven until golden brown, 17 to 20 minutes.\n\n\nMust Step 3 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1163, "title": "very-vanilla-ry-cheesecake", "question_idx": 1163, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 6 happen after Step 3?", "why_question": "Why is it not necessary for Step 6 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\nMust Step 6 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1164, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1164, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why is it not necessary for Step 6 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\nMust Step 6 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1165, "title": "vegetable-terrine", "question_idx": 1165, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 5 happen after Step 3?", "why_question": "Why is it not necessary for Step 5 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\nMust Step 5 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1166, "title": "fusilli-and-meatballs", "question_idx": 1166, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 15], "binary_question": "Must Step 16 happen after Step 7?", "why_question": "Why is it not necessary for Step 16 to happen after Step 7?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 16 happen after Step 7? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1167, "title": "spiced butternut squash soup", "question_idx": 1167, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 6], "binary_question": "Must Step 7 happen after Step 5?", "why_question": "Why is it not necessary for Step 7 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\nMust Step 7 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1168, "title": "almond and apple cake", "question_idx": 1168, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 8], "binary_question": "Must Step 9 happen after Step 2?", "why_question": "Why is it not necessary for Step 9 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\nMust Step 9 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1169, "title": "spiced-pumpkin-teabread", "question_idx": 1169, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 6], "binary_question": "Must Step 7 happen after Step 4?", "why_question": "Why is it not necessary for Step 7 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\nMust Step 7 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1170, "title": "fusilli-and-meatballs", "question_idx": 1170, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [9, 12], "binary_question": "Must Step 13 happen after Step 10?", "why_question": "Why is it not necessary for Step 13 to happen after Step 10?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 13 happen after Step 10? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1171, "title": "spiced butternut squash soup", "question_idx": 1171, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why is it not necessary for Step 3 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\nMust Step 3 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1172, "title": "chicken-prawn-and-rice-soup", "question_idx": 1172, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [8, 9], "binary_question": "Must Step 10 happen after Step 9?", "why_question": "Why is it not necessary for Step 10 to happen after Step 9?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\nMust Step 10 happen after Step 9? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1173, "title": "no-sugar-rock-cakes", "question_idx": 1173, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 4 happen after Step 2?", "why_question": "Why is it not necessary for Step 4 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\nMust Step 4 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1174, "title": "fusilli-and-meatballs", "question_idx": 1174, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 10], "binary_question": "Must Step 11 happen after Step 3?", "why_question": "Why is it not necessary for Step 11 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 11 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1175, "title": "spanish-rabbit-stew", "question_idx": 1175, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 9], "binary_question": "Must Step 10 happen after Step 2?", "why_question": "Why is it not necessary for Step 10 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\nMust Step 10 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1176, "title": "curried bbq mussels", "question_idx": 1176, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 3 happen after Step 2?", "why_question": "Why is it not necessary for Step 3 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\nMust Step 3 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1177, "title": "very-vanilla-ry-cheesecake", "question_idx": 1177, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 7], "binary_question": "Must Step 8 happen after Step 1?", "why_question": "Why is it not necessary for Step 8 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\nMust Step 8 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1178, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 1178, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 7 happen after Step 6?", "why_question": "Why is it not necessary for Step 7 to happen after Step 6?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\nMust Step 7 happen after Step 6? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1179, "title": "spiced-pumpkin-teabread", "question_idx": 1179, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 6 happen after Step 5?", "why_question": "Why is it not necessary for Step 6 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\nMust Step 6 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1180, "title": "chicken and vegetable pie", "question_idx": 1180, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 5 happen after Step 4?", "why_question": "Why is it not necessary for Step 5 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\nMust Step 5 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1181, "title": "vegetable-terrine", "question_idx": 1181, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 9], "binary_question": "Must Step 10 happen after Step 5?", "why_question": "Why is it not necessary for Step 10 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\nMust Step 10 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1182, "title": "chicken and vegetable pie", "question_idx": 1182, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 7], "binary_question": "Must Step 8 happen after Step 1?", "why_question": "Why is it not necessary for Step 8 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\nMust Step 8 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1183, "title": "green-tofu-curry", "question_idx": 1183, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 10], "binary_question": "Must Step 11 happen after Step 4?", "why_question": "Why is it not necessary for Step 11 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\nMust Step 11 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1184, "title": "spanish-rabbit-stew", "question_idx": 1184, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 7], "binary_question": "Must Step 8 happen after Step 3?", "why_question": "Why is it not necessary for Step 8 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\nMust Step 8 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No", "model_answer": "No."}
{"plan_idx": 1185, "title": "fusilli-and-meatballs", "question_idx": 1185, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 14], "binary_question": "Must Step 15 happen after Step 5?", "why_question": "Why is it not necessary for Step 15 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 15 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1186, "title": "chocolate-chocolate-cake", "question_idx": 1186, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [9, 14], "binary_question": "Must Step 15 happen after Step 10?", "why_question": "Why is it not necessary for Step 15 to happen after Step 10?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 15 happen after Step 10? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1187, "title": "almond and apple cake", "question_idx": 1187, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 7 happen after Step 2?", "why_question": "Why is it not necessary for Step 7 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\nMust Step 7 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1188, "title": "chocolate-chocolate-cake", "question_idx": 1188, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [8, 13], "binary_question": "Must Step 14 happen after Step 9?", "why_question": "Why is it not necessary for Step 14 to happen after Step 9?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 14 happen after Step 9? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1189, "title": "green-tofu-curry", "question_idx": 1189, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 5], "binary_question": "Must Step 6 happen after Step 4?", "why_question": "Why is it not necessary for Step 6 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\nMust Step 6 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1190, "title": "lightly spiced tomato and red lentil soup", "question_idx": 1190, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 7 happen after Step 6?", "why_question": "Why is it not necessary for Step 7 to happen after Step 6?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\nMust Step 7 happen after Step 6? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1191, "title": "spiced butternut squash soup", "question_idx": 1191, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 8], "binary_question": "Must Step 9 happen after Step 4?", "why_question": "Why is it not necessary for Step 9 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\nMust Step 9 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1192, "title": "banana-split-cake", "question_idx": 1192, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 5], "binary_question": "Must Step 6 happen after Step 4?", "why_question": "Why is it not necessary for Step 6 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\nMust Step 6 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1193, "title": "spanish-rabbit-stew", "question_idx": 1193, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why is it not necessary for Step 5 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\nMust Step 5 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1194, "title": "cranachan", "question_idx": 1194, "steps": ["Preheat the oven to 180 C / Gas mark 4.", "Spread oats out in a thin layer on a baking tray.", "Toast in the oven for about 10 minutes, or until lightly browned.", "Set aside to cool.", "Remove them from the tray for faster cooling.", "In a medium bowl, whip the cream to firm peaks.", "Gently fold in the icing sugar, vanilla and toasted oats.", "Spoon into 4 serving bowls, and top with fresh berries.", "For an extra touch, drizzle some whisky over each serving.", "Garnish with a mint leaf."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 5], "binary_question": "Must Step 6 happen after Step 4?", "why_question": "Why is it not necessary for Step 6 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: cranachan\n\nProcedure:\n1. Preheat the oven to 180 C / Gas mark 4.\n2. Spread oats out in a thin layer on a baking tray.\n3. Toast in the oven for about 10 minutes, or until lightly browned.\n4. Set aside to cool.\n5. Remove them from the tray for faster cooling.\n6. In a medium bowl, whip the cream to firm peaks.\n7. Gently fold in the icing sugar, vanilla and toasted oats.\n8. Spoon into 4 serving bowls, and top with fresh berries.\n9. For an extra touch, drizzle some whisky over each serving.\n10. Garnish with a mint leaf.\n\n\nMust Step 6 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1195, "title": "very-vanilla-ry-cheesecake", "question_idx": 1195, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why is it not necessary for Step 3 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\nMust Step 3 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No", "model_answer": "No."}
{"plan_idx": 1196, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1196, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why is it not necessary for Step 4 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\nMust Step 4 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1197, "title": "chicken and vegetable pie", "question_idx": 1197, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 9], "binary_question": "Must Step 10 happen after Step 7?", "why_question": "Why is it not necessary for Step 10 to happen after Step 7?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\nMust Step 10 happen after Step 7? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1198, "title": "chocolate-pancake-batter", "question_idx": 1198, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 5 happen after Step 4?", "why_question": "Why is it not necessary for Step 5 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\nMust Step 5 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "Yes", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1199, "title": "balsamic-and-mozzarella-chicken", "question_idx": 1199, "steps": ["Place chicken in a shallow dish or large resealable plastic bag.", "Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.", "Coat a large frying pan lightly with oil, and set over low heat.", "Remove the chicken from the marinade and discard the marinade.", "Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.", "Arrange chicken on a serving platter.", "Place a generous slice of fresh mozzarella on top of each piece.", "Place a leaf of basil on top of the cheese, and cover with a slice of tomato.", "Drizzle balsamic vinegar over the platter, then season with salt and pepper.", "Serve!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 3 happen after Step 2?", "why_question": "Why is it not necessary for Step 3 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: balsamic-and-mozzarella-chicken\n\nProcedure:\n1. Place chicken in a shallow dish or large resealable plastic bag.\n2. Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.\n3. Coat a large frying pan lightly with oil, and set over low heat.\n4. Remove the chicken from the marinade and discard the marinade.\n5. Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.\n6. Arrange chicken on a serving platter.\n7. Place a generous slice of fresh mozzarella on top of each piece.\n8. Place a leaf of basil on top of the cheese, and cover with a slice of tomato.\n9. Drizzle balsamic vinegar over the platter, then season with salt and pepper.\n10. Serve!\n\n\nMust Step 3 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1200, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1200, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 12], "binary_question": "Must Step 13 happen after Step 6?", "why_question": "Why is it not necessary for Step 13 to happen after Step 6?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\nMust Step 13 happen after Step 6? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1201, "title": "spiced-pumpkin-teabread", "question_idx": 1201, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 7 happen after Step 1?", "why_question": "Why is it not necessary for Step 7 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\nMust Step 7 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1202, "title": "tangy-gammon-in-cider", "question_idx": 1202, "steps": ["Preheat the oven to 200 degrees /gas mark 6.", "Start by piercing each tomato once and covering with boiling water to loosen the skins.", "Drain the onions and chop each one in half.", "Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.", "Put the onions, tomatoes and apples into a casserole dish.", "Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.", "Place in the dish and repeat with the other gammon steaks.", "Pour cider over the steaks, cover the top with a lid or tin foil.", "Cook for 1 hour."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why is it not necessary for Step 5 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: tangy-gammon-in-cider\n\nProcedure:\n1. Preheat the oven to 200 degrees /gas mark 6.\n2. Start by piercing each tomato once and covering with boiling water to loosen the skins.\n3. Drain the onions and chop each one in half.\n4. Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.\n5. Put the onions, tomatoes and apples into a casserole dish.\n6. Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.\n7. Place in the dish and repeat with the other gammon steaks.\n8. Pour cider over the steaks, cover the top with a lid or tin foil.\n9. Cook for 1 hour.\n\n\nMust Step 5 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1203, "title": "chicken-prawn-and-rice-soup", "question_idx": 1203, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 10], "binary_question": "Must Step 11 happen after Step 2?", "why_question": "Why is it not necessary for Step 11 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\nMust Step 11 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1204, "title": "fusilli-and-meatballs", "question_idx": 1204, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [8, 10], "binary_question": "Must Step 11 happen after Step 9?", "why_question": "Why is it not necessary for Step 11 to happen after Step 9?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 11 happen after Step 9? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1205, "title": "chocolate-chocolate-cake", "question_idx": 1205, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 7], "binary_question": "Must Step 8 happen after Step 2?", "why_question": "Why is it not necessary for Step 8 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 8 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1206, "title": "spiced-guava-cake", "question_idx": 1206, "steps": ["Preheat oven to 180 C / Gas 4.", "Grease and flour one 23x13cm loaf tin.", "Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.", "In another bowl, mix together guava pulp and juice.", "In another bowl, cream together butter and sugar.", "Add eggs, one at a time.", "Add flour mixture and guava mixture alternately to creamed mixture.", "Pour batter into prepared tin.", "Bake at 180 C / Gas 4 for 30-35 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why is it not necessary for Step 4 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced-guava-cake\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Grease and flour one 23x13cm loaf tin.\n3. Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.\n4. In another bowl, mix together guava pulp and juice.\n5. In another bowl, cream together butter and sugar.\n6. Add eggs, one at a time.\n7. Add flour mixture and guava mixture alternately to creamed mixture.\n8. Pour batter into prepared tin.\n9. Bake at 180 C / Gas 4 for 30-35 minutes.\n\n\nMust Step 4 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1207, "title": "kid-s-cheese-and-veg-kebab", "question_idx": 1207, "steps": ["Shave the carrots into wide ribbons / waves using a potato peeler.", "Cut the red pepper into star shapes using a star cookie cutter.", "Cut the bread into flowers using a cookie cutter.", "Assemble all onto a skewer with bread flowers top and bottom and carrot curls, cheesy chunks and pepper stars seen as layers between."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why is it not necessary for Step 2 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: kid-s-cheese-and-veg-kebab\n\nProcedure:\n1. Shave the carrots into wide ribbons / waves using a potato peeler.\n2. Cut the red pepper into star shapes using a star cookie cutter.\n3. Cut the bread into flowers using a cookie cutter.\n4. Assemble all onto a skewer with bread flowers top and bottom and carrot curls, cheesy chunks and pepper stars seen as layers between.\n\n\nMust Step 2 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1208, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1208, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [10, 12], "binary_question": "Must Step 13 happen after Step 11?", "why_question": "Why is it not necessary for Step 13 to happen after Step 11?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\nMust Step 13 happen after Step 11? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1209, "title": "chocolate-chocolate-cake", "question_idx": 1209, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 8], "binary_question": "Must Step 9 happen after Step 4?", "why_question": "Why is it not necessary for Step 9 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 9 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1210, "title": "brown sugar shortbread", "question_idx": 1210, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why is it not necessary for Step 5 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\nMust Step 5 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No", "model_answer": "No."}
{"plan_idx": 1211, "title": "spiced butternut squash soup", "question_idx": 1211, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 7], "binary_question": "Must Step 8 happen after Step 1?", "why_question": "Why is it not necessary for Step 8 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\nMust Step 8 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1212, "title": "fusilli-and-meatballs", "question_idx": 1212, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [9, 11], "binary_question": "Must Step 12 happen after Step 10?", "why_question": "Why is it not necessary for Step 12 to happen after Step 10?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 12 happen after Step 10? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1213, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1213, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 7], "binary_question": "Must Step 8 happen after Step 1?", "why_question": "Why is it not necessary for Step 8 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\nMust Step 8 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1214, "title": "spiced butternut squash soup", "question_idx": 1214, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 8], "binary_question": "Must Step 9 happen after Step 5?", "why_question": "Why is it not necessary for Step 9 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\nMust Step 9 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1215, "title": "spanish-rabbit-stew", "question_idx": 1215, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 10], "binary_question": "Must Step 11 happen after Step 6?", "why_question": "Why is it not necessary for Step 11 to happen after Step 6?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\nMust Step 11 happen after Step 6? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes", "model_answer": "Yes."}
{"plan_idx": 1216, "title": "vegetable-terrine", "question_idx": 1216, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 9], "binary_question": "Must Step 10 happen after Step 7?", "why_question": "Why is it not necessary for Step 10 to happen after Step 7?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\nMust Step 10 happen after Step 7? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1217, "title": "cranachan", "question_idx": 1217, "steps": ["Preheat the oven to 180 C / Gas mark 4.", "Spread oats out in a thin layer on a baking tray.", "Toast in the oven for about 10 minutes, or until lightly browned.", "Set aside to cool.", "Remove them from the tray for faster cooling.", "In a medium bowl, whip the cream to firm peaks.", "Gently fold in the icing sugar, vanilla and toasted oats.", "Spoon into 4 serving bowls, and top with fresh berries.", "For an extra touch, drizzle some whisky over each serving.", "Garnish with a mint leaf."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why is it not necessary for Step 6 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: cranachan\n\nProcedure:\n1. Preheat the oven to 180 C / Gas mark 4.\n2. Spread oats out in a thin layer on a baking tray.\n3. Toast in the oven for about 10 minutes, or until lightly browned.\n4. Set aside to cool.\n5. Remove them from the tray for faster cooling.\n6. In a medium bowl, whip the cream to firm peaks.\n7. Gently fold in the icing sugar, vanilla and toasted oats.\n8. Spoon into 4 serving bowls, and top with fresh berries.\n9. For an extra touch, drizzle some whisky over each serving.\n10. Garnish with a mint leaf.\n\n\nMust Step 6 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1218, "title": "spiced-pumpkin-teabread", "question_idx": 1218, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 3 happen after Step 2?", "why_question": "Why is it not necessary for Step 3 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\nMust Step 3 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1219, "title": "tortellini-fritto-with-almond-butter", "question_idx": 1219, "steps": ["Bring a saucepan of water to the boil.", "Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.", "In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.", "If you slightly undercooked your tortellini then it's less likely to stick to the pan.", "Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.", "Continue to gently fry and stir the tortellini until golden brown.", "Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.", "Enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 7], "binary_question": "Must Step 8 happen after Step 1?", "why_question": "Why is it not necessary for Step 8 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: tortellini-fritto-with-almond-butter\n\nProcedure:\n1. Bring a saucepan of water to the boil.\n2. Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.\n3. In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.\n4. If you slightly undercooked your tortellini then it's less likely to stick to the pan.\n5. Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.\n6. Continue to gently fry and stir the tortellini until golden brown.\n7. Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.\n8. Enjoy!\n\n\nMust Step 8 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1220, "title": "spanish-rabbit-stew", "question_idx": 1220, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 7], "binary_question": "Must Step 8 happen after Step 1?", "why_question": "Why is it not necessary for Step 8 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\nMust Step 8 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1221, "title": "chicken and vegetable pie", "question_idx": 1221, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 7], "binary_question": "Must Step 8 happen after Step 4?", "why_question": "Why is it not necessary for Step 8 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\nMust Step 8 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1222, "title": "cranachan", "question_idx": 1222, "steps": ["Preheat the oven to 180 C / Gas mark 4.", "Spread oats out in a thin layer on a baking tray.", "Toast in the oven for about 10 minutes, or until lightly browned.", "Set aside to cool.", "Remove them from the tray for faster cooling.", "In a medium bowl, whip the cream to firm peaks.", "Gently fold in the icing sugar, vanilla and toasted oats.", "Spoon into 4 serving bowls, and top with fresh berries.", "For an extra touch, drizzle some whisky over each serving.", "Garnish with a mint leaf."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why is it not necessary for Step 2 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: cranachan\n\nProcedure:\n1. Preheat the oven to 180 C / Gas mark 4.\n2. Spread oats out in a thin layer on a baking tray.\n3. Toast in the oven for about 10 minutes, or until lightly browned.\n4. Set aside to cool.\n5. Remove them from the tray for faster cooling.\n6. In a medium bowl, whip the cream to firm peaks.\n7. Gently fold in the icing sugar, vanilla and toasted oats.\n8. Spoon into 4 serving bowls, and top with fresh berries.\n9. For an extra touch, drizzle some whisky over each serving.\n10. Garnish with a mint leaf.\n\n\nMust Step 2 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1223, "title": "spicy-tomato-anchovy-pasta", "question_idx": 1223, "steps": ["Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;", "cook until lightly browned.", "Add anchovies and water, cover and simmer for 4 to 5 minutes.", "Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.", "While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.", "Add linguine and cook until al dente, about 7 to 8 minutes;", "drain.", "Toss with anchovy mixture and chilli flakes.", "If desired, season with black pepper.", "Serve immediately."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why is it not necessary for Step 6 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spicy-tomato-anchovy-pasta\n\nProcedure:\n1. Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;\n2. cook until lightly browned.\n3. Add anchovies and water, cover and simmer for 4 to 5 minutes.\n4. Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.\n5. While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.\n6. Add linguine and cook until al dente, about 7 to 8 minutes;\n7. drain.\n8. Toss with anchovy mixture and chilli flakes.\n9. If desired, season with black pepper.\n10. Serve immediately.\n\n\nMust Step 6 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1224, "title": "fusilli-and-meatballs", "question_idx": 1224, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [8, 11], "binary_question": "Must Step 12 happen after Step 9?", "why_question": "Why is it not necessary for Step 12 to happen after Step 9?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 12 happen after Step 9? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1225, "title": "chocolate-chocolate-cake", "question_idx": 1225, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 14], "binary_question": "Must Step 15 happen after Step 8?", "why_question": "Why is it not necessary for Step 15 to happen after Step 8?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 15 happen after Step 8? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1226, "title": "fusilli-and-meatballs", "question_idx": 1226, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 5], "binary_question": "Must Step 6 happen after Step 4?", "why_question": "Why is it not necessary for Step 6 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 6 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1227, "title": "chocolate-chocolate-cake", "question_idx": 1227, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 8], "binary_question": "Must Step 9 happen after Step 1?", "why_question": "Why is it not necessary for Step 9 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 9 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1228, "title": "strawberry-tiramisu-trifle", "question_idx": 1228, "steps": ["Set 3 strawberries for the garnish aside, and cut the rest into slices.", "In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.", "Then stir in the custard and finally fold in the whipped cream.", "Brush the sponge fingers with the remaining coffee.", "Line a glass bowl with one layer of the soaked sponge fingers.", "Spread half of the strawberries over the sponge fingers.", "Sprinkle half of the grated chocolate over that and then half of the custard mixture.", "Repeat the layers in order again.", "Cut the remaining 3 strawberries in half and lay them on top of the trifle.", "Cover and leave in the fridge for at least 4 hours, best overnight."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why is it not necessary for Step 2 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: strawberry-tiramisu-trifle\n\nProcedure:\n1. Set 3 strawberries for the garnish aside, and cut the rest into slices.\n2. In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.\n3. Then stir in the custard and finally fold in the whipped cream.\n4. Brush the sponge fingers with the remaining coffee.\n5. Line a glass bowl with one layer of the soaked sponge fingers.\n6. Spread half of the strawberries over the sponge fingers.\n7. Sprinkle half of the grated chocolate over that and then half of the custard mixture.\n8. Repeat the layers in order again.\n9. Cut the remaining 3 strawberries in half and lay them on top of the trifle.\n10. Cover and leave in the fridge for at least 4 hours, best overnight.\n\n\nMust Step 2 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1229, "title": "spiced butternut squash soup", "question_idx": 1229, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why is it not necessary for Step 2 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\nMust Step 2 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes", "trial_1_answer": "Yes", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1230, "title": "spiced butternut squash soup", "question_idx": 1230, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 9], "binary_question": "Must Step 10 happen after Step 4?", "why_question": "Why is it not necessary for Step 10 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\nMust Step 10 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1231, "title": "very-vanilla-ry-cheesecake", "question_idx": 1231, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 9], "binary_question": "Must Step 10 happen after Step 5?", "why_question": "Why is it not necessary for Step 10 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\nMust Step 10 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1232, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 1232, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 7 happen after Step 2?", "why_question": "Why is it not necessary for Step 7 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\nMust Step 7 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1233, "title": "busters-liver-dinner", "question_idx": 1233, "steps": ["Put all ingredients into a slow cooker, mix together.", "Put slow cooker on high for 4 to 5 hours or low all day.", "( If mixture starts to look too dry just add a little hot water.", ")", "Once cooked, divide between several plastic microwaveable tubs with lids.", "This mixture usually makes 6 to 7 meals, I freeze 4 and put the rest in the fridge.", "When ready to eat microwave with lid half off for 2 to 3 minutes on medium high."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 4 happen after Step 3?", "why_question": "Why is it not necessary for Step 4 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: busters-liver-dinner\n\nProcedure:\n1. Put all ingredients into a slow cooker, mix together.\n2. Put slow cooker on high for 4 to 5 hours or low all day.\n3. ( If mixture starts to look too dry just add a little hot water.\n4. )\n5. Once cooked, divide between several plastic microwaveable tubs with lids.\n6. This mixture usually makes 6 to 7 meals, I freeze 4 and put the rest in the fridge.\n7. When ready to eat microwave with lid half off for 2 to 3 minutes on medium high.\n\n\nMust Step 4 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1234, "title": "chicken and vegetable pie", "question_idx": 1234, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 8], "binary_question": "Must Step 9 happen after Step 3?", "why_question": "Why is it not necessary for Step 9 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\nMust Step 9 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1235, "title": "fusilli-and-meatballs", "question_idx": 1235, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [17, 18], "binary_question": "Must Step 19 happen after Step 18?", "why_question": "Why is it not necessary for Step 19 to happen after Step 18?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 19 happen after Step 18? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1236, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1236, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 13], "binary_question": "Must Step 14 happen after Step 1?", "why_question": "Why is it not necessary for Step 14 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\nMust Step 14 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1237, "title": "fusilli-and-meatballs", "question_idx": 1237, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 5 happen after Step 4?", "why_question": "Why is it not necessary for Step 5 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 5 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes", "model_answer": "Yes."}
{"plan_idx": 1238, "title": "chocolate-chocolate-cake", "question_idx": 1238, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [11, 14], "binary_question": "Must Step 15 happen after Step 12?", "why_question": "Why is it not necessary for Step 15 to happen after Step 12?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 15 happen after Step 12? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1239, "title": "chocolate-chocolate-cake", "question_idx": 1239, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why is it not necessary for Step 2 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 2 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1240, "title": "busters-liver-dinner", "question_idx": 1240, "steps": ["Put all ingredients into a slow cooker, mix together.", "Put slow cooker on high for 4 to 5 hours or low all day.", "( If mixture starts to look too dry just add a little hot water.", ")", "Once cooked, divide between several plastic microwaveable tubs with lids.", "This mixture usually makes 6 to 7 meals, I freeze 4 and put the rest in the fridge.", "When ready to eat microwave with lid half off for 2 to 3 minutes on medium high."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why is it not necessary for Step 4 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: busters-liver-dinner\n\nProcedure:\n1. Put all ingredients into a slow cooker, mix together.\n2. Put slow cooker on high for 4 to 5 hours or low all day.\n3. ( If mixture starts to look too dry just add a little hot water.\n4. )\n5. Once cooked, divide between several plastic microwaveable tubs with lids.\n6. This mixture usually makes 6 to 7 meals, I freeze 4 and put the rest in the fridge.\n7. When ready to eat microwave with lid half off for 2 to 3 minutes on medium high.\n\n\nMust Step 4 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1241, "title": "chocolate-chocolate-cake", "question_idx": 1241, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 5], "binary_question": "Must Step 6 happen after Step 4?", "why_question": "Why is it not necessary for Step 6 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 6 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1242, "title": "almond and apple cake", "question_idx": 1242, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why is it not necessary for Step 3 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\nMust Step 3 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1243, "title": "chocolate-pancake-batter", "question_idx": 1243, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 5], "binary_question": "Must Step 6 happen after Step 4?", "why_question": "Why is it not necessary for Step 6 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\nMust Step 6 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1244, "title": "brown sugar shortbread", "question_idx": 1244, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 7 happen after Step 1?", "why_question": "Why is it not necessary for Step 7 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\nMust Step 7 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1245, "title": "spiced butternut squash soup", "question_idx": 1245, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 10], "binary_question": "Must Step 11 happen after Step 2?", "why_question": "Why is it not necessary for Step 11 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\nMust Step 11 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1246, "title": "simple-basic-cupcakes", "question_idx": 1246, "steps": ["Preheat oven to 180 C / Gas 4.", "Beat butter and sugar together until light and fluffy.", "Add the eggs, one at a time, beating after each addition.", "If the batter is too thick, stir in some milk.", "Gradually add the flour, mixing well each time until evenly mixed.", "Spoon tablespoons of batter into a greased muffin tin.", "Bake in preheated oven for 15-20 minutes.", "The cake is done when a skewer inserted to the cake comes out clean.", "Let rest for fives minutes, then allow to cool fully on a wire rack.", "Decorate, if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why is it not necessary for Step 5 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: simple-basic-cupcakes\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Beat butter and sugar together until light and fluffy.\n3. Add the eggs, one at a time, beating after each addition.\n4. If the batter is too thick, stir in some milk.\n5. Gradually add the flour, mixing well each time until evenly mixed.\n6. Spoon tablespoons of batter into a greased muffin tin.\n7. Bake in preheated oven for 15-20 minutes.\n8. The cake is done when a skewer inserted to the cake comes out clean.\n9. Let rest for fives minutes, then allow to cool fully on a wire rack.\n10. Decorate, if desired.\n\n\nMust Step 5 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1247, "title": "butternut-squash-pastry-for-pies", "question_idx": 1247, "steps": ["Place the flour, egg and squash into the container of a food processor.", "Pulse until mixed into a doughy ball.", "You may need to add a little extra flour.", "Divide into two equal parts.", "Use in a pie or pastie recipe."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 3 happen after Step 2?", "why_question": "Why is it not necessary for Step 3 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: butternut-squash-pastry-for-pies\n\nProcedure:\n1. Place the flour, egg and squash into the container of a food processor.\n2. Pulse until mixed into a doughy ball.\n3. You may need to add a little extra flour.\n4. Divide into two equal parts.\n5. Use in a pie or pastie recipe.\n\n\nMust Step 3 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes", "trial_2_answer": "Yes", "model_answer": "Yes."}
{"plan_idx": 1248, "title": "chicken and vegetable pie", "question_idx": 1248, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why is it not necessary for Step 6 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\nMust Step 6 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1249, "title": "fusilli-and-meatballs", "question_idx": 1249, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [11, 18], "binary_question": "Must Step 19 happen after Step 12?", "why_question": "Why is it not necessary for Step 19 to happen after Step 12?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 19 happen after Step 12? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1250, "title": "spanish-rabbit-stew", "question_idx": 1250, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 8], "binary_question": "Must Step 9 happen after Step 8?", "why_question": "Why is it not necessary for Step 9 to happen after Step 8?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\nMust Step 9 happen after Step 8? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1251, "title": "sardine spread", "question_idx": 1251, "steps": ["Place the sardines in a bowl and roughly mash with a fork.", "Add in all of the remaining ingredients and stir well.", "Enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 3 happen after Step 2?", "why_question": "Why is it not necessary for Step 3 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: sardine spread\n\nProcedure:\n1. Place the sardines in a bowl and roughly mash with a fork.\n2. Add in all of the remaining ingredients and stir well.\n3. Enjoy!\n\n\nMust Step 3 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1252, "title": "spiced butternut squash soup", "question_idx": 1252, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 10], "binary_question": "Must Step 11 happen after Step 1?", "why_question": "Why is it not necessary for Step 11 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\nMust Step 11 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1253, "title": "chocolate-chocolate-cake", "question_idx": 1253, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [9, 11], "binary_question": "Must Step 12 happen after Step 10?", "why_question": "Why is it not necessary for Step 12 to happen after Step 10?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 12 happen after Step 10? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1254, "title": "chocolate-chocolate-cake", "question_idx": 1254, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [18, 20], "binary_question": "Must Step 21 happen after Step 19?", "why_question": "Why is it not necessary for Step 21 to happen after Step 19?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 21 happen after Step 19? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes", "model_answer": "Yes."}
{"plan_idx": 1255, "title": "almond and apple cake", "question_idx": 1255, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 9], "binary_question": "Must Step 10 happen after Step 8?", "why_question": "Why is it not necessary for Step 10 to happen after Step 8?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\nMust Step 10 happen after Step 8? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1256, "title": "tortellini-fritto-with-almond-butter", "question_idx": 1256, "steps": ["Bring a saucepan of water to the boil.", "Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.", "In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.", "If you slightly undercooked your tortellini then it's less likely to stick to the pan.", "Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.", "Continue to gently fry and stir the tortellini until golden brown.", "Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.", "Enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 6], "binary_question": "Must Step 7 happen after Step 4?", "why_question": "Why is it not necessary for Step 7 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: tortellini-fritto-with-almond-butter\n\nProcedure:\n1. Bring a saucepan of water to the boil.\n2. Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.\n3. In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.\n4. If you slightly undercooked your tortellini then it's less likely to stick to the pan.\n5. Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.\n6. Continue to gently fry and stir the tortellini until golden brown.\n7. Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.\n8. Enjoy!\n\n\nMust Step 7 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1257, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1257, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 9], "binary_question": "Must Step 10 happen after Step 1?", "why_question": "Why is it not necessary for Step 10 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\nMust Step 10 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1258, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1258, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why is it not necessary for Step 2 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\nMust Step 2 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No", "model_answer": "No."}
{"plan_idx": 1259, "title": "chocolate-chocolate-cake", "question_idx": 1259, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [10, 18], "binary_question": "Must Step 19 happen after Step 11?", "why_question": "Why is it not necessary for Step 19 to happen after Step 11?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 19 happen after Step 11? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1260, "title": "almost no fat banana bread", "question_idx": 1260, "steps": ["Preheat oven to 180 C / Gas mark 4.", "Lightly grease a 20x10cm (8x4 in) loaf tin.", "In a large bowl, stir together flour, sugar, baking powder, bicarbonate of soda and cinnamon.", "Add egg whites, bananas and apple pur\u00c3\u00a9e; stir just until combined.", "Pour batter into prepared tin.", "Bake in preheated oven for 50 to 55 minutes, until a skewer inserted into centre of loaf comes out clean.", "Turn out onto wire rack and allow to cool before slicing."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 4 happen after Step 2?", "why_question": "Why is it not necessary for Step 4 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: almost no fat banana bread\n\nProcedure:\n1. Preheat oven to 180 C / Gas mark 4.\n2. Lightly grease a 20x10cm (8x4 in) loaf tin.\n3. In a large bowl, stir together flour, sugar, baking powder, bicarbonate of soda and cinnamon.\n4. Add egg whites, bananas and apple pur\u00c3\u00a9e; stir just until combined.\n5. Pour batter into prepared tin.\n6. Bake in preheated oven for 50 to 55 minutes, until a skewer inserted into centre of loaf comes out clean.\n7. Turn out onto wire rack and allow to cool before slicing.\n\n\nMust Step 4 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No", "model_answer": "No."}
{"plan_idx": 1261, "title": "brown sugar shortbread", "question_idx": 1261, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why is it not necessary for Step 3 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\nMust Step 3 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1262, "title": "chocolate-chocolate-cake", "question_idx": 1262, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [15, 18], "binary_question": "Must Step 19 happen after Step 16?", "why_question": "Why is it not necessary for Step 19 to happen after Step 16?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 19 happen after Step 16? Select between yes or no\n\n", "trial_0_answer": "Yes", "trial_1_answer": "Yes", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1263, "title": "tangy-gammon-in-cider", "question_idx": 1263, "steps": ["Preheat the oven to 200 degrees /gas mark 6.", "Start by piercing each tomato once and covering with boiling water to loosen the skins.", "Drain the onions and chop each one in half.", "Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.", "Put the onions, tomatoes and apples into a casserole dish.", "Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.", "Place in the dish and repeat with the other gammon steaks.", "Pour cider over the steaks, cover the top with a lid or tin foil.", "Cook for 1 hour."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why is it not necessary for Step 3 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: tangy-gammon-in-cider\n\nProcedure:\n1. Preheat the oven to 200 degrees /gas mark 6.\n2. Start by piercing each tomato once and covering with boiling water to loosen the skins.\n3. Drain the onions and chop each one in half.\n4. Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.\n5. Put the onions, tomatoes and apples into a casserole dish.\n6. Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.\n7. Place in the dish and repeat with the other gammon steaks.\n8. Pour cider over the steaks, cover the top with a lid or tin foil.\n9. Cook for 1 hour.\n\n\nMust Step 3 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1264, "title": "green-tofu-curry", "question_idx": 1264, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 7 happen after Step 1?", "why_question": "Why is it not necessary for Step 7 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\nMust Step 7 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1265, "title": "almond and apple cake", "question_idx": 1265, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 5 happen after Step 3?", "why_question": "Why is it not necessary for Step 5 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\nMust Step 5 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1266, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1266, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 12], "binary_question": "Must Step 13 happen after Step 8?", "why_question": "Why is it not necessary for Step 13 to happen after Step 8?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\nMust Step 13 happen after Step 8? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1267, "title": "green-tofu-curry", "question_idx": 1267, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 9], "binary_question": "Must Step 10 happen after Step 3?", "why_question": "Why is it not necessary for Step 10 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\nMust Step 10 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1268, "title": "busters-liver-dinner", "question_idx": 1268, "steps": ["Put all ingredients into a slow cooker, mix together.", "Put slow cooker on high for 4 to 5 hours or low all day.", "( If mixture starts to look too dry just add a little hot water.", ")", "Once cooked, divide between several plastic microwaveable tubs with lids.", "This mixture usually makes 6 to 7 meals, I freeze 4 and put the rest in the fridge.", "When ready to eat microwave with lid half off for 2 to 3 minutes on medium high."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 6], "binary_question": "Must Step 7 happen after Step 4?", "why_question": "Why is it not necessary for Step 7 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: busters-liver-dinner\n\nProcedure:\n1. Put all ingredients into a slow cooker, mix together.\n2. Put slow cooker on high for 4 to 5 hours or low all day.\n3. ( If mixture starts to look too dry just add a little hot water.\n4. )\n5. Once cooked, divide between several plastic microwaveable tubs with lids.\n6. This mixture usually makes 6 to 7 meals, I freeze 4 and put the rest in the fridge.\n7. When ready to eat microwave with lid half off for 2 to 3 minutes on medium high.\n\n\nMust Step 7 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1269, "title": "fusilli-and-meatballs", "question_idx": 1269, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 8], "binary_question": "Must Step 9 happen after Step 2?", "why_question": "Why is it not necessary for Step 9 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 9 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1270, "title": "smoked-salmon-and-grapefruit-salad", "question_idx": 1270, "steps": ["Top and tail the grapefruits.", "Slice the skin off the grapefruit over a bowl.", "This is to catch any juices.", "Using a small knife, segment the grapefruits over the juice bowl.", "Arrange the lamb's lettuce onto each serving plate or a large salad bowl.", "Top with grapefruit segments and smoked salmon.", "Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.", "Pour over the salad and serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 3 happen after Step 2?", "why_question": "Why is it not necessary for Step 3 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: smoked-salmon-and-grapefruit-salad\n\nProcedure:\n1. Top and tail the grapefruits.\n2. Slice the skin off the grapefruit over a bowl.\n3. This is to catch any juices.\n4. Using a small knife, segment the grapefruits over the juice bowl.\n5. Arrange the lamb's lettuce onto each serving plate or a large salad bowl.\n6. Top with grapefruit segments and smoked salmon.\n7. Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.\n8. Pour over the salad and serve.\n\n\nMust Step 3 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1271, "title": "vegetable-terrine", "question_idx": 1271, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [8, 9], "binary_question": "Must Step 10 happen after Step 9?", "why_question": "Why is it not necessary for Step 10 to happen after Step 9?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\nMust Step 10 happen after Step 9? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1272, "title": "banana-split-cake", "question_idx": 1272, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 6], "binary_question": "Must Step 7 happen after Step 5?", "why_question": "Why is it not necessary for Step 7 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\nMust Step 7 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1273, "title": "best-ever-margarita", "question_idx": 1273, "steps": ["Rim 2 margarita glasses with salt if desired and fill with ice.", "Pour the tequila, lime cordial, triple sec and lemon-lime soft drink into a cocktail shaker filled with ice.", "Hold your hand firmly over over the top of the shaker so the top doesn't pop off from the fizzy soft drink and shake vigorously.", "Pour into prepared margarita glasses and serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why is it not necessary for Step 2 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: best-ever-margarita\n\nProcedure:\n1. Rim 2 margarita glasses with salt if desired and fill with ice.\n2. Pour the tequila, lime cordial, triple sec and lemon-lime soft drink into a cocktail shaker filled with ice.\n3. Hold your hand firmly over over the top of the shaker so the top doesn't pop off from the fizzy soft drink and shake vigorously.\n4. Pour into prepared margarita glasses and serve.\n\n\nMust Step 2 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1274, "title": "spanish-rabbit-stew", "question_idx": 1274, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 10], "binary_question": "Must Step 11 happen after Step 5?", "why_question": "Why is it not necessary for Step 11 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\nMust Step 11 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1275, "title": "vegetable-terrine", "question_idx": 1275, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 9], "binary_question": "Must Step 10 happen after Step 1?", "why_question": "Why is it not necessary for Step 10 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\nMust Step 10 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1276, "title": "fusilli-and-meatballs", "question_idx": 1276, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 18], "binary_question": "Must Step 19 happen after Step 6?", "why_question": "Why is it not necessary for Step 19 to happen after Step 6?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 19 happen after Step 6? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1277, "title": "vegetable-terrine", "question_idx": 1277, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 4 happen after Step 2?", "why_question": "Why is it not necessary for Step 4 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\nMust Step 4 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1278, "title": "chocolate-chocolate-cake", "question_idx": 1278, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 8], "binary_question": "Must Step 9 happen after Step 2?", "why_question": "Why is it not necessary for Step 9 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 9 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1279, "title": "fusilli-and-meatballs", "question_idx": 1279, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 10], "binary_question": "Must Step 11 happen after Step 6?", "why_question": "Why is it not necessary for Step 11 to happen after Step 6?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 11 happen after Step 6? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1280, "title": "curried bbq mussels", "question_idx": 1280, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 6], "binary_question": "Must Step 7 happen after Step 5?", "why_question": "Why is it not necessary for Step 7 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\nMust Step 7 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1281, "title": "very-vanilla-ry-cheesecake", "question_idx": 1281, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 5], "binary_question": "Must Step 6 happen after Step 4?", "why_question": "Why is it not necessary for Step 6 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\nMust Step 6 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1282, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1282, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 12], "binary_question": "Must Step 13 happen after Step 7?", "why_question": "Why is it not necessary for Step 13 to happen after Step 7?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\nMust Step 13 happen after Step 7? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1283, "title": "spiced-pumpkin-teabread", "question_idx": 1283, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why is it not necessary for Step 2 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\nMust Step 2 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1284, "title": "spiced-pumpkin-teabread", "question_idx": 1284, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why is it not necessary for Step 5 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\nMust Step 5 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1285, "title": "green-tofu-curry", "question_idx": 1285, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 7], "binary_question": "Must Step 8 happen after Step 3?", "why_question": "Why is it not necessary for Step 8 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\nMust Step 8 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1286, "title": "balsamic-and-mozzarella-chicken", "question_idx": 1286, "steps": ["Place chicken in a shallow dish or large resealable plastic bag.", "Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.", "Coat a large frying pan lightly with oil, and set over low heat.", "Remove the chicken from the marinade and discard the marinade.", "Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.", "Arrange chicken on a serving platter.", "Place a generous slice of fresh mozzarella on top of each piece.", "Place a leaf of basil on top of the cheese, and cover with a slice of tomato.", "Drizzle balsamic vinegar over the platter, then season with salt and pepper.", "Serve!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why is it not necessary for Step 3 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: balsamic-and-mozzarella-chicken\n\nProcedure:\n1. Place chicken in a shallow dish or large resealable plastic bag.\n2. Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.\n3. Coat a large frying pan lightly with oil, and set over low heat.\n4. Remove the chicken from the marinade and discard the marinade.\n5. Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.\n6. Arrange chicken on a serving platter.\n7. Place a generous slice of fresh mozzarella on top of each piece.\n8. Place a leaf of basil on top of the cheese, and cover with a slice of tomato.\n9. Drizzle balsamic vinegar over the platter, then season with salt and pepper.\n10. Serve!\n\n\nMust Step 3 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1287, "title": "tangy-gammon-in-cider", "question_idx": 1287, "steps": ["Preheat the oven to 200 degrees /gas mark 6.", "Start by piercing each tomato once and covering with boiling water to loosen the skins.", "Drain the onions and chop each one in half.", "Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.", "Put the onions, tomatoes and apples into a casserole dish.", "Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.", "Place in the dish and repeat with the other gammon steaks.", "Pour cider over the steaks, cover the top with a lid or tin foil.", "Cook for 1 hour."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 4 happen after Step 3?", "why_question": "Why is it not necessary for Step 4 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: tangy-gammon-in-cider\n\nProcedure:\n1. Preheat the oven to 200 degrees /gas mark 6.\n2. Start by piercing each tomato once and covering with boiling water to loosen the skins.\n3. Drain the onions and chop each one in half.\n4. Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.\n5. Put the onions, tomatoes and apples into a casserole dish.\n6. Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.\n7. Place in the dish and repeat with the other gammon steaks.\n8. Pour cider over the steaks, cover the top with a lid or tin foil.\n9. Cook for 1 hour.\n\n\nMust Step 4 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1288, "title": "chicken and vegetable pie", "question_idx": 1288, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 10], "binary_question": "Must Step 11 happen after Step 8?", "why_question": "Why is it not necessary for Step 11 to happen after Step 8?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\nMust Step 11 happen after Step 8? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1289, "title": "strawberry-tiramisu-trifle", "question_idx": 1289, "steps": ["Set 3 strawberries for the garnish aside, and cut the rest into slices.", "In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.", "Then stir in the custard and finally fold in the whipped cream.", "Brush the sponge fingers with the remaining coffee.", "Line a glass bowl with one layer of the soaked sponge fingers.", "Spread half of the strawberries over the sponge fingers.", "Sprinkle half of the grated chocolate over that and then half of the custard mixture.", "Repeat the layers in order again.", "Cut the remaining 3 strawberries in half and lay them on top of the trifle.", "Cover and leave in the fridge for at least 4 hours, best overnight."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 5 happen after Step 2?", "why_question": "Why is it not necessary for Step 5 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: strawberry-tiramisu-trifle\n\nProcedure:\n1. Set 3 strawberries for the garnish aside, and cut the rest into slices.\n2. In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.\n3. Then stir in the custard and finally fold in the whipped cream.\n4. Brush the sponge fingers with the remaining coffee.\n5. Line a glass bowl with one layer of the soaked sponge fingers.\n6. Spread half of the strawberries over the sponge fingers.\n7. Sprinkle half of the grated chocolate over that and then half of the custard mixture.\n8. Repeat the layers in order again.\n9. Cut the remaining 3 strawberries in half and lay them on top of the trifle.\n10. Cover and leave in the fridge for at least 4 hours, best overnight.\n\n\nMust Step 5 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No", "trial_1_answer": "No", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1290, "title": "curried bbq mussels", "question_idx": 1290, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 7 happen after Step 1?", "why_question": "Why is it not necessary for Step 7 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\nMust Step 7 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1291, "title": "almost no fat banana bread", "question_idx": 1291, "steps": ["Preheat oven to 180 C / Gas mark 4.", "Lightly grease a 20x10cm (8x4 in) loaf tin.", "In a large bowl, stir together flour, sugar, baking powder, bicarbonate of soda and cinnamon.", "Add egg whites, bananas and apple pur\u00c3\u00a9e; stir just until combined.", "Pour batter into prepared tin.", "Bake in preheated oven for 50 to 55 minutes, until a skewer inserted into centre of loaf comes out clean.", "Turn out onto wire rack and allow to cool before slicing."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why is it not necessary for Step 2 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: almost no fat banana bread\n\nProcedure:\n1. Preheat oven to 180 C / Gas mark 4.\n2. Lightly grease a 20x10cm (8x4 in) loaf tin.\n3. In a large bowl, stir together flour, sugar, baking powder, bicarbonate of soda and cinnamon.\n4. Add egg whites, bananas and apple pur\u00c3\u00a9e; stir just until combined.\n5. Pour batter into prepared tin.\n6. Bake in preheated oven for 50 to 55 minutes, until a skewer inserted into centre of loaf comes out clean.\n7. Turn out onto wire rack and allow to cool before slicing.\n\n\nMust Step 2 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1292, "title": "lightly spiced tomato and red lentil soup", "question_idx": 1292, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 9], "binary_question": "Must Step 10 happen after Step 7?", "why_question": "Why is it not necessary for Step 10 to happen after Step 7?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\nMust Step 10 happen after Step 7? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1293, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1293, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 12], "binary_question": "Must Step 13 happen after Step 5?", "why_question": "Why is it not necessary for Step 13 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\nMust Step 13 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1294, "title": "banana-split-cake", "question_idx": 1294, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why is it not necessary for Step 6 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\nMust Step 6 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No", "model_answer": "No."}
{"plan_idx": 1295, "title": "green-tofu-curry", "question_idx": 1295, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 8], "binary_question": "Must Step 9 happen after Step 3?", "why_question": "Why is it not necessary for Step 9 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\nMust Step 9 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1296, "title": "cloud-bread", "question_idx": 1296, "steps": ["Preheat oven to 150 C / Gas mark 2.", "Line a baking tray with baking paper.", "Mix cream cheese and egg yolks together until smooth.", "Place egg whites and baking powder in a glass, metal, or ceramic bowl;", "beat together until stiff peaks form.", "Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.", "Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.", "Bake in the preheated oven until golden brown, 17 to 20 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 5 happen after Step 3?", "why_question": "Why is it not necessary for Step 5 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: cloud-bread\n\nProcedure:\n1. Preheat oven to 150 C / Gas mark 2.\n2. Line a baking tray with baking paper.\n3. Mix cream cheese and egg yolks together until smooth.\n4. Place egg whites and baking powder in a glass, metal, or ceramic bowl;\n5. beat together until stiff peaks form.\n6. Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.\n7. Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.\n8. Bake in the preheated oven until golden brown, 17 to 20 minutes.\n\n\nMust Step 5 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1297, "title": "spanish-rabbit-stew", "question_idx": 1297, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 7 happen after Step 2?", "why_question": "Why is it not necessary for Step 7 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\nMust Step 7 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "Yes", "trial_1_answer": "Yes", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1298, "title": "curried bbq mussels", "question_idx": 1298, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 7 happen after Step 2?", "why_question": "Why is it not necessary for Step 7 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\nMust Step 7 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No", "model_answer": "No."}
{"plan_idx": 1299, "title": "feta-and-sundried-tomato-spinach-rolls", "question_idx": 1299, "steps": ["Preheat grill.", "Mix together cream cheese, feta, sundried tomatoes, basil and garlic.", "Stir until creamy, with no lumps.", "Blanch the spinach leaves.", "Wrap a dollop of cheese mix in each spinach leaf.", "Brush with olive oil.", "Sprinkle almonds on the top or alternately roll them in the almonds", "Grill spinach rolls until slightly crispy on top.", "Let cool for 10 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 4 happen after Step 3?", "why_question": "Why is it not necessary for Step 4 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: feta-and-sundried-tomato-spinach-rolls\n\nProcedure:\n1. Preheat grill.\n2. Mix together cream cheese, feta, sundried tomatoes, basil and garlic.\n3. Stir until creamy, with no lumps.\n4. Blanch the spinach leaves.\n5. Wrap a dollop of cheese mix in each spinach leaf.\n6. Brush with olive oil.\n7. Sprinkle almonds on the top or alternately roll them in the almonds\n8. Grill spinach rolls until slightly crispy on top.\n9. Let cool for 10 minutes.\n\n\nMust Step 4 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1300, "title": "spanish-rabbit-stew", "question_idx": 1300, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 10], "binary_question": "Must Step 11 happen after Step 3?", "why_question": "Why is it not necessary for Step 11 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\nMust Step 11 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1301, "title": "chocolate-chocolate-cake", "question_idx": 1301, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 18], "binary_question": "Must Step 19 happen after Step 8?", "why_question": "Why is it not necessary for Step 19 to happen after Step 8?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 19 happen after Step 8? Select between yes or no\n\n", "trial_0_answer": "No", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1302, "title": "chicken and vegetable pie", "question_idx": 1302, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [8, 10], "binary_question": "Must Step 11 happen after Step 9?", "why_question": "Why is it not necessary for Step 11 to happen after Step 9?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\nMust Step 11 happen after Step 9? Select between yes or no\n\n", "trial_0_answer": "Yes", "trial_1_answer": "Yes", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1303, "title": "lightly spiced tomato and red lentil soup", "question_idx": 1303, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 7 happen after Step 3?", "why_question": "Why is it not necessary for Step 7 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\nMust Step 7 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1304, "title": "chocolate-chocolate-cake", "question_idx": 1304, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 8], "binary_question": "Must Step 9 happen after Step 3?", "why_question": "Why is it not necessary for Step 9 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 9 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1305, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1305, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 11], "binary_question": "Must Step 12 happen after Step 3?", "why_question": "Why is it not necessary for Step 12 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\nMust Step 12 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1306, "title": "fusilli-and-meatballs", "question_idx": 1306, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 12], "binary_question": "Must Step 13 happen after Step 5?", "why_question": "Why is it not necessary for Step 13 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 13 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1307, "title": "vegetable-terrine", "question_idx": 1307, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 8], "binary_question": "Must Step 9 happen after Step 2?", "why_question": "Why is it not necessary for Step 9 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\nMust Step 9 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1308, "title": "chocolate-chocolate-cake", "question_idx": 1308, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [18, 19], "binary_question": "Must Step 20 happen after Step 19?", "why_question": "Why is it not necessary for Step 20 to happen after Step 19?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 20 happen after Step 19? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1309, "title": "tortellini-fritto-with-almond-butter", "question_idx": 1309, "steps": ["Bring a saucepan of water to the boil.", "Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.", "In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.", "If you slightly undercooked your tortellini then it's less likely to stick to the pan.", "Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.", "Continue to gently fry and stir the tortellini until golden brown.", "Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.", "Enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 4 happen after Step 2?", "why_question": "Why is it not necessary for Step 4 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: tortellini-fritto-with-almond-butter\n\nProcedure:\n1. Bring a saucepan of water to the boil.\n2. Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.\n3. In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.\n4. If you slightly undercooked your tortellini then it's less likely to stick to the pan.\n5. Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.\n6. Continue to gently fry and stir the tortellini until golden brown.\n7. Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.\n8. Enjoy!\n\n\nMust Step 4 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes", "model_answer": "Yes."}
{"plan_idx": 1310, "title": "fusilli-and-meatballs", "question_idx": 1310, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [9, 13], "binary_question": "Must Step 14 happen after Step 10?", "why_question": "Why is it not necessary for Step 14 to happen after Step 10?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 14 happen after Step 10? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1311, "title": "curried bbq mussels", "question_idx": 1311, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 7], "binary_question": "Must Step 8 happen after Step 1?", "why_question": "Why is it not necessary for Step 8 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\nMust Step 8 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1312, "title": "chocolate-chocolate-cake", "question_idx": 1312, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 10], "binary_question": "Must Step 11 happen after Step 8?", "why_question": "Why is it not necessary for Step 11 to happen after Step 8?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 11 happen after Step 8? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1313, "title": "very-vanilla-ry-cheesecake", "question_idx": 1313, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 9], "binary_question": "Must Step 10 happen after Step 8?", "why_question": "Why is it not necessary for Step 10 to happen after Step 8?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\nMust Step 10 happen after Step 8? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1314, "title": "feta-and-sundried-tomato-spinach-rolls", "question_idx": 1314, "steps": ["Preheat grill.", "Mix together cream cheese, feta, sundried tomatoes, basil and garlic.", "Stir until creamy, with no lumps.", "Blanch the spinach leaves.", "Wrap a dollop of cheese mix in each spinach leaf.", "Brush with olive oil.", "Sprinkle almonds on the top or alternately roll them in the almonds", "Grill spinach rolls until slightly crispy on top.", "Let cool for 10 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why is it not necessary for Step 6 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: feta-and-sundried-tomato-spinach-rolls\n\nProcedure:\n1. Preheat grill.\n2. Mix together cream cheese, feta, sundried tomatoes, basil and garlic.\n3. Stir until creamy, with no lumps.\n4. Blanch the spinach leaves.\n5. Wrap a dollop of cheese mix in each spinach leaf.\n6. Brush with olive oil.\n7. Sprinkle almonds on the top or alternately roll them in the almonds\n8. Grill spinach rolls until slightly crispy on top.\n9. Let cool for 10 minutes.\n\n\nMust Step 6 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1315, "title": "spiced butternut squash soup", "question_idx": 1315, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 7], "binary_question": "Must Step 8 happen after Step 6?", "why_question": "Why is it not necessary for Step 8 to happen after Step 6?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\nMust Step 8 happen after Step 6? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1316, "title": "chocolate-chocolate-cake", "question_idx": 1316, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 12], "binary_question": "Must Step 13 happen after Step 1?", "why_question": "Why is it not necessary for Step 13 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 13 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1317, "title": "very-vanilla-ry-cheesecake", "question_idx": 1317, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 7], "binary_question": "Must Step 8 happen after Step 2?", "why_question": "Why is it not necessary for Step 8 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\nMust Step 8 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1318, "title": "curried bbq mussels", "question_idx": 1318, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why is it not necessary for Step 4 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\nMust Step 4 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "No", "model_answer": "No."}
{"plan_idx": 1319, "title": "chocolate-chocolate-cake", "question_idx": 1319, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 14], "binary_question": "Must Step 15 happen after Step 5?", "why_question": "Why is it not necessary for Step 15 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 15 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1320, "title": "busters-liver-dinner", "question_idx": 1320, "steps": ["Put all ingredients into a slow cooker, mix together.", "Put slow cooker on high for 4 to 5 hours or low all day.", "( If mixture starts to look too dry just add a little hot water.", ")", "Once cooked, divide between several plastic microwaveable tubs with lids.", "This mixture usually makes 6 to 7 meals, I freeze 4 and put the rest in the fridge.", "When ready to eat microwave with lid half off for 2 to 3 minutes on medium high."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 4 happen after Step 2?", "why_question": "Why is it not necessary for Step 4 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: busters-liver-dinner\n\nProcedure:\n1. Put all ingredients into a slow cooker, mix together.\n2. Put slow cooker on high for 4 to 5 hours or low all day.\n3. ( If mixture starts to look too dry just add a little hot water.\n4. )\n5. Once cooked, divide between several plastic microwaveable tubs with lids.\n6. This mixture usually makes 6 to 7 meals, I freeze 4 and put the rest in the fridge.\n7. When ready to eat microwave with lid half off for 2 to 3 minutes on medium high.\n\n\nMust Step 4 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1321, "title": "fusilli-and-meatballs", "question_idx": 1321, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [15, 18], "binary_question": "Must Step 19 happen after Step 16?", "why_question": "Why is it not necessary for Step 19 to happen after Step 16?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 19 happen after Step 16? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1322, "title": "cloud-bread", "question_idx": 1322, "steps": ["Preheat oven to 150 C / Gas mark 2.", "Line a baking tray with baking paper.", "Mix cream cheese and egg yolks together until smooth.", "Place egg whites and baking powder in a glass, metal, or ceramic bowl;", "beat together until stiff peaks form.", "Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.", "Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.", "Bake in the preheated oven until golden brown, 17 to 20 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why is it not necessary for Step 2 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: cloud-bread\n\nProcedure:\n1. Preheat oven to 150 C / Gas mark 2.\n2. Line a baking tray with baking paper.\n3. Mix cream cheese and egg yolks together until smooth.\n4. Place egg whites and baking powder in a glass, metal, or ceramic bowl;\n5. beat together until stiff peaks form.\n6. Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.\n7. Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.\n8. Bake in the preheated oven until golden brown, 17 to 20 minutes.\n\n\nMust Step 2 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes", "model_answer": "Yes."}
{"plan_idx": 1323, "title": "chicken and vegetable pie", "question_idx": 1323, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 7], "binary_question": "Must Step 8 happen after Step 3?", "why_question": "Why is it not necessary for Step 8 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\nMust Step 8 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1324, "title": "smoked-salmon-and-grapefruit-salad", "question_idx": 1324, "steps": ["Top and tail the grapefruits.", "Slice the skin off the grapefruit over a bowl.", "This is to catch any juices.", "Using a small knife, segment the grapefruits over the juice bowl.", "Arrange the lamb's lettuce onto each serving plate or a large salad bowl.", "Top with grapefruit segments and smoked salmon.", "Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.", "Pour over the salad and serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 4 happen after Step 3?", "why_question": "Why is it not necessary for Step 4 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: smoked-salmon-and-grapefruit-salad\n\nProcedure:\n1. Top and tail the grapefruits.\n2. Slice the skin off the grapefruit over a bowl.\n3. This is to catch any juices.\n4. Using a small knife, segment the grapefruits over the juice bowl.\n5. Arrange the lamb's lettuce onto each serving plate or a large salad bowl.\n6. Top with grapefruit segments and smoked salmon.\n7. Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.\n8. Pour over the salad and serve.\n\n\nMust Step 4 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1325, "title": "cloud-bread", "question_idx": 1325, "steps": ["Preheat oven to 150 C / Gas mark 2.", "Line a baking tray with baking paper.", "Mix cream cheese and egg yolks together until smooth.", "Place egg whites and baking powder in a glass, metal, or ceramic bowl;", "beat together until stiff peaks form.", "Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.", "Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.", "Bake in the preheated oven until golden brown, 17 to 20 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 4 happen after Step 2?", "why_question": "Why is it not necessary for Step 4 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: cloud-bread\n\nProcedure:\n1. Preheat oven to 150 C / Gas mark 2.\n2. Line a baking tray with baking paper.\n3. Mix cream cheese and egg yolks together until smooth.\n4. Place egg whites and baking powder in a glass, metal, or ceramic bowl;\n5. beat together until stiff peaks form.\n6. Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.\n7. Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.\n8. Bake in the preheated oven until golden brown, 17 to 20 minutes.\n\n\nMust Step 4 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No", "trial_1_answer": "No.", "trial_2_answer": "No", "model_answer": "No."}
{"plan_idx": 1326, "title": "spiced-pumpkin-teabread", "question_idx": 1326, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why is it not necessary for Step 3 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\nMust Step 3 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1327, "title": "almond and apple cake", "question_idx": 1327, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 9], "binary_question": "Must Step 10 happen after Step 5?", "why_question": "Why is it not necessary for Step 10 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\nMust Step 10 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1328, "title": "butternut-squash-pastry-for-pies", "question_idx": 1328, "steps": ["Place the flour, egg and squash into the container of a food processor.", "Pulse until mixed into a doughy ball.", "You may need to add a little extra flour.", "Divide into two equal parts.", "Use in a pie or pastie recipe."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why is it not necessary for Step 3 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: butternut-squash-pastry-for-pies\n\nProcedure:\n1. Place the flour, egg and squash into the container of a food processor.\n2. Pulse until mixed into a doughy ball.\n3. You may need to add a little extra flour.\n4. Divide into two equal parts.\n5. Use in a pie or pastie recipe.\n\n\nMust Step 3 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1329, "title": "green-tofu-curry", "question_idx": 1329, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 5 happen after Step 2?", "why_question": "Why is it not necessary for Step 5 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\nMust Step 5 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1330, "title": "spiced-pumpkin-teabread", "question_idx": 1330, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why is it not necessary for Step 6 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\nMust Step 6 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1331, "title": "green-tofu-curry", "question_idx": 1331, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 8], "binary_question": "Must Step 9 happen after Step 4?", "why_question": "Why is it not necessary for Step 9 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\nMust Step 9 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1332, "title": "spiced-guava-cake", "question_idx": 1332, "steps": ["Preheat oven to 180 C / Gas 4.", "Grease and flour one 23x13cm loaf tin.", "Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.", "In another bowl, mix together guava pulp and juice.", "In another bowl, cream together butter and sugar.", "Add eggs, one at a time.", "Add flour mixture and guava mixture alternately to creamed mixture.", "Pour batter into prepared tin.", "Bake at 180 C / Gas 4 for 30-35 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 5 happen after Step 2?", "why_question": "Why is it not necessary for Step 5 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced-guava-cake\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Grease and flour one 23x13cm loaf tin.\n3. Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.\n4. In another bowl, mix together guava pulp and juice.\n5. In another bowl, cream together butter and sugar.\n6. Add eggs, one at a time.\n7. Add flour mixture and guava mixture alternately to creamed mixture.\n8. Pour batter into prepared tin.\n9. Bake at 180 C / Gas 4 for 30-35 minutes.\n\n\nMust Step 5 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1333, "title": "green-tofu-curry", "question_idx": 1333, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why is it not necessary for Step 6 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\nMust Step 6 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1334, "title": "fusilli-and-meatballs", "question_idx": 1334, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 8], "binary_question": "Must Step 9 happen after Step 1?", "why_question": "Why is it not necessary for Step 9 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 9 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1335, "title": "chicken and vegetable pie", "question_idx": 1335, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 9], "binary_question": "Must Step 10 happen after Step 1?", "why_question": "Why is it not necessary for Step 10 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\nMust Step 10 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1336, "title": "fusilli-and-meatballs", "question_idx": 1336, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [14, 18], "binary_question": "Must Step 19 happen after Step 15?", "why_question": "Why is it not necessary for Step 19 to happen after Step 15?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 19 happen after Step 15? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1337, "title": "fusilli-and-meatballs", "question_idx": 1337, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 13], "binary_question": "Must Step 14 happen after Step 4?", "why_question": "Why is it not necessary for Step 14 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 14 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1338, "title": "fusilli-and-meatballs", "question_idx": 1338, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 18], "binary_question": "Must Step 19 happen after Step 8?", "why_question": "Why is it not necessary for Step 19 to happen after Step 8?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 19 happen after Step 8? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1339, "title": "chocolate-chocolate-cake", "question_idx": 1339, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [11, 18], "binary_question": "Must Step 19 happen after Step 12?", "why_question": "Why is it not necessary for Step 19 to happen after Step 12?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 19 happen after Step 12? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1340, "title": "almond and apple cake", "question_idx": 1340, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 7 happen after Step 1?", "why_question": "Why is it not necessary for Step 7 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\nMust Step 7 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1341, "title": "tortellini-fritto-with-almond-butter", "question_idx": 1341, "steps": ["Bring a saucepan of water to the boil.", "Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.", "In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.", "If you slightly undercooked your tortellini then it's less likely to stick to the pan.", "Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.", "Continue to gently fry and stir the tortellini until golden brown.", "Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.", "Enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 7], "binary_question": "Must Step 8 happen after Step 5?", "why_question": "Why is it not necessary for Step 8 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: tortellini-fritto-with-almond-butter\n\nProcedure:\n1. Bring a saucepan of water to the boil.\n2. Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.\n3. In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.\n4. If you slightly undercooked your tortellini then it's less likely to stick to the pan.\n5. Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.\n6. Continue to gently fry and stir the tortellini until golden brown.\n7. Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.\n8. Enjoy!\n\n\nMust Step 8 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1342, "title": "almond and apple cake", "question_idx": 1342, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 9], "binary_question": "Must Step 10 happen after Step 6?", "why_question": "Why is it not necessary for Step 10 to happen after Step 6?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\nMust Step 10 happen after Step 6? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1343, "title": "chocolate-pancake-batter", "question_idx": 1343, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why is it not necessary for Step 6 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\nMust Step 6 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1344, "title": "vegetable-terrine", "question_idx": 1344, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 5 happen after Step 2?", "why_question": "Why is it not necessary for Step 5 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\nMust Step 5 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1345, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1345, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why is it not necessary for Step 3 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\nMust Step 3 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1346, "title": "spanish-rabbit-stew", "question_idx": 1346, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 7], "binary_question": "Must Step 8 happen after Step 7?", "why_question": "Why is it not necessary for Step 8 to happen after Step 7?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\nMust Step 8 happen after Step 7? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1347, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1347, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [10, 11], "binary_question": "Must Step 12 happen after Step 11?", "why_question": "Why is it not necessary for Step 12 to happen after Step 11?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\nMust Step 12 happen after Step 11? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1348, "title": "chocolate-chocolate-cake", "question_idx": 1348, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [8, 11], "binary_question": "Must Step 12 happen after Step 9?", "why_question": "Why is it not necessary for Step 12 to happen after Step 9?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 12 happen after Step 9? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1349, "title": "fusilli-and-meatballs", "question_idx": 1349, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 13], "binary_question": "Must Step 14 happen after Step 3?", "why_question": "Why is it not necessary for Step 14 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 14 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1350, "title": "fusilli-and-meatballs", "question_idx": 1350, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 10], "binary_question": "Must Step 11 happen after Step 2?", "why_question": "Why is it not necessary for Step 11 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 11 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1351, "title": "no-sugar-rock-cakes", "question_idx": 1351, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 4 happen after Step 3?", "why_question": "Why is it not necessary for Step 4 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\nMust Step 4 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "Yes", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1352, "title": "chicken and vegetable pie", "question_idx": 1352, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 13], "binary_question": "Must Step 14 happen after Step 1?", "why_question": "Why is it not necessary for Step 14 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\nMust Step 14 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No", "model_answer": "No."}
{"plan_idx": 1353, "title": "almond and apple cake", "question_idx": 1353, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why is it not necessary for Step 4 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\nMust Step 4 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1354, "title": "strawberry-tiramisu-trifle", "question_idx": 1354, "steps": ["Set 3 strawberries for the garnish aside, and cut the rest into slices.", "In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.", "Then stir in the custard and finally fold in the whipped cream.", "Brush the sponge fingers with the remaining coffee.", "Line a glass bowl with one layer of the soaked sponge fingers.", "Spread half of the strawberries over the sponge fingers.", "Sprinkle half of the grated chocolate over that and then half of the custard mixture.", "Repeat the layers in order again.", "Cut the remaining 3 strawberries in half and lay them on top of the trifle.", "Cover and leave in the fridge for at least 4 hours, best overnight."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why is it not necessary for Step 3 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: strawberry-tiramisu-trifle\n\nProcedure:\n1. Set 3 strawberries for the garnish aside, and cut the rest into slices.\n2. In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.\n3. Then stir in the custard and finally fold in the whipped cream.\n4. Brush the sponge fingers with the remaining coffee.\n5. Line a glass bowl with one layer of the soaked sponge fingers.\n6. Spread half of the strawberries over the sponge fingers.\n7. Sprinkle half of the grated chocolate over that and then half of the custard mixture.\n8. Repeat the layers in order again.\n9. Cut the remaining 3 strawberries in half and lay them on top of the trifle.\n10. Cover and leave in the fridge for at least 4 hours, best overnight.\n\n\nMust Step 3 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1355, "title": "spiced butternut squash soup", "question_idx": 1355, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 8], "binary_question": "Must Step 9 happen after Step 3?", "why_question": "Why is it not necessary for Step 9 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\nMust Step 9 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1356, "title": "very-vanilla-ry-cheesecake", "question_idx": 1356, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 9], "binary_question": "Must Step 10 happen after Step 6?", "why_question": "Why is it not necessary for Step 10 to happen after Step 6?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\nMust Step 10 happen after Step 6? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1357, "title": "chicken-prawn-and-rice-soup", "question_idx": 1357, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 9], "binary_question": "Must Step 10 happen after Step 7?", "why_question": "Why is it not necessary for Step 10 to happen after Step 7?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\nMust Step 10 happen after Step 7? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1358, "title": "chicken and vegetable pie", "question_idx": 1358, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 9], "binary_question": "Must Step 10 happen after Step 8?", "why_question": "Why is it not necessary for Step 10 to happen after Step 8?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\nMust Step 10 happen after Step 8? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1359, "title": "tortellini-fritto-with-almond-butter", "question_idx": 1359, "steps": ["Bring a saucepan of water to the boil.", "Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.", "In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.", "If you slightly undercooked your tortellini then it's less likely to stick to the pan.", "Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.", "Continue to gently fry and stir the tortellini until golden brown.", "Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.", "Enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 7], "binary_question": "Must Step 8 happen after Step 3?", "why_question": "Why is it not necessary for Step 8 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: tortellini-fritto-with-almond-butter\n\nProcedure:\n1. Bring a saucepan of water to the boil.\n2. Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.\n3. In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.\n4. If you slightly undercooked your tortellini then it's less likely to stick to the pan.\n5. Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.\n6. Continue to gently fry and stir the tortellini until golden brown.\n7. Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.\n8. Enjoy!\n\n\nMust Step 8 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1360, "title": "spanish-rabbit-stew", "question_idx": 1360, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 5 happen after Step 4?", "why_question": "Why is it not necessary for Step 5 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\nMust Step 5 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1361, "title": "curried bbq mussels", "question_idx": 1361, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 4 happen after Step 2?", "why_question": "Why is it not necessary for Step 4 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\nMust Step 4 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No", "trial_2_answer": "No", "model_answer": "No."}
{"plan_idx": 1362, "title": "banana-split-cake", "question_idx": 1362, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 7 happen after Step 2?", "why_question": "Why is it not necessary for Step 7 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\nMust Step 7 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1363, "title": "green-tofu-curry", "question_idx": 1363, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 7 happen after Step 2?", "why_question": "Why is it not necessary for Step 7 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\nMust Step 7 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1364, "title": "tortellini-fritto-with-almond-butter", "question_idx": 1364, "steps": ["Bring a saucepan of water to the boil.", "Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.", "In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.", "If you slightly undercooked your tortellini then it's less likely to stick to the pan.", "Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.", "Continue to gently fry and stir the tortellini until golden brown.", "Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.", "Enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 7], "binary_question": "Must Step 8 happen after Step 4?", "why_question": "Why is it not necessary for Step 8 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: tortellini-fritto-with-almond-butter\n\nProcedure:\n1. Bring a saucepan of water to the boil.\n2. Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.\n3. In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.\n4. If you slightly undercooked your tortellini then it's less likely to stick to the pan.\n5. Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.\n6. Continue to gently fry and stir the tortellini until golden brown.\n7. Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.\n8. Enjoy!\n\n\nMust Step 8 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1365, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1365, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 11], "binary_question": "Must Step 12 happen after Step 8?", "why_question": "Why is it not necessary for Step 12 to happen after Step 8?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\nMust Step 12 happen after Step 8? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1366, "title": "fusilli-and-meatballs", "question_idx": 1366, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 9], "binary_question": "Must Step 10 happen after Step 2?", "why_question": "Why is it not necessary for Step 10 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 10 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1367, "title": "spicy-tomato-anchovy-pasta", "question_idx": 1367, "steps": ["Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;", "cook until lightly browned.", "Add anchovies and water, cover and simmer for 4 to 5 minutes.", "Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.", "While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.", "Add linguine and cook until al dente, about 7 to 8 minutes;", "drain.", "Toss with anchovy mixture and chilli flakes.", "If desired, season with black pepper.", "Serve immediately."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 6 happen after Step 3?", "why_question": "Why is it not necessary for Step 6 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spicy-tomato-anchovy-pasta\n\nProcedure:\n1. Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;\n2. cook until lightly browned.\n3. Add anchovies and water, cover and simmer for 4 to 5 minutes.\n4. Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.\n5. While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.\n6. Add linguine and cook until al dente, about 7 to 8 minutes;\n7. drain.\n8. Toss with anchovy mixture and chilli flakes.\n9. If desired, season with black pepper.\n10. Serve immediately.\n\n\nMust Step 6 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1368, "title": "spanish-rabbit-stew", "question_idx": 1368, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 5], "binary_question": "Must Step 6 happen after Step 4?", "why_question": "Why is it not necessary for Step 6 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\nMust Step 6 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1369, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1369, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 12], "binary_question": "Must Step 13 happen after Step 4?", "why_question": "Why is it not necessary for Step 13 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\nMust Step 13 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1370, "title": "spiced-guava-cake", "question_idx": 1370, "steps": ["Preheat oven to 180 C / Gas 4.", "Grease and flour one 23x13cm loaf tin.", "Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.", "In another bowl, mix together guava pulp and juice.", "In another bowl, cream together butter and sugar.", "Add eggs, one at a time.", "Add flour mixture and guava mixture alternately to creamed mixture.", "Pour batter into prepared tin.", "Bake at 180 C / Gas 4 for 30-35 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why is it not necessary for Step 3 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced-guava-cake\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Grease and flour one 23x13cm loaf tin.\n3. Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.\n4. In another bowl, mix together guava pulp and juice.\n5. In another bowl, cream together butter and sugar.\n6. Add eggs, one at a time.\n7. Add flour mixture and guava mixture alternately to creamed mixture.\n8. Pour batter into prepared tin.\n9. Bake at 180 C / Gas 4 for 30-35 minutes.\n\n\nMust Step 3 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1371, "title": "chicken-prawn-and-rice-soup", "question_idx": 1371, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 9], "binary_question": "Must Step 10 happen after Step 3?", "why_question": "Why is it not necessary for Step 10 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\nMust Step 10 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1372, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1372, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 8], "binary_question": "Must Step 9 happen after Step 1?", "why_question": "Why is it not necessary for Step 9 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\nMust Step 9 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1373, "title": "spanish-rabbit-stew", "question_idx": 1373, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 7], "binary_question": "Must Step 8 happen after Step 4?", "why_question": "Why is it not necessary for Step 8 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\nMust Step 8 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1374, "title": "green-tofu-curry", "question_idx": 1374, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 6], "binary_question": "Must Step 7 happen after Step 4?", "why_question": "Why is it not necessary for Step 7 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\nMust Step 7 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1375, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1375, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 11], "binary_question": "Must Step 12 happen after Step 7?", "why_question": "Why is it not necessary for Step 12 to happen after Step 7?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\nMust Step 12 happen after Step 7? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1376, "title": "chocolate-chocolate-cake", "question_idx": 1376, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [8, 14], "binary_question": "Must Step 15 happen after Step 9?", "why_question": "Why is it not necessary for Step 15 to happen after Step 9?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 15 happen after Step 9? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1377, "title": "fusilli-and-meatballs", "question_idx": 1377, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 7], "binary_question": "Must Step 8 happen after Step 4?", "why_question": "Why is it not necessary for Step 8 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 8 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1378, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1378, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 12], "binary_question": "Must Step 13 happen after Step 3?", "why_question": "Why is it not necessary for Step 13 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\nMust Step 13 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1379, "title": "spanish-rabbit-stew", "question_idx": 1379, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 7], "binary_question": "Must Step 8 happen after Step 6?", "why_question": "Why is it not necessary for Step 8 to happen after Step 6?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\nMust Step 8 happen after Step 6? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "No", "model_answer": "No."}
{"plan_idx": 1380, "title": "warm-puy-lentil-and-tomato-salad", "question_idx": 1380, "steps": ["Bring a large pan of water to the boil;", "add lentils and cook over low heat for 30 minutes.", "Put tomatoes in a small bowl and season with salt.", "Set aside for 15 minutes.", "Drain lentils and tomatoes and mix together.", "Distribute mixture evenly in 6 individual bowls or ramekins, sprinkle with chopped parsley and serve warm or chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why is it not necessary for Step 4 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: warm-puy-lentil-and-tomato-salad\n\nProcedure:\n1. Bring a large pan of water to the boil;\n2. add lentils and cook over low heat for 30 minutes.\n3. Put tomatoes in a small bowl and season with salt.\n4. Set aside for 15 minutes.\n5. Drain lentils and tomatoes and mix together.\n6. Distribute mixture evenly in 6 individual bowls or ramekins, sprinkle with chopped parsley and serve warm or chilled.\n\n\nMust Step 4 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1381, "title": "smoked-salmon-and-grapefruit-salad", "question_idx": 1381, "steps": ["Top and tail the grapefruits.", "Slice the skin off the grapefruit over a bowl.", "This is to catch any juices.", "Using a small knife, segment the grapefruits over the juice bowl.", "Arrange the lamb's lettuce onto each serving plate or a large salad bowl.", "Top with grapefruit segments and smoked salmon.", "Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.", "Pour over the salad and serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 6 happen after Step 3?", "why_question": "Why is it not necessary for Step 6 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: smoked-salmon-and-grapefruit-salad\n\nProcedure:\n1. Top and tail the grapefruits.\n2. Slice the skin off the grapefruit over a bowl.\n3. This is to catch any juices.\n4. Using a small knife, segment the grapefruits over the juice bowl.\n5. Arrange the lamb's lettuce onto each serving plate or a large salad bowl.\n6. Top with grapefruit segments and smoked salmon.\n7. Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.\n8. Pour over the salad and serve.\n\n\nMust Step 6 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1382, "title": "feta-and-sundried-tomato-spinach-rolls", "question_idx": 1382, "steps": ["Preheat grill.", "Mix together cream cheese, feta, sundried tomatoes, basil and garlic.", "Stir until creamy, with no lumps.", "Blanch the spinach leaves.", "Wrap a dollop of cheese mix in each spinach leaf.", "Brush with olive oil.", "Sprinkle almonds on the top or alternately roll them in the almonds", "Grill spinach rolls until slightly crispy on top.", "Let cool for 10 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 4 happen after Step 2?", "why_question": "Why is it not necessary for Step 4 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: feta-and-sundried-tomato-spinach-rolls\n\nProcedure:\n1. Preheat grill.\n2. Mix together cream cheese, feta, sundried tomatoes, basil and garlic.\n3. Stir until creamy, with no lumps.\n4. Blanch the spinach leaves.\n5. Wrap a dollop of cheese mix in each spinach leaf.\n6. Brush with olive oil.\n7. Sprinkle almonds on the top or alternately roll them in the almonds\n8. Grill spinach rolls until slightly crispy on top.\n9. Let cool for 10 minutes.\n\n\nMust Step 4 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1383, "title": "spanish-rabbit-stew", "question_idx": 1383, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 7], "binary_question": "Must Step 8 happen after Step 2?", "why_question": "Why is it not necessary for Step 8 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\nMust Step 8 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No", "model_answer": "No."}
{"plan_idx": 1384, "title": "fusilli-and-meatballs", "question_idx": 1384, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 10], "binary_question": "Must Step 11 happen after Step 1?", "why_question": "Why is it not necessary for Step 11 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 11 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1385, "title": "chocolate-chocolate-cake", "question_idx": 1385, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 13], "binary_question": "Must Step 14 happen after Step 5?", "why_question": "Why is it not necessary for Step 14 to happen after Step 5?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 14 happen after Step 5? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1386, "title": "lightly spiced tomato and red lentil soup", "question_idx": 1386, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 7 happen after Step 2?", "why_question": "Why is it not necessary for Step 7 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\nMust Step 7 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1387, "title": "chicken and vegetable pie", "question_idx": 1387, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [8, 9], "binary_question": "Must Step 10 happen after Step 9?", "why_question": "Why is it not necessary for Step 10 to happen after Step 9?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\nMust Step 10 happen after Step 9? Select between yes or no\n\n", "trial_0_answer": "Yes", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1388, "title": "busters-liver-dinner", "question_idx": 1388, "steps": ["Put all ingredients into a slow cooker, mix together.", "Put slow cooker on high for 4 to 5 hours or low all day.", "( If mixture starts to look too dry just add a little hot water.", ")", "Once cooked, divide between several plastic microwaveable tubs with lids.", "This mixture usually makes 6 to 7 meals, I freeze 4 and put the rest in the fridge.", "When ready to eat microwave with lid half off for 2 to 3 minutes on medium high."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 5], "binary_question": "Must Step 6 happen after Step 4?", "why_question": "Why is it not necessary for Step 6 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: busters-liver-dinner\n\nProcedure:\n1. Put all ingredients into a slow cooker, mix together.\n2. Put slow cooker on high for 4 to 5 hours or low all day.\n3. ( If mixture starts to look too dry just add a little hot water.\n4. )\n5. Once cooked, divide between several plastic microwaveable tubs with lids.\n6. This mixture usually makes 6 to 7 meals, I freeze 4 and put the rest in the fridge.\n7. When ready to eat microwave with lid half off for 2 to 3 minutes on medium high.\n\n\nMust Step 6 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes", "model_answer": "Yes."}
{"plan_idx": 1389, "title": "very-vanilla-ry-cheesecake", "question_idx": 1389, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 9], "binary_question": "Must Step 10 happen after Step 3?", "why_question": "Why is it not necessary for Step 10 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\nMust Step 10 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1390, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1390, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [8, 12], "binary_question": "Must Step 13 happen after Step 9?", "why_question": "Why is it not necessary for Step 13 to happen after Step 9?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\nMust Step 13 happen after Step 9? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1391, "title": "chocolate-chocolate-cake", "question_idx": 1391, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 18], "binary_question": "Must Step 19 happen after Step 4?", "why_question": "Why is it not necessary for Step 19 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 19 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1392, "title": "almond and apple cake", "question_idx": 1392, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 4 happen after Step 2?", "why_question": "Why is it not necessary for Step 4 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\nMust Step 4 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1393, "title": "fusilli-and-meatballs", "question_idx": 1393, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [8, 14], "binary_question": "Must Step 15 happen after Step 9?", "why_question": "Why is it not necessary for Step 15 to happen after Step 9?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 15 happen after Step 9? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1394, "title": "green-tofu-curry", "question_idx": 1394, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 10], "binary_question": "Must Step 11 happen after Step 1?", "why_question": "Why is it not necessary for Step 11 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\nMust Step 11 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1395, "title": "spicy-tomato-anchovy-pasta", "question_idx": 1395, "steps": ["Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;", "cook until lightly browned.", "Add anchovies and water, cover and simmer for 4 to 5 minutes.", "Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.", "While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.", "Add linguine and cook until al dente, about 7 to 8 minutes;", "drain.", "Toss with anchovy mixture and chilli flakes.", "If desired, season with black pepper.", "Serve immediately."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 7 happen after Step 1?", "why_question": "Why is it not necessary for Step 7 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spicy-tomato-anchovy-pasta\n\nProcedure:\n1. Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;\n2. cook until lightly browned.\n3. Add anchovies and water, cover and simmer for 4 to 5 minutes.\n4. Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.\n5. While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.\n6. Add linguine and cook until al dente, about 7 to 8 minutes;\n7. drain.\n8. Toss with anchovy mixture and chilli flakes.\n9. If desired, season with black pepper.\n10. Serve immediately.\n\n\nMust Step 7 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1396, "title": "chicken-prawn-and-rice-soup", "question_idx": 1396, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 9], "binary_question": "Must Step 10 happen after Step 2?", "why_question": "Why is it not necessary for Step 10 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\nMust Step 10 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1397, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 1397, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 7 happen after Step 3?", "why_question": "Why is it not necessary for Step 7 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\nMust Step 7 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1398, "title": "fusilli-and-meatballs", "question_idx": 1398, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 18], "binary_question": "Must Step 19 happen after Step 1?", "why_question": "Why is it not necessary for Step 19 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 19 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1399, "title": "tortellini-fritto-with-almond-butter", "question_idx": 1399, "steps": ["Bring a saucepan of water to the boil.", "Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.", "In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.", "If you slightly undercooked your tortellini then it's less likely to stick to the pan.", "Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.", "Continue to gently fry and stir the tortellini until golden brown.", "Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.", "Enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 5], "binary_question": "Must Step 6 happen after Step 4?", "why_question": "Why is it not necessary for Step 6 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: tortellini-fritto-with-almond-butter\n\nProcedure:\n1. Bring a saucepan of water to the boil.\n2. Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.\n3. In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.\n4. If you slightly undercooked your tortellini then it's less likely to stick to the pan.\n5. Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.\n6. Continue to gently fry and stir the tortellini until golden brown.\n7. Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.\n8. Enjoy!\n\n\nMust Step 6 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1400, "title": "chocolate-chocolate-cake", "question_idx": 1400, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [16, 18], "binary_question": "Must Step 19 happen after Step 17?", "why_question": "Why is it not necessary for Step 19 to happen after Step 17?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 19 happen after Step 17? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1401, "title": "banana-split-cake", "question_idx": 1401, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 7 happen after Step 3?", "why_question": "Why is it not necessary for Step 7 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\nMust Step 7 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1402, "title": "chocolate-chocolate-cake", "question_idx": 1402, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 10], "binary_question": "Must Step 11 happen after Step 2?", "why_question": "Why is it not necessary for Step 11 to happen after Step 2?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 11 happen after Step 2? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1403, "title": "cloud-bread", "question_idx": 1403, "steps": ["Preheat oven to 150 C / Gas mark 2.", "Line a baking tray with baking paper.", "Mix cream cheese and egg yolks together until smooth.", "Place egg whites and baking powder in a glass, metal, or ceramic bowl;", "beat together until stiff peaks form.", "Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.", "Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.", "Bake in the preheated oven until golden brown, 17 to 20 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why is it not necessary for Step 3 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: cloud-bread\n\nProcedure:\n1. Preheat oven to 150 C / Gas mark 2.\n2. Line a baking tray with baking paper.\n3. Mix cream cheese and egg yolks together until smooth.\n4. Place egg whites and baking powder in a glass, metal, or ceramic bowl;\n5. beat together until stiff peaks form.\n6. Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.\n7. Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.\n8. Bake in the preheated oven until golden brown, 17 to 20 minutes.\n\n\nMust Step 3 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1404, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1404, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 10], "binary_question": "Must Step 11 happen after Step 8?", "why_question": "Why is it not necessary for Step 11 to happen after Step 8?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\nMust Step 11 happen after Step 8? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1405, "title": "smoked-salmon-and-grapefruit-salad", "question_idx": 1405, "steps": ["Top and tail the grapefruits.", "Slice the skin off the grapefruit over a bowl.", "This is to catch any juices.", "Using a small knife, segment the grapefruits over the juice bowl.", "Arrange the lamb's lettuce onto each serving plate or a large salad bowl.", "Top with grapefruit segments and smoked salmon.", "Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.", "Pour over the salad and serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 7 happen after Step 3?", "why_question": "Why is it not necessary for Step 7 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: smoked-salmon-and-grapefruit-salad\n\nProcedure:\n1. Top and tail the grapefruits.\n2. Slice the skin off the grapefruit over a bowl.\n3. This is to catch any juices.\n4. Using a small knife, segment the grapefruits over the juice bowl.\n5. Arrange the lamb's lettuce onto each serving plate or a large salad bowl.\n6. Top with grapefruit segments and smoked salmon.\n7. Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.\n8. Pour over the salad and serve.\n\n\nMust Step 7 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1406, "title": "tortellini-fritto-with-almond-butter", "question_idx": 1406, "steps": ["Bring a saucepan of water to the boil.", "Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.", "In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.", "If you slightly undercooked your tortellini then it's less likely to stick to the pan.", "Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.", "Continue to gently fry and stir the tortellini until golden brown.", "Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.", "Enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 7], "binary_question": "Must Step 8 happen after Step 6?", "why_question": "Why is it not necessary for Step 8 to happen after Step 6?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: tortellini-fritto-with-almond-butter\n\nProcedure:\n1. Bring a saucepan of water to the boil.\n2. Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.\n3. In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.\n4. If you slightly undercooked your tortellini then it's less likely to stick to the pan.\n5. Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.\n6. Continue to gently fry and stir the tortellini until golden brown.\n7. Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.\n8. Enjoy!\n\n\nMust Step 8 happen after Step 6? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes", "model_answer": "Yes."}
{"plan_idx": 1407, "title": "fusilli-and-meatballs", "question_idx": 1407, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [11, 13], "binary_question": "Must Step 14 happen after Step 12?", "why_question": "Why is it not necessary for Step 14 to happen after Step 12?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\nMust Step 14 happen after Step 12? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1408, "title": "almond and apple cake", "question_idx": 1408, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 6 happen after Step 3?", "why_question": "Why is it not necessary for Step 6 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\nMust Step 6 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1409, "title": "chocolate-chocolate-cake", "question_idx": 1409, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 14], "binary_question": "Must Step 15 happen after Step 7?", "why_question": "Why is it not necessary for Step 15 to happen after Step 7?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 15 happen after Step 7? Select between yes or no\n\n", "trial_0_answer": "No", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1410, "title": "chicken and vegetable pie", "question_idx": 1410, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why is it not necessary for Step 2 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\nMust Step 2 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1411, "title": "chicken and vegetable pie", "question_idx": 1411, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 6], "binary_question": "Must Step 7 happen after Step 4?", "why_question": "Why is it not necessary for Step 7 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\nMust Step 7 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1412, "title": "chocolate-chocolate-cake", "question_idx": 1412, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 14], "binary_question": "Must Step 15 happen after Step 4?", "why_question": "Why is it not necessary for Step 15 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 15 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1413, "title": "spiced butternut squash soup", "question_idx": 1413, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 10], "binary_question": "Must Step 11 happen after Step 4?", "why_question": "Why is it not necessary for Step 11 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\nMust Step 11 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1414, "title": "spiced butternut squash soup", "question_idx": 1414, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 8], "binary_question": "Must Step 9 happen after Step 1?", "why_question": "Why is it not necessary for Step 9 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\nMust Step 9 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1415, "title": "chocolate-chocolate-cake", "question_idx": 1415, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 18], "binary_question": "Must Step 19 happen after Step 3?", "why_question": "Why is it not necessary for Step 19 to happen after Step 3?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 19 happen after Step 3? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1416, "title": "chocolate-chocolate-cake", "question_idx": 1416, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 18], "binary_question": "Must Step 19 happen after Step 6?", "why_question": "Why is it not necessary for Step 19 to happen after Step 6?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 19 happen after Step 6? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1417, "title": "chicken and vegetable pie", "question_idx": 1417, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 5], "binary_question": "Must Step 6 happen after Step 4?", "why_question": "Why is it not necessary for Step 6 to happen after Step 4?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\nMust Step 6 happen after Step 4? Select between yes or no\n\n", "trial_0_answer": "Yes.", "trial_1_answer": "Yes.", "trial_2_answer": "Yes.", "model_answer": "Yes."}
{"plan_idx": 1418, "title": "chocolate-chocolate-cake", "question_idx": 1418, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [10, 14], "binary_question": "Must Step 15 happen after Step 11?", "why_question": "Why is it not necessary for Step 15 to happen after Step 11?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\nMust Step 15 happen after Step 11? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
{"plan_idx": 1419, "title": "vegetable-terrine", "question_idx": 1419, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why is it not necessary for Step 4 to happen after Step 1?", "model_name": "gpt-4-turbo-2024-04-09", "prompt_key": "basic_binary", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the question in one sentence.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\nMust Step 4 happen after Step 1? Select between yes or no\n\n", "trial_0_answer": "No.", "trial_1_answer": "No.", "trial_2_answer": "No.", "model_answer": "No."}
