{"plan_idx": 710, "title": "spiced-guava-cake", "question_idx": 710, "steps": ["Preheat oven to 180 C / Gas 4.", "Grease and flour one 23x13cm loaf tin.", "Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.", "In another bowl, mix together guava pulp and juice.", "In another bowl, cream together butter and sugar.", "Add eggs, one at a time.", "Add flour mixture and guava mixture alternately to creamed mixture.", "Pour batter into prepared tin.", "Bake at 180 C / Gas 4 for 30-35 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 5 happen after Step 4?", "why_question": "Why must Step 5 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-guava-cake\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Grease and flour one 23x13cm loaf tin.\n3. Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.\n4. In another bowl, mix together guava pulp and juice.\n5. In another bowl, cream together butter and sugar.\n6. Add eggs, one at a time.\n7. Add flour mixture and guava mixture alternately to creamed mixture.\n8. Pour batter into prepared tin.\n9. Bake at 180 C / Gas 4 for 30-35 minutes.\n\n\n1. Must Step 5 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 5 does not depend on Step 4 and can be done independently.\"\n}\n```"}
{"plan_idx": 711, "title": "chocolate-chocolate-cake", "question_idx": 711, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why must Step 6 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 6 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 6 can happen independently of Step 2 as they involve different ingredients and processes.\"\n}\n```"}
{"plan_idx": 712, "title": "chicken-prawn-and-rice-soup", "question_idx": 712, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 10], "binary_question": "Must Step 11 happen after Step 4?", "why_question": "Why must Step 11 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 11 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 can happen independently of Step 4 as it involves preparing the rice separately.\"\n}\n```"}
{"plan_idx": 713, "title": "green-tofu-curry", "question_idx": 713, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why must Step 5 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 5 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 5 can happen independently of Step 1 as they involve different ingredients and processes.\"\n}\n```"}
{"plan_idx": 714, "title": "very-vanilla-ry-cheesecake", "question_idx": 714, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 7], "binary_question": "Must Step 8 happen after Step 5?", "why_question": "Why must Step 8 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 8 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 8 involves preparing the cheesecake filling, which needs to be poured into the biscuit base prepared in Step 5.\"\n}\n```"}
{"plan_idx": 715, "title": "smoked-salmon-and-grapefruit-salad", "question_idx": 715, "steps": ["Top and tail the grapefruits.", "Slice the skin off the grapefruit over a bowl.", "This is to catch any juices.", "Using a small knife, segment the grapefruits over the juice bowl.", "Arrange the lamb's lettuce onto each serving plate or a large salad bowl.", "Top with grapefruit segments and smoked salmon.", "Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.", "Pour over the salad and serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 5 happen after Step 2?", "why_question": "Why must Step 5 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: smoked-salmon-and-grapefruit-salad\n\nProcedure:\n1. Top and tail the grapefruits.\n2. Slice the skin off the grapefruit over a bowl.\n3. This is to catch any juices.\n4. Using a small knife, segment the grapefruits over the juice bowl.\n5. Arrange the lamb's lettuce onto each serving plate or a large salad bowl.\n6. Top with grapefruit segments and smoked salmon.\n7. Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.\n8. Pour over the salad and serve.\n\n\n1. Must Step 5 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 5 can happen independently of Step 2 as it involves arranging the lamb's lettuce, which does not depend on slicing the grapefruit skin.\"\n}\n```"}
{"plan_idx": 716, "title": "fusilli-and-meatballs", "question_idx": 716, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 15], "binary_question": "Must Step 16 happen after Step 6?", "why_question": "Why must Step 16 happen after Step 6?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 16 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 16 involves draining the meatballs after browning, which is independent of adding tomatoes to the saucepan in Step 6.\"\n}\n```"}
{"plan_idx": 717, "title": "spanish-rabbit-stew", "question_idx": 717, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 8], "binary_question": "Must Step 9 happen after Step 3?", "why_question": "Why must Step 9 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 9 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 9 can happen at any point after Step 4 when the liquid is added, as it involves seasoning the stew to taste.\"\n}\n```"}
{"plan_idx": 718, "title": "green-tofu-curry", "question_idx": 718, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 8], "binary_question": "Must Step 9 happen after Step 1?", "why_question": "Why must Step 9 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 9 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 9 does not depend on Step 1 and can be done independently.\"\n}\n```"}
{"plan_idx": 719, "title": "tangy-gammon-in-cider", "question_idx": 719, "steps": ["Preheat the oven to 200 degrees /gas mark 6.", "Start by piercing each tomato once and covering with boiling water to loosen the skins.", "Drain the onions and chop each one in half.", "Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.", "Put the onions, tomatoes and apples into a casserole dish.", "Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.", "Place in the dish and repeat with the other gammon steaks.", "Pour cider over the steaks, cover the top with a lid or tin foil.", "Cook for 1 hour."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 7 happen after Step 1?", "why_question": "Why must Step 7 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tangy-gammon-in-cider\n\nProcedure:\n1. Preheat the oven to 200 degrees /gas mark 6.\n2. Start by piercing each tomato once and covering with boiling water to loosen the skins.\n3. Drain the onions and chop each one in half.\n4. Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.\n5. Put the onions, tomatoes and apples into a casserole dish.\n6. Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.\n7. Place in the dish and repeat with the other gammon steaks.\n8. Pour cider over the steaks, cover the top with a lid or tin foil.\n9. Cook for 1 hour.\n\n\n1. Must Step 7 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 involves placing the prepared gammon steaks in the dish, which needs to be done after the oven is preheated in Step 1 to ensure proper cooking.\"\n}\n```"}
{"plan_idx": 720, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 720, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [11, 13], "binary_question": "Must Step 14 happen after Step 12?", "why_question": "Why must Step 14 happen after Step 12?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 14 happen after Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 14 must happen after Step 12 because the shortcakes need to be split and assembled with the whipped cream, which is prepared in Step 12.\"\n}\n```"}
{"plan_idx": 721, "title": "tortellini-fritto-with-almond-butter", "question_idx": 721, "steps": ["Bring a saucepan of water to the boil.", "Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.", "In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.", "If you slightly undercooked your tortellini then it's less likely to stick to the pan.", "Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.", "Continue to gently fry and stir the tortellini until golden brown.", "Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.", "Enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 7], "binary_question": "Must Step 8 happen after Step 7?", "why_question": "Why must Step 8 happen after Step 7?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tortellini-fritto-with-almond-butter\n\nProcedure:\n1. Bring a saucepan of water to the boil.\n2. Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.\n3. In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.\n4. If you slightly undercooked your tortellini then it's less likely to stick to the pan.\n5. Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.\n6. Continue to gently fry and stir the tortellini until golden brown.\n7. Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.\n8. Enjoy!\n\n\n1. Must Step 8 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 8 is the final step where you enjoy the dish, which naturally comes after serving it in Step 7.\"\n}\n```"}
{"plan_idx": 722, "title": "almond and apple cake", "question_idx": 722, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why must Step 2 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 2 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 2 can be done before or after preheating the oven as it does not depend on the oven being preheated.\"\n}\n```"}
{"plan_idx": 723, "title": "green-tofu-curry", "question_idx": 723, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 10], "binary_question": "Must Step 11 happen after Step 7?", "why_question": "Why must Step 11 happen after Step 7?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 11 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 can happen independently of Step 7 as they involve different components (curry sauce and tofu) that are combined at the end.\"\n}\n```"}
{"plan_idx": 724, "title": "brown sugar shortbread", "question_idx": 724, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 5 happen after Step 4?", "why_question": "Why must Step 5 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\n1. Must Step 5 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 must happen after Step 4 because the board needs to be sprinkled with flour before kneading the dough to prevent sticking.\"\n}\n```"}
{"plan_idx": 725, "title": "chicken-prawn-and-rice-soup", "question_idx": 725, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 9], "binary_question": "Must Step 10 happen after Step 6?", "why_question": "Why must Step 10 happen after Step 6?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 10 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 can happen independently of Step 6 as it involves heating oil for the rice, which is a separate task from bringing the soup to a boil.\"\n}\n```"}
{"plan_idx": 726, "title": "chicken and vegetable pie", "question_idx": 726, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 10], "binary_question": "Must Step 11 happen after Step 5?", "why_question": "Why must Step 11 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 11 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 11 must happen after Step 5 because the chicken mixture needs to be prepared and set aside before it can be placed in the pie dish.\"\n}\n```"}
{"plan_idx": 727, "title": "fusilli-and-meatballs", "question_idx": 727, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 11], "binary_question": "Must Step 12 happen after Step 5?", "why_question": "Why must Step 12 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 12 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 12 involves preparing the meatball mixture and is independent of processing the tomatoes in Step 5.\"\n}\n```"}
{"plan_idx": 728, "title": "fusilli-and-meatballs", "question_idx": 728, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [12, 13], "binary_question": "Must Step 14 happen after Step 13?", "why_question": "Why must Step 14 happen after Step 13?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 14 happen after Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 14 involves cooking the meatballs, which can only be done after they are shaped in Step 13.\"\n}\n```"}
{"plan_idx": 729, "title": "chicken and vegetable pie", "question_idx": 729, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why must Step 6 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 6 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 6 does not depend on Step 1 and can be done independently of preheating the oven.\"\n}\n```"}
{"plan_idx": 730, "title": "feta-and-sundried-tomato-spinach-rolls", "question_idx": 730, "steps": ["Preheat grill.", "Mix together cream cheese, feta, sundried tomatoes, basil and garlic.", "Stir until creamy, with no lumps.", "Blanch the spinach leaves.", "Wrap a dollop of cheese mix in each spinach leaf.", "Brush with olive oil.", "Sprinkle almonds on the top or alternately roll them in the almonds", "Grill spinach rolls until slightly crispy on top.", "Let cool for 10 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 7 happen after Step 1?", "why_question": "Why must Step 7 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: feta-and-sundried-tomato-spinach-rolls\n\nProcedure:\n1. Preheat grill.\n2. Mix together cream cheese, feta, sundried tomatoes, basil and garlic.\n3. Stir until creamy, with no lumps.\n4. Blanch the spinach leaves.\n5. Wrap a dollop of cheese mix in each spinach leaf.\n6. Brush with olive oil.\n7. Sprinkle almonds on the top or alternately roll them in the almonds\n8. Grill spinach rolls until slightly crispy on top.\n9. Let cool for 10 minutes.\n\n\n1. Must Step 7 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 does not depend on Step 1 and can be done at any time before grilling.\"\n}\n```"}
{"plan_idx": 731, "title": "green-tofu-curry", "question_idx": 731, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 10], "binary_question": "Must Step 11 happen after Step 6?", "why_question": "Why must Step 11 happen after Step 6?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 11 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 does not depend on Step 6 and can be done independently.\"\n}\n```"}
{"plan_idx": 732, "title": "chocolate-chocolate-cake", "question_idx": 732, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 10], "binary_question": "Must Step 11 happen after Step 3?", "why_question": "Why must Step 11 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 11 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 involves beating egg whites and is independent of melting the chocolate in Step 3.\"\n}\n```"}
{"plan_idx": 733, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 733, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 12], "binary_question": "Must Step 13 happen after Step 2?", "why_question": "Why must Step 13 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 13 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 13 involves preparing the whipped cream, which can be done independently of combining the dry ingredients in Step 2.\"\n}\n```"}
{"plan_idx": 734, "title": "spanish-rabbit-stew", "question_idx": 734, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 6], "binary_question": "Must Step 7 happen after Step 5?", "why_question": "Why must Step 7 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 7 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 involves turning on the slow cooker to start the cooking process, which should only happen after all ingredients and liquids are properly added and mixed in Step 5.\"\n}\n```"}
{"plan_idx": 735, "title": "spiced-guava-cake", "question_idx": 735, "steps": ["Preheat oven to 180 C / Gas 4.", "Grease and flour one 23x13cm loaf tin.", "Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.", "In another bowl, mix together guava pulp and juice.", "In another bowl, cream together butter and sugar.", "Add eggs, one at a time.", "Add flour mixture and guava mixture alternately to creamed mixture.", "Pour batter into prepared tin.", "Bake at 180 C / Gas 4 for 30-35 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why must Step 5 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-guava-cake\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Grease and flour one 23x13cm loaf tin.\n3. Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.\n4. In another bowl, mix together guava pulp and juice.\n5. In another bowl, cream together butter and sugar.\n6. Add eggs, one at a time.\n7. Add flour mixture and guava mixture alternately to creamed mixture.\n8. Pour batter into prepared tin.\n9. Bake at 180 C / Gas 4 for 30-35 minutes.\n\n\n1. Must Step 5 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 5 does not depend on the oven being preheated, so it can happen independently of Step 1.\"\n}\n```"}
{"plan_idx": 736, "title": "fusilli-and-meatballs", "question_idx": 736, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 8], "binary_question": "Must Step 9 happen after Step 3?", "why_question": "Why must Step 9 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 9 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 9 involves simmering the tomato sauce, which requires the onion mixture to be added to the bowl in Step 3 for the meatball preparation.\"\n}\n```"}
{"plan_idx": 737, "title": "spanish-rabbit-stew", "question_idx": 737, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 7 happen after Step 3?", "why_question": "Why must Step 7 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 7 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 involves turning on the slow cooker, which must happen after mixing the ingredients in Step 3.\"\n}\n```"}
{"plan_idx": 738, "title": "fusilli-and-meatballs", "question_idx": 738, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 6 happen after Step 3?", "why_question": "Why must Step 6 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 6 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 must happen after Step 3 because the onion mixture needs to be transferred to the bowl before adding the tomatoes to the saucepan.\"\n}\n```"}
{"plan_idx": 739, "title": "brown sugar shortbread", "question_idx": 739, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 5 happen after Step 3?", "why_question": "Why must Step 5 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\n1. Must Step 5 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 involves sprinkling the board with the remaining flour, which is only possible after some flour has been used in Step 3.\"\n}\n```"}
{"plan_idx": 740, "title": "fusilli-and-meatballs", "question_idx": 740, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why must Step 6 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 6 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 involves adding the processed tomatoes to the saucepan, which already contains the saut\u00e9ed onion and garlic from Step 2.\"\n}\n```"}
{"plan_idx": 741, "title": "spicy-tomato-anchovy-pasta", "question_idx": 741, "steps": ["Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;", "cook until lightly browned.", "Add anchovies and water, cover and simmer for 4 to 5 minutes.", "Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.", "While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.", "Add linguine and cook until al dente, about 7 to 8 minutes;", "drain.", "Toss with anchovy mixture and chilli flakes.", "If desired, season with black pepper.", "Serve immediately."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 7 happen after Step 3?", "why_question": "Why must Step 7 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spicy-tomato-anchovy-pasta\n\nProcedure:\n1. Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;\n2. cook until lightly browned.\n3. Add anchovies and water, cover and simmer for 4 to 5 minutes.\n4. Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.\n5. While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.\n6. Add linguine and cook until al dente, about 7 to 8 minutes;\n7. drain.\n8. Toss with anchovy mixture and chilli flakes.\n9. If desired, season with black pepper.\n10. Serve immediately.\n\n\n1. Must Step 7 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 can happen after Step 6 as it involves draining the pasta, which is independent of the anchovy mixture cooking process.\"\n}\n```"}
{"plan_idx": 742, "title": "curried bbq mussels", "question_idx": 742, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 7 happen after Step 6?", "why_question": "Why must Step 7 happen after Step 6?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 7 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 must happen after Step 6 to ensure the lime slices are placed on top of the red pepper and parsley.\"\n}\n```"}
{"plan_idx": 743, "title": "chocolate-chocolate-cake", "question_idx": 743, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 13], "binary_question": "Must Step 14 happen after Step 1?", "why_question": "Why must Step 14 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 14 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 14 can be done at any time before Step 16 as it involves preparing the cake tin, which does not depend on preheating the oven.\"\n}\n```"}
{"plan_idx": 744, "title": "green-tofu-curry", "question_idx": 744, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 7 happen after Step 3?", "why_question": "Why must Step 7 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 7 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 involves frying the tofu, which is a separate process from cooking the rice and must be done after the rice is simmered and before serving.\"\n}\n```"}
{"plan_idx": 745, "title": "smoked-salmon-and-grapefruit-salad", "question_idx": 745, "steps": ["Top and tail the grapefruits.", "Slice the skin off the grapefruit over a bowl.", "This is to catch any juices.", "Using a small knife, segment the grapefruits over the juice bowl.", "Arrange the lamb's lettuce onto each serving plate or a large salad bowl.", "Top with grapefruit segments and smoked salmon.", "Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.", "Pour over the salad and serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why must Step 5 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: smoked-salmon-and-grapefruit-salad\n\nProcedure:\n1. Top and tail the grapefruits.\n2. Slice the skin off the grapefruit over a bowl.\n3. This is to catch any juices.\n4. Using a small knife, segment the grapefruits over the juice bowl.\n5. Arrange the lamb's lettuce onto each serving plate or a large salad bowl.\n6. Top with grapefruit segments and smoked salmon.\n7. Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.\n8. Pour over the salad and serve.\n\n\n1. Must Step 5 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 5 does not depend on Step 1 and can be done independently.\"\n}\n```"}
{"plan_idx": 746, "title": "chicken-prawn-and-rice-soup", "question_idx": 746, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [8, 10], "binary_question": "Must Step 11 happen after Step 9?", "why_question": "Why must Step 11 happen after Step 9?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 11 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 11 must happen after Step 9 because the rice needs to be browned and then added to the simmering soup.\"\n}\n```"}
{"plan_idx": 747, "title": "chocolate-chocolate-cake", "question_idx": 747, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why must Step 6 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 6 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 involves preparing the batter, which should be done after preheating the oven to ensure the oven is ready when the batter is prepared.\"\n}\n```"}
{"plan_idx": 748, "title": "almond and apple cake", "question_idx": 748, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 7], "binary_question": "Must Step 8 happen after Step 3?", "why_question": "Why must Step 8 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 8 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 8 involves combining ingredients that are prepared in the previous steps, which must be done after the cake tin is prepared in Step 3.\"\n}\n```"}
{"plan_idx": 749, "title": "cranachan", "question_idx": 749, "steps": ["Preheat the oven to 180 C / Gas mark 4.", "Spread oats out in a thin layer on a baking tray.", "Toast in the oven for about 10 minutes, or until lightly browned.", "Set aside to cool.", "Remove them from the tray for faster cooling.", "In a medium bowl, whip the cream to firm peaks.", "Gently fold in the icing sugar, vanilla and toasted oats.", "Spoon into 4 serving bowls, and top with fresh berries.", "For an extra touch, drizzle some whisky over each serving.", "Garnish with a mint leaf."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 6 happen after Step 5?", "why_question": "Why must Step 6 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cranachan\n\nProcedure:\n1. Preheat the oven to 180 C / Gas mark 4.\n2. Spread oats out in a thin layer on a baking tray.\n3. Toast in the oven for about 10 minutes, or until lightly browned.\n4. Set aside to cool.\n5. Remove them from the tray for faster cooling.\n6. In a medium bowl, whip the cream to firm peaks.\n7. Gently fold in the icing sugar, vanilla and toasted oats.\n8. Spoon into 4 serving bowls, and top with fresh berries.\n9. For an extra touch, drizzle some whisky over each serving.\n10. Garnish with a mint leaf.\n\n\n1. Must Step 6 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The oats need to cool before being folded into the whipped cream to prevent the cream from melting.\"\n}\n```"}
{"plan_idx": 750, "title": "fusilli-and-meatballs", "question_idx": 750, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 5 happen after Step 3?", "why_question": "Why must Step 5 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 5 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 involves transferring part of the onion mixture to a bowl, which is needed for the meatball mixture in Step 12, while Step 5 involves processing tomatoes for the sauce.\"\n}\n```"}
{"plan_idx": 751, "title": "fusilli-and-meatballs", "question_idx": 751, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 7 happen after Step 2?", "why_question": "Why must Step 7 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 7 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 involves bringing the tomato mixture to a boil, which requires the saut\u00e9ed onion and garlic from Step 2 to be added to the saucepan first.\"\n}\n```"}
{"plan_idx": 752, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 752, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [8, 10], "binary_question": "Must Step 11 happen after Step 9?", "why_question": "Why must Step 11 happen after Step 9?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 11 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 can be done at any time before assembling the shortcakes in Step 14.\"\n}\n```"}
{"plan_idx": 753, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 753, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 10], "binary_question": "Must Step 11 happen after Step 4?", "why_question": "Why must Step 11 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 11 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 can be done at any time before assembling the shortcakes as it does not depend on the completion of Step 4.\"\n}\n```"}
{"plan_idx": 754, "title": "fusilli-and-meatballs", "question_idx": 754, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 9], "binary_question": "Must Step 10 happen after Step 3?", "why_question": "Why must Step 10 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 10 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 involves adding herbs to the sauce, which is independent of transferring the onion mixture in Step 3.\"\n}\n```"}
{"plan_idx": 755, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 755, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why must Step 5 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 5 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 5 involves preparing the dough, which is independent of the strawberry and sugar mixture in Step 1.\"\n}\n```"}
{"plan_idx": 756, "title": "cloud-bread", "question_idx": 756, "steps": ["Preheat oven to 150 C / Gas mark 2.", "Line a baking tray with baking paper.", "Mix cream cheese and egg yolks together until smooth.", "Place egg whites and baking powder in a glass, metal, or ceramic bowl;", "beat together until stiff peaks form.", "Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.", "Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.", "Bake in the preheated oven until golden brown, 17 to 20 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 5 happen after Step 2?", "why_question": "Why must Step 5 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cloud-bread\n\nProcedure:\n1. Preheat oven to 150 C / Gas mark 2.\n2. Line a baking tray with baking paper.\n3. Mix cream cheese and egg yolks together until smooth.\n4. Place egg whites and baking powder in a glass, metal, or ceramic bowl;\n5. beat together until stiff peaks form.\n6. Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.\n7. Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.\n8. Bake in the preheated oven until golden brown, 17 to 20 minutes.\n\n\n1. Must Step 5 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 5 does not depend on Step 2 and can be done independently.\"\n}\n```"}
{"plan_idx": 757, "title": "curried bbq mussels", "question_idx": 757, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 6], "binary_question": "Must Step 7 happen after Step 4?", "why_question": "Why must Step 7 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 7 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 must happen after Step 4 because the lime slices need to be placed on top of the mussels, which are divided and placed on the foil in Step 4.\"\n}\n```"}
{"plan_idx": 758, "title": "vegetable-terrine", "question_idx": 758, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 6 happen after Step 3?", "why_question": "Why must Step 6 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 6 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The gelatin needs to be added to the cream mixture after it has been softened and the sorrel has been cooked and chopped.\"\n}\n```"}
{"plan_idx": 759, "title": "chicken and vegetable pie", "question_idx": 759, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 10], "binary_question": "Must Step 11 happen after Step 1?", "why_question": "Why must Step 11 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 11 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 11 must happen after Step 1 because the oven needs to be preheated before baking the pie.\"\n}\n```"}
{"plan_idx": 760, "title": "chocolate-chocolate-cake", "question_idx": 760, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 10], "binary_question": "Must Step 11 happen after Step 5?", "why_question": "Why must Step 11 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 11 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 can happen independently of Step 5 as they involve separate mixtures.\"\n}\n```"}
{"plan_idx": 761, "title": "chicken and vegetable pie", "question_idx": 761, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 7 happen after Step 1?", "why_question": "Why must Step 7 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 7 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 does not depend on Step 1 and can be done independently of preheating the oven.\"\n}\n```"}
{"plan_idx": 762, "title": "almond and apple cake", "question_idx": 762, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 5 happen after Step 2?", "why_question": "Why must Step 5 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 5 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 5 involves adding eggs to the mixture, which is independent of greasing the cake tin in Step 2.\"\n}\n```"}
{"plan_idx": 763, "title": "almond and apple cake", "question_idx": 763, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 9], "binary_question": "Must Step 10 happen after Step 7?", "why_question": "Why must Step 10 happen after Step 7?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 10 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 10 involves arranging the apple in the tin, which must be done after preparing the batter in Step 7.\"\n}\n```"}
{"plan_idx": 764, "title": "lightly spiced tomato and red lentil soup", "question_idx": 764, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 7], "binary_question": "Must Step 8 happen after Step 7?", "why_question": "Why must Step 8 happen after Step 7?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 8 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 8 can happen independently of Step 7 as it involves removing the bay leaf from the soup, which does not affect the preparation of the coriander yoghurt garnish.\"\n}\n```"}
{"plan_idx": 765, "title": "chocolate-chocolate-cake", "question_idx": 765, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 7 happen after Step 3?", "why_question": "Why must Step 7 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 7 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 involves beating sugar into the butter and margarine mixture, which is part of the batter preparation that must follow the melting of the chocolate in Step 3.\"\n}\n```"}
{"plan_idx": 766, "title": "curried bbq mussels", "question_idx": 766, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why must Step 3 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 3 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 3 does not depend on the barbecue being preheated and can be done independently.\"\n}\n```"}
{"plan_idx": 767, "title": "spicy-tomato-anchovy-pasta", "question_idx": 767, "steps": ["Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;", "cook until lightly browned.", "Add anchovies and water, cover and simmer for 4 to 5 minutes.", "Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.", "While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.", "Add linguine and cook until al dente, about 7 to 8 minutes;", "drain.", "Toss with anchovy mixture and chilli flakes.", "If desired, season with black pepper.", "Serve immediately."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 5], "binary_question": "Must Step 6 happen after Step 4?", "why_question": "Why must Step 6 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spicy-tomato-anchovy-pasta\n\nProcedure:\n1. Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;\n2. cook until lightly browned.\n3. Add anchovies and water, cover and simmer for 4 to 5 minutes.\n4. Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.\n5. While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.\n6. Add linguine and cook until al dente, about 7 to 8 minutes;\n7. drain.\n8. Toss with anchovy mixture and chilli flakes.\n9. If desired, season with black pepper.\n10. Serve immediately.\n\n\n1. Must Step 6 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 6 can happen concurrently with Step 4 as long as the linguine is ready by the time the vegetables are soft.\"\n}\n```"}
{"plan_idx": 768, "title": "chocolate-chocolate-cake", "question_idx": 768, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 14], "binary_question": "Must Step 15 happen after Step 2?", "why_question": "Why must Step 15 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 15 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 15 involves preparing the cake tin, which can be done independently of melting the chocolate in Step 2.\"\n}\n```"}
{"plan_idx": 769, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 769, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [10, 13], "binary_question": "Must Step 14 happen after Step 11?", "why_question": "Why must Step 14 happen after Step 11?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 14 happen after Step 11?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 14 can happen after Step 10 as long as the shortcakes are cooled; Step 11 is not a prerequisite for Step 14.\"\n}\n```"}
{"plan_idx": 770, "title": "smoked-salmon-and-grapefruit-salad", "question_idx": 770, "steps": ["Top and tail the grapefruits.", "Slice the skin off the grapefruit over a bowl.", "This is to catch any juices.", "Using a small knife, segment the grapefruits over the juice bowl.", "Arrange the lamb's lettuce onto each serving plate or a large salad bowl.", "Top with grapefruit segments and smoked salmon.", "Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.", "Pour over the salad and serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why must Step 3 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: smoked-salmon-and-grapefruit-salad\n\nProcedure:\n1. Top and tail the grapefruits.\n2. Slice the skin off the grapefruit over a bowl.\n3. This is to catch any juices.\n4. Using a small knife, segment the grapefruits over the juice bowl.\n5. Arrange the lamb's lettuce onto each serving plate or a large salad bowl.\n6. Top with grapefruit segments and smoked salmon.\n7. Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.\n8. Pour over the salad and serve.\n\n\n1. Must Step 3 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 3 is an explanation for Step 2 and does not need to happen after Step 1.\"\n}\n```"}
{"plan_idx": 771, "title": "chocolate-chocolate-cake", "question_idx": 771, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why must Step 4 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 4 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 4 does not depend on Step 1 and can be done independently of preheating the oven.\"\n}\n```"}
{"plan_idx": 772, "title": "spicy-tomato-anchovy-pasta", "question_idx": 772, "steps": ["Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;", "cook until lightly browned.", "Add anchovies and water, cover and simmer for 4 to 5 minutes.", "Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.", "While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.", "Add linguine and cook until al dente, about 7 to 8 minutes;", "drain.", "Toss with anchovy mixture and chilli flakes.", "If desired, season with black pepper.", "Serve immediately."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 7 happen after Step 2?", "why_question": "Why must Step 7 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spicy-tomato-anchovy-pasta\n\nProcedure:\n1. Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;\n2. cook until lightly browned.\n3. Add anchovies and water, cover and simmer for 4 to 5 minutes.\n4. Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.\n5. While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.\n6. Add linguine and cook until al dente, about 7 to 8 minutes;\n7. drain.\n8. Toss with anchovy mixture and chilli flakes.\n9. If desired, season with black pepper.\n10. Serve immediately.\n\n\n1. Must Step 7 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 must happen after Step 6, not necessarily after Step 2.\"\n}\n```"}
{"plan_idx": 773, "title": "tortellini-fritto-with-almond-butter", "question_idx": 773, "steps": ["Bring a saucepan of water to the boil.", "Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.", "In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.", "If you slightly undercooked your tortellini then it's less likely to stick to the pan.", "Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.", "Continue to gently fry and stir the tortellini until golden brown.", "Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.", "Enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why must Step 4 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tortellini-fritto-with-almond-butter\n\nProcedure:\n1. Bring a saucepan of water to the boil.\n2. Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.\n3. In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.\n4. If you slightly undercooked your tortellini then it's less likely to stick to the pan.\n5. Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.\n6. Continue to gently fry and stir the tortellini until golden brown.\n7. Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.\n8. Enjoy!\n\n\n1. Must Step 4 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 4 is a recommendation related to Step 3 and does not need to follow Step 1 directly.\"\n}\n```"}
{"plan_idx": 774, "title": "fusilli-and-meatballs", "question_idx": 774, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why must Step 6 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 6 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 involves adding the processed tomatoes to the saucepan, which needs to be prepared and heated in Step 1.\"\n}\n```"}
{"plan_idx": 775, "title": "chocolate-chocolate-cake", "question_idx": 775, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 7], "binary_question": "Must Step 8 happen after Step 1?", "why_question": "Why must Step 8 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 8 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 8 does not depend on Step 1 and can be done independently of preheating the oven.\"\n}\n```"}
{"plan_idx": 776, "title": "vegetable-terrine", "question_idx": 776, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 4 happen after Step 3?", "why_question": "Why must Step 4 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 4 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 involves cooking the sorrel, which is a separate process from stopping the cooking of the vegetables in Step 3.\"\n}\n```"}
{"plan_idx": 777, "title": "spiced-pumpkin-teabread", "question_idx": 777, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 5], "binary_question": "Must Step 6 happen after Step 4?", "why_question": "Why must Step 6 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 6 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 involves preparing the dry ingredients which need to be combined with the pumpkin mixture prepared in Step 4.\"\n}\n```"}
{"plan_idx": 778, "title": "chicory-and-roquefort-salad", "question_idx": 778, "steps": ["In a bowl, toss chicory, Roquefort and pecan nuts together.", "Make the dressing by mixing together cream cheese, yoghurt and salt and pepper.", "Drizzle over salad."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why must Step 2 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicory-and-roquefort-salad\n\nProcedure:\n1. In a bowl, toss chicory, Roquefort and pecan nuts together.\n2. Make the dressing by mixing together cream cheese, yoghurt and salt and pepper.\n3. Drizzle over salad.\n\n\n1. Must Step 2 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 2 can be done before Step 1 as the dressing can be prepared in advance and then drizzled over the salad.\"\n}\n```"}
{"plan_idx": 779, "title": "spiced-guava-cake", "question_idx": 779, "steps": ["Preheat oven to 180 C / Gas 4.", "Grease and flour one 23x13cm loaf tin.", "Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.", "In another bowl, mix together guava pulp and juice.", "In another bowl, cream together butter and sugar.", "Add eggs, one at a time.", "Add flour mixture and guava mixture alternately to creamed mixture.", "Pour batter into prepared tin.", "Bake at 180 C / Gas 4 for 30-35 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why must Step 6 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-guava-cake\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Grease and flour one 23x13cm loaf tin.\n3. Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.\n4. In another bowl, mix together guava pulp and juice.\n5. In another bowl, cream together butter and sugar.\n6. Add eggs, one at a time.\n7. Add flour mixture and guava mixture alternately to creamed mixture.\n8. Pour batter into prepared tin.\n9. Bake at 180 C / Gas 4 for 30-35 minutes.\n\n\n1. Must Step 6 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 6 does not depend on Step 1 and can be done independently.\"\n}\n```"}
{"plan_idx": 780, "title": "spiced-pumpkin-teabread", "question_idx": 780, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why must Step 6 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 6 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 6 does not depend on Step 2 and can be done independently.\"\n}\n```"}
{"plan_idx": 781, "title": "chocolate-pancake-batter", "question_idx": 781, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why must Step 5 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 5 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 involves heating the pan, which is only necessary after the batter is prepared in Steps 1-4.\"\n}\n```"}
{"plan_idx": 782, "title": "chocolate-pancake-batter", "question_idx": 782, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 5 happen after Step 2?", "why_question": "Why must Step 5 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 5 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 5 involves heating the pan, which can be done independently of mixing the ingredients in Step 2.\"\n}\n```"}
{"plan_idx": 783, "title": "spiced butternut squash soup", "question_idx": 783, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 9], "binary_question": "Must Step 10 happen after Step 5?", "why_question": "Why must Step 10 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 10 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 10 involves cooking the potatoes in the chicken stock, which is added after the squash is prepared and set aside in Step 6.\"\n}\n```"}
{"plan_idx": 784, "title": "fusilli-and-meatballs", "question_idx": 784, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 14], "binary_question": "Must Step 15 happen after Step 6?", "why_question": "Why must Step 15 happen after Step 6?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 15 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 15 involves cooking the meatballs, which can be done independently of adding the tomatoes to the saucepan in Step 6.\"\n}\n```"}
{"plan_idx": 785, "title": "fusilli-and-meatballs", "question_idx": 785, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [12, 18], "binary_question": "Must Step 19 happen after Step 13?", "why_question": "Why must Step 19 happen after Step 13?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 19 happen after Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 19 can happen independently of Step 13 as it involves cooking pasta, which can be done while other steps are in progress.\"\n}\n```"}
{"plan_idx": 786, "title": "green-tofu-curry", "question_idx": 786, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 8], "binary_question": "Must Step 9 happen after Step 6?", "why_question": "Why must Step 9 happen after Step 6?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 9 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 9 can happen independently of Step 6 as they involve different components and can be prepared simultaneously.\"\n}\n```"}
{"plan_idx": 787, "title": "spiced-pumpkin-teabread", "question_idx": 787, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 8], "binary_question": "Must Step 9 happen after Step 1?", "why_question": "Why must Step 9 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 9 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 9 involves putting the mixture into the prepared tin, which requires the oven to be preheated as per Step 1.\"\n}\n```"}
{"plan_idx": 788, "title": "chocolate-chocolate-cake", "question_idx": 788, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 7 happen after Step 1?", "why_question": "Why must Step 7 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 7 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 does not depend on Step 1 and can be done independently of preheating the oven.\"\n}\n```"}
{"plan_idx": 789, "title": "chicken and vegetable pie", "question_idx": 789, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 7 happen after Step 3?", "why_question": "Why must Step 7 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 7 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 involves making the sauce which requires the chicken stock, and the chicken stock is added after boiling the chicken and vegetables in Step 3.\"\n}\n```"}
{"plan_idx": 790, "title": "best-ever-margarita", "question_idx": 790, "steps": ["Rim 2 margarita glasses with salt if desired and fill with ice.", "Pour the tequila, lime cordial, triple sec and lemon-lime soft drink into a cocktail shaker filled with ice.", "Hold your hand firmly over over the top of the shaker so the top doesn't pop off from the fizzy soft drink and shake vigorously.", "Pour into prepared margarita glasses and serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why must Step 3 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: best-ever-margarita\n\nProcedure:\n1. Rim 2 margarita glasses with salt if desired and fill with ice.\n2. Pour the tequila, lime cordial, triple sec and lemon-lime soft drink into a cocktail shaker filled with ice.\n3. Hold your hand firmly over over the top of the shaker so the top doesn't pop off from the fizzy soft drink and shake vigorously.\n4. Pour into prepared margarita glasses and serve.\n\n\n1. Must Step 3 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen after Step 1 because the margarita glasses need to be prepared and filled with ice before pouring the shaken mixture into them.\"\n}\n```"}
{"plan_idx": 791, "title": "tangy-gammon-in-cider", "question_idx": 791, "steps": ["Preheat the oven to 200 degrees /gas mark 6.", "Start by piercing each tomato once and covering with boiling water to loosen the skins.", "Drain the onions and chop each one in half.", "Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.", "Put the onions, tomatoes and apples into a casserole dish.", "Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.", "Place in the dish and repeat with the other gammon steaks.", "Pour cider over the steaks, cover the top with a lid or tin foil.", "Cook for 1 hour."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 7], "binary_question": "Must Step 8 happen after Step 1?", "why_question": "Why must Step 8 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tangy-gammon-in-cider\n\nProcedure:\n1. Preheat the oven to 200 degrees /gas mark 6.\n2. Start by piercing each tomato once and covering with boiling water to loosen the skins.\n3. Drain the onions and chop each one in half.\n4. Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.\n5. Put the onions, tomatoes and apples into a casserole dish.\n6. Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.\n7. Place in the dish and repeat with the other gammon steaks.\n8. Pour cider over the steaks, cover the top with a lid or tin foil.\n9. Cook for 1 hour.\n\n\n1. Must Step 8 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 8 can happen after Step 7 as it involves pouring cider over the steaks, which is independent of preheating the oven.\"\n}\n```"}
{"plan_idx": 792, "title": "almond and apple cake", "question_idx": 792, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 9], "binary_question": "Must Step 10 happen after Step 4?", "why_question": "Why must Step 10 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 10 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 can happen after Step 3 as it involves preparing the tin, not the batter.\"\n}\n```"}
{"plan_idx": 793, "title": "simple-basic-cupcakes", "question_idx": 793, "steps": ["Preheat oven to 180 C / Gas 4.", "Beat butter and sugar together until light and fluffy.", "Add the eggs, one at a time, beating after each addition.", "If the batter is too thick, stir in some milk.", "Gradually add the flour, mixing well each time until evenly mixed.", "Spoon tablespoons of batter into a greased muffin tin.", "Bake in preheated oven for 15-20 minutes.", "The cake is done when a skewer inserted to the cake comes out clean.", "Let rest for fives minutes, then allow to cool fully on a wire rack.", "Decorate, if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why must Step 2 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: simple-basic-cupcakes\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Beat butter and sugar together until light and fluffy.\n3. Add the eggs, one at a time, beating after each addition.\n4. If the batter is too thick, stir in some milk.\n5. Gradually add the flour, mixing well each time until evenly mixed.\n6. Spoon tablespoons of batter into a greased muffin tin.\n7. Bake in preheated oven for 15-20 minutes.\n8. The cake is done when a skewer inserted to the cake comes out clean.\n9. Let rest for fives minutes, then allow to cool fully on a wire rack.\n10. Decorate, if desired.\n\n\n1. Must Step 2 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen after Step 1 because the oven needs to be preheated before baking the cupcakes.\"\n}\n```"}
{"plan_idx": 794, "title": "no-sugar-rock-cakes", "question_idx": 794, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why must Step 6 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\n1. Must Step 6 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The dough needs to be placed on a preheated oven to bake properly.\"\n}\n```"}
{"plan_idx": 795, "title": "chocolate-chocolate-cake", "question_idx": 795, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 6], "binary_question": "Must Step 7 happen after Step 5?", "why_question": "Why must Step 7 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 7 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 involves beating sugar into the butter and margarine mixture, which is part of the batter preparation that must follow the cooling of the chocolate mixture in Step 5.\"\n}\n```"}
{"plan_idx": 796, "title": "green-tofu-curry", "question_idx": 796, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 10], "binary_question": "Must Step 11 happen after Step 8?", "why_question": "Why must Step 11 happen after Step 8?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 11 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 is part of preparing the curry sauce, which is independent of seasoning the tofu in Step 8.\"\n}\n```"}
{"plan_idx": 797, "title": "chocolate-chocolate-cake", "question_idx": 797, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 13], "binary_question": "Must Step 14 happen after Step 4?", "why_question": "Why must Step 14 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 14 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 14 can be done at any time before Step 16 as it involves preparing the cake tin, which is independent of the chocolate mixture cooling process.\"\n}\n```"}
{"plan_idx": 798, "title": "fusilli-and-meatballs", "question_idx": 798, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 9], "binary_question": "Must Step 10 happen after Step 1?", "why_question": "Why must Step 10 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 10 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 10 involves adding herbs to the simmering tomato sauce, which requires the sauce to be prepared in Step 1 and subsequent steps.\"\n}\n```"}
{"plan_idx": 799, "title": "curried bbq mussels", "question_idx": 799, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why must Step 2 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 2 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 2 can be done independently of Step 1 as it involves preparing the curry mixture, which does not require the barbecue to be preheated.\"\n}\n```"}
{"plan_idx": 800, "title": "almond and apple cake", "question_idx": 800, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [8, 9], "binary_question": "Must Step 10 happen after Step 9?", "why_question": "Why must Step 10 happen after Step 9?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 10 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 10 must happen after Step 9 because the apple needs to be arranged in the prepared tin before the cake mixture is added on top.\"\n}\n```"}
{"plan_idx": 801, "title": "chocolate-chocolate-cake", "question_idx": 801, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 8], "binary_question": "Must Step 9 happen after Step 5?", "why_question": "Why must Step 9 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 9 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 9 involves adding flour to the mixture, which includes the butter, margarine, sugar, and egg yolks that are prepared in Steps 6-8, and these steps must follow the cooling of the chocolate in Step 5.\"\n}\n```"}
{"plan_idx": 802, "title": "chocolate-chocolate-cake", "question_idx": 802, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why must Step 3 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 3 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 3 does not depend on Step 1 and can be done independently.\"\n}\n```"}
{"plan_idx": 803, "title": "chicken and vegetable pie", "question_idx": 803, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 5 happen after Step 2?", "why_question": "Why must Step 5 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 5 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 involves cooking the onion in butter, which is part of the preparation of the sauce that will be combined with the chicken mixture prepared in Step 2.\"\n}\n```"}
{"plan_idx": 804, "title": "fusilli-and-meatballs", "question_idx": 804, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 13], "binary_question": "Must Step 14 happen after Step 2?", "why_question": "Why must Step 14 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 14 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 14 can happen independently of Step 2 as it involves cooking the meatballs, which is a separate process from saut\u00e9ing the onion and garlic.\"\n}\n```"}
{"plan_idx": 805, "title": "warm-puy-lentil-and-tomato-salad", "question_idx": 805, "steps": ["Bring a large pan of water to the boil;", "add lentils and cook over low heat for 30 minutes.", "Put tomatoes in a small bowl and season with salt.", "Set aside for 15 minutes.", "Drain lentils and tomatoes and mix together.", "Distribute mixture evenly in 6 individual bowls or ramekins, sprinkle with chopped parsley and serve warm or chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why must Step 3 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: warm-puy-lentil-and-tomato-salad\n\nProcedure:\n1. Bring a large pan of water to the boil;\n2. add lentils and cook over low heat for 30 minutes.\n3. Put tomatoes in a small bowl and season with salt.\n4. Set aside for 15 minutes.\n5. Drain lentils and tomatoes and mix together.\n6. Distribute mixture evenly in 6 individual bowls or ramekins, sprinkle with chopped parsley and serve warm or chilled.\n\n\n1. Must Step 3 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 3 can happen independently of Step 1 as it involves seasoning the tomatoes, which does not depend on the lentils being cooked.\"\n}\n```"}
{"plan_idx": 806, "title": "spiced butternut squash soup", "question_idx": 806, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 7], "binary_question": "Must Step 8 happen after Step 2?", "why_question": "Why must Step 8 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 8 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 8 involves preparing the aromatics in a pot, which is independent of Step 2 that involves preparing the baking dish for the squash.\"\n}\n```"}
{"plan_idx": 807, "title": "curried bbq mussels", "question_idx": 807, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why must Step 6 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 6 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 6 involves sprinkling red pepper and parsley over the mussels, which can be done independently of preheating the barbecue in Step 1.\"\n}\n```"}
{"plan_idx": 808, "title": "very-vanilla-ry-cheesecake", "question_idx": 808, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 9], "binary_question": "Must Step 10 happen after Step 4?", "why_question": "Why must Step 10 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 10 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 involves preparing the oven for baking and can be done independently of Step 4, which is about preparing the crust.\"\n}\n```"}
{"plan_idx": 809, "title": "spiced-pumpkin-teabread", "question_idx": 809, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 5 happen after Step 2?", "why_question": "Why must Step 5 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 5 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 5 does not depend on Step 2, as it involves mixing ingredients and not preparing the loaf tin.\"\n}\n```"}
{"plan_idx": 810, "title": "fusilli-and-meatballs", "question_idx": 810, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 8], "binary_question": "Must Step 9 happen after Step 4?", "why_question": "Why must Step 9 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 9 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 9 involves simmering the tomato sauce, which requires the tomatoes to be added to the saucepan in Step 6, and Steps 5-8 must be completed before that.\"\n}\n```"}
{"plan_idx": 811, "title": "chicken and vegetable pie", "question_idx": 811, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 8], "binary_question": "Must Step 9 happen after Step 4?", "why_question": "Why must Step 9 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 9 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 9 must happen after Step 4 because the liquid mixture prepared in Step 9 is poured over the chicken mixture set aside in Step 4.\"\n}\n```"}
{"plan_idx": 812, "title": "chocolate-chocolate-cake", "question_idx": 812, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [12, 14], "binary_question": "Must Step 15 happen after Step 13?", "why_question": "Why must Step 15 happen after Step 13?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 15 happen after Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 15 can be done before Step 13 as it involves preparing the tin, which does not depend on the mixture being ready.\"\n}\n```"}
{"plan_idx": 813, "title": "chocolate-chocolate-cake", "question_idx": 813, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 18], "binary_question": "Must Step 19 happen after Step 7?", "why_question": "Why must Step 19 happen after Step 7?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 19 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 19 is an observation about the cake's baking process and does not need to follow Step 7, which is about beating sugar into the butter and margarine mixture.\"\n}\n```"}
{"plan_idx": 814, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 814, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 6], "binary_question": "Must Step 7 happen after Step 5?", "why_question": "Why must Step 7 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\n1. Must Step 7 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 must happen after Step 5 because the peppers need to be mixed into the mushrooms after they have been cooked with the mustard, lemon zest, garlic, and sherry.\"\n}\n```"}
{"plan_idx": 815, "title": "very-vanilla-ry-cheesecake", "question_idx": 815, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 6], "binary_question": "Must Step 7 happen after Step 4?", "why_question": "Why must Step 7 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 7 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 involves incorporating eggs into the cream cheese mixture, which must be done after preparing the biscuit base in Step 4 to ensure the cheesecake filling is ready to be poured into the base.\"\n}\n```"}
{"plan_idx": 816, "title": "no-sugar-rock-cakes", "question_idx": 816, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 5 happen after Step 2?", "why_question": "Why must Step 5 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\n1. Must Step 5 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 5 does not depend on Step 2 and can be done independently.\"\n}\n```"}
{"plan_idx": 817, "title": "spanish-rabbit-stew", "question_idx": 817, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 9], "binary_question": "Must Step 10 happen after Step 3?", "why_question": "Why must Step 10 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 10 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 involves cooking pasta separately and can be done at any time before serving.\"\n}\n```"}
{"plan_idx": 818, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 818, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 6], "binary_question": "Must Step 7 happen after Step 4?", "why_question": "Why must Step 7 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\n1. Must Step 7 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 must happen after Step 4 because the peppers need to be mixed into the cooked mushrooms, which are prepared in Step 4.\"\n}\n```"}
{"plan_idx": 819, "title": "chocolate-chocolate-cake", "question_idx": 819, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [18, 21], "binary_question": "Must Step 22 happen after Step 19?", "why_question": "Why must Step 22 happen after Step 19?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 22 happen after Step 19?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 22 must happen after Step 19 because the cake needs to be fully baked and cooled before adding the icing sugar for decoration.\"\n}\n```"}
{"plan_idx": 820, "title": "fusilli-and-meatballs", "question_idx": 820, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [8, 15], "binary_question": "Must Step 16 happen after Step 9?", "why_question": "Why must Step 16 happen after Step 9?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 16 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 16 involves draining the meatballs after browning them, which is independent of the tomato sauce simmering in Step 9.\"\n}\n```"}
{"plan_idx": 821, "title": "chicken and vegetable pie", "question_idx": 821, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 10], "binary_question": "Must Step 11 happen after Step 7?", "why_question": "Why must Step 11 happen after Step 7?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 11 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 must happen after Step 4, not necessarily after Step 7.\"\n}\n```"}
{"plan_idx": 822, "title": "chocolate-chocolate-cake", "question_idx": 822, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [9, 10], "binary_question": "Must Step 11 happen after Step 10?", "why_question": "Why must Step 11 happen after Step 10?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 11 happen after Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 11 must happen after Step 10 because the beaten egg whites need to be folded into the chocolate mixture, which is prepared in Step 10.\"\n}\n```"}
{"plan_idx": 823, "title": "chocolate-chocolate-cake", "question_idx": 823, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [8, 18], "binary_question": "Must Step 19 happen after Step 9?", "why_question": "Why must Step 19 happen after Step 9?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 19 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 19 is an observation about the cake's baking process and does not need to follow Step 9.\"\n}\n```"}
{"plan_idx": 824, "title": "very-vanilla-ry-cheesecake", "question_idx": 824, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why must Step 6 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 6 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 6 does not depend on Step 1 and can be done independently.\"\n}\n```"}
{"plan_idx": 825, "title": "fusilli-and-meatballs", "question_idx": 825, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [8, 18], "binary_question": "Must Step 19 happen after Step 9?", "why_question": "Why must Step 19 happen after Step 9?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 19 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 19 can happen at any time as long as the pasta is ready by the time the meatballs and sauce are finished.\"\n}\n```"}
{"plan_idx": 826, "title": "fusilli-and-meatballs", "question_idx": 826, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 11], "binary_question": "Must Step 12 happen after Step 8?", "why_question": "Why must Step 12 happen after Step 8?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 12 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 12 involves preparing the meatball mixture and is independent of the sauce preparation steps.\"\n}\n```"}
{"plan_idx": 827, "title": "fusilli-and-meatballs", "question_idx": 827, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 18], "binary_question": "Must Step 19 happen after Step 2?", "why_question": "Why must Step 19 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 19 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 19 does not depend on Step 2 and can be done independently.\"\n}\n```"}
{"plan_idx": 828, "title": "fusilli-and-meatballs", "question_idx": 828, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 10], "binary_question": "Must Step 11 happen after Step 8?", "why_question": "Why must Step 11 happen after Step 8?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 11 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 is independent of Step 8 and can be done at any time before Step 12.\"\n}\n```"}
{"plan_idx": 829, "title": "spiced-pumpkin-teabread", "question_idx": 829, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 6], "binary_question": "Must Step 7 happen after Step 5?", "why_question": "Why must Step 7 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 7 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 must happen after Step 5 because the dry ingredients need to be prepared before combining them with the wet pumpkin mixture in Step 8.\"\n}\n```"}
{"plan_idx": 830, "title": "very-vanilla-ry-cheesecake", "question_idx": 830, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 7 happen after Step 1?", "why_question": "Why must Step 7 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 7 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 involves beating eggs into the cream cheese mixture, which is independent of preheating the oven in Step 1.\"\n}\n```"}
{"plan_idx": 831, "title": "vegetable-terrine", "question_idx": 831, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 9], "binary_question": "Must Step 10 happen after Step 2?", "why_question": "Why must Step 10 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 10 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 is a recommendation about the type of mould to use and does not depend on the cooking of the vegetables in Step 2.\"\n}\n```"}
{"plan_idx": 832, "title": "green-tofu-curry", "question_idx": 832, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 8], "binary_question": "Must Step 9 happen after Step 7?", "why_question": "Why must Step 9 happen after Step 7?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 9 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 9 can happen independently of Step 7 as it involves preparing the curry sauce, which can be done concurrently with frying the tofu.\"\n}\n```"}
{"plan_idx": 833, "title": "almond and apple cake", "question_idx": 833, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 7 happen after Step 3?", "why_question": "Why must Step 7 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 7 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 involves adding ingredients to the mixture, which must be done after preparing the cake tin in Step 3.\"\n}\n```"}
{"plan_idx": 834, "title": "chocolate-chocolate-cake", "question_idx": 834, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 13], "binary_question": "Must Step 14 happen after Step 7?", "why_question": "Why must Step 14 happen after Step 7?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 14 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 14 can be done independently of Step 7 as it involves preparing the cake tin, not the batter.\"\n}\n```"}
{"plan_idx": 835, "title": "chocolate-chocolate-cake", "question_idx": 835, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 11], "binary_question": "Must Step 12 happen after Step 2?", "why_question": "Why must Step 12 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 12 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 12 involves beating egg whites and is independent of placing chocolate chips, coffee, and water in a microwave safe bowl in Step 2.\"\n}\n```"}
{"plan_idx": 836, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 836, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 11], "binary_question": "Must Step 12 happen after Step 6?", "why_question": "Why must Step 12 happen after Step 6?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 12 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 12 can happen at any time before the assembly in Step 14.\"\n}\n```"}
{"plan_idx": 837, "title": "fusilli-and-meatballs", "question_idx": 837, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 13], "binary_question": "Must Step 14 happen after Step 5?", "why_question": "Why must Step 14 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 14 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 14 can happen independently of Step 5 as it involves cooking the meatballs, which is a separate process from preparing the tomato sauce.\"\n}\n```"}
{"plan_idx": 838, "title": "chocolate-chocolate-cake", "question_idx": 838, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 10], "binary_question": "Must Step 11 happen after Step 6?", "why_question": "Why must Step 11 happen after Step 6?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 11 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 can be done independently of Step 6 as it involves a separate bowl and does not depend on the butter and margarine mixture.\"\n}\n```"}
{"plan_idx": 839, "title": "strawberry-tiramisu-trifle", "question_idx": 839, "steps": ["Set 3 strawberries for the garnish aside, and cut the rest into slices.", "In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.", "Then stir in the custard and finally fold in the whipped cream.", "Brush the sponge fingers with the remaining coffee.", "Line a glass bowl with one layer of the soaked sponge fingers.", "Spread half of the strawberries over the sponge fingers.", "Sprinkle half of the grated chocolate over that and then half of the custard mixture.", "Repeat the layers in order again.", "Cut the remaining 3 strawberries in half and lay them on top of the trifle.", "Cover and leave in the fridge for at least 4 hours, best overnight."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why must Step 4 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberry-tiramisu-trifle\n\nProcedure:\n1. Set 3 strawberries for the garnish aside, and cut the rest into slices.\n2. In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.\n3. Then stir in the custard and finally fold in the whipped cream.\n4. Brush the sponge fingers with the remaining coffee.\n5. Line a glass bowl with one layer of the soaked sponge fingers.\n6. Spread half of the strawberries over the sponge fingers.\n7. Sprinkle half of the grated chocolate over that and then half of the custard mixture.\n8. Repeat the layers in order again.\n9. Cut the remaining 3 strawberries in half and lay them on top of the trifle.\n10. Cover and leave in the fridge for at least 4 hours, best overnight.\n\n\n1. Must Step 4 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 4 does not depend on Step 1 and can be done independently.\"\n}\n```"}
{"plan_idx": 840, "title": "fusilli-and-meatballs", "question_idx": 840, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [9, 15], "binary_question": "Must Step 16 happen after Step 10?", "why_question": "Why must Step 16 happen after Step 10?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 16 happen after Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 16 involves draining the meatballs after they are cooked, which is independent of adding basil and oregano to the sauce in Step 10.\"\n}\n```"}
{"plan_idx": 841, "title": "green-tofu-curry", "question_idx": 841, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 8], "binary_question": "Must Step 9 happen after Step 5?", "why_question": "Why must Step 9 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 9 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 9 can happen independently of Step 5 as they involve different ingredients and processes.\"\n}\n```"}
{"plan_idx": 842, "title": "smoked-salmon-and-grapefruit-salad", "question_idx": 842, "steps": ["Top and tail the grapefruits.", "Slice the skin off the grapefruit over a bowl.", "This is to catch any juices.", "Using a small knife, segment the grapefruits over the juice bowl.", "Arrange the lamb's lettuce onto each serving plate or a large salad bowl.", "Top with grapefruit segments and smoked salmon.", "Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.", "Pour over the salad and serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 7 happen after Step 6?", "why_question": "Why must Step 7 happen after Step 6?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: smoked-salmon-and-grapefruit-salad\n\nProcedure:\n1. Top and tail the grapefruits.\n2. Slice the skin off the grapefruit over a bowl.\n3. This is to catch any juices.\n4. Using a small knife, segment the grapefruits over the juice bowl.\n5. Arrange the lamb's lettuce onto each serving plate or a large salad bowl.\n6. Top with grapefruit segments and smoked salmon.\n7. Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.\n8. Pour over the salad and serve.\n\n\n1. Must Step 7 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 can be done before Step 6 as it involves preparing the dressing, which can be poured over the salad after arranging the ingredients.\"\n}\n```"}
{"plan_idx": 843, "title": "spanish-rabbit-stew", "question_idx": 843, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 10], "binary_question": "Must Step 11 happen after Step 2?", "why_question": "Why must Step 11 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 11 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 is about enjoying the meal, which naturally happens after the cooking process, not specifically after Step 2.\"\n}\n```"}
{"plan_idx": 844, "title": "spiced-pumpkin-teabread", "question_idx": 844, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 7 happen after Step 2?", "why_question": "Why must Step 7 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 7 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 does not depend on Step 2 and can be done independently.\"\n}\n```"}
{"plan_idx": 845, "title": "chicken and vegetable pie", "question_idx": 845, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 7 happen after Step 2?", "why_question": "Why must Step 7 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 7 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 involves making the sauce, which is independent of boiling the chicken and vegetables in Step 2.\"\n}\n```"}
{"plan_idx": 846, "title": "fusilli-and-meatballs", "question_idx": 846, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [9, 18], "binary_question": "Must Step 19 happen after Step 10?", "why_question": "Why must Step 19 happen after Step 10?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 19 happen after Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 19 can happen independently of Step 10 as it involves cooking the pasta, which is separate from the sauce preparation.\"\n}\n```"}
{"plan_idx": 847, "title": "cranachan", "question_idx": 847, "steps": ["Preheat the oven to 180 C / Gas mark 4.", "Spread oats out in a thin layer on a baking tray.", "Toast in the oven for about 10 minutes, or until lightly browned.", "Set aside to cool.", "Remove them from the tray for faster cooling.", "In a medium bowl, whip the cream to firm peaks.", "Gently fold in the icing sugar, vanilla and toasted oats.", "Spoon into 4 serving bowls, and top with fresh berries.", "For an extra touch, drizzle some whisky over each serving.", "Garnish with a mint leaf."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 6 happen after Step 3?", "why_question": "Why must Step 6 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cranachan\n\nProcedure:\n1. Preheat the oven to 180 C / Gas mark 4.\n2. Spread oats out in a thin layer on a baking tray.\n3. Toast in the oven for about 10 minutes, or until lightly browned.\n4. Set aside to cool.\n5. Remove them from the tray for faster cooling.\n6. In a medium bowl, whip the cream to firm peaks.\n7. Gently fold in the icing sugar, vanilla and toasted oats.\n8. Spoon into 4 serving bowls, and top with fresh berries.\n9. For an extra touch, drizzle some whisky over each serving.\n10. Garnish with a mint leaf.\n\n\n1. Must Step 6 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The toasted oats need to be ready and cooled before they can be folded into the whipped cream.\"\n}\n```"}
{"plan_idx": 848, "title": "warm-puy-lentil-and-tomato-salad", "question_idx": 848, "steps": ["Bring a large pan of water to the boil;", "add lentils and cook over low heat for 30 minutes.", "Put tomatoes in a small bowl and season with salt.", "Set aside for 15 minutes.", "Drain lentils and tomatoes and mix together.", "Distribute mixture evenly in 6 individual bowls or ramekins, sprinkle with chopped parsley and serve warm or chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 4 happen after Step 2?", "why_question": "Why must Step 4 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: warm-puy-lentil-and-tomato-salad\n\nProcedure:\n1. Bring a large pan of water to the boil;\n2. add lentils and cook over low heat for 30 minutes.\n3. Put tomatoes in a small bowl and season with salt.\n4. Set aside for 15 minutes.\n5. Drain lentils and tomatoes and mix together.\n6. Distribute mixture evenly in 6 individual bowls or ramekins, sprinkle with chopped parsley and serve warm or chilled.\n\n\n1. Must Step 4 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen after Step 2 because the tomatoes need to be set aside for 15 minutes while the lentils are cooking to ensure they are properly seasoned and ready to be mixed together.\"\n}\n```"}
{"plan_idx": 849, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 849, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [9, 10], "binary_question": "Must Step 11 happen after Step 10?", "why_question": "Why must Step 11 happen after Step 10?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 11 happen after Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 can be done at any time before assembling the shortcakes, as it does not depend on the cooling of the shortcakes.\"\n}\n```"}
{"plan_idx": 850, "title": "no-sugar-rock-cakes", "question_idx": 850, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 3 happen after Step 2?", "why_question": "Why must Step 3 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\n1. Must Step 3 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 involves preparing the dough mixture, which needs to be placed on the baking tray prepared in Step 2.\"\n}\n```"}
{"plan_idx": 851, "title": "spanish-rabbit-stew", "question_idx": 851, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why must Step 6 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 6 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 must happen after Step 2 because the tarragon and bay leaf need to be added to the mixture to ensure they release their flavor properly.\"\n}\n```"}
{"plan_idx": 852, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 852, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 11], "binary_question": "Must Step 12 happen after Step 1?", "why_question": "Why must Step 12 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 12 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 12 does not depend on Step 1 and can be done independently.\"\n}\n```"}
{"plan_idx": 853, "title": "fusilli-and-meatballs", "question_idx": 853, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 9], "binary_question": "Must Step 10 happen after Step 4?", "why_question": "Why must Step 10 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 10 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 10 involves adding herbs to the simmering tomato sauce, which is prepared in steps 5-9 after setting aside the onion mixture in step 4.\"\n}\n```"}
{"plan_idx": 854, "title": "no-sugar-rock-cakes", "question_idx": 854, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why must Step 2 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\n1. Must Step 2 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 2 can be done before or after Step 1 as it does not depend on the oven being preheated.\"\n}\n```"}
{"plan_idx": 855, "title": "curried bbq mussels", "question_idx": 855, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 7 happen after Step 3?", "why_question": "Why must Step 7 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 7 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 must happen after Step 6, not necessarily after Step 3.\"\n}\n```"}
{"plan_idx": 856, "title": "chocolate-chocolate-cake", "question_idx": 856, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 11], "binary_question": "Must Step 12 happen after Step 8?", "why_question": "Why must Step 12 happen after Step 8?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 12 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 12 must happen after Step 8 because the egg whites need to be folded into the chocolate mixture, which is prepared by combining the ingredients from the previous steps.\"\n}\n```"}
{"plan_idx": 857, "title": "green-tofu-curry", "question_idx": 857, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 9], "binary_question": "Must Step 10 happen after Step 4?", "why_question": "Why must Step 10 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 10 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 involves preparing the curry sauce and is independent of the rice preparation in Step 4.\"\n}\n```"}
{"plan_idx": 858, "title": "almond and apple cake", "question_idx": 858, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 9], "binary_question": "Must Step 10 happen after Step 1?", "why_question": "Why must Step 10 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 10 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 does not depend on preheating the oven and can be done independently.\"\n}\n```"}
{"plan_idx": 859, "title": "smoked-salmon-and-grapefruit-salad", "question_idx": 859, "steps": ["Top and tail the grapefruits.", "Slice the skin off the grapefruit over a bowl.", "This is to catch any juices.", "Using a small knife, segment the grapefruits over the juice bowl.", "Arrange the lamb's lettuce onto each serving plate or a large salad bowl.", "Top with grapefruit segments and smoked salmon.", "Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.", "Pour over the salad and serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 7], "binary_question": "Must Step 8 happen after Step 3?", "why_question": "Why must Step 8 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: smoked-salmon-and-grapefruit-salad\n\nProcedure:\n1. Top and tail the grapefruits.\n2. Slice the skin off the grapefruit over a bowl.\n3. This is to catch any juices.\n4. Using a small knife, segment the grapefruits over the juice bowl.\n5. Arrange the lamb's lettuce onto each serving plate or a large salad bowl.\n6. Top with grapefruit segments and smoked salmon.\n7. Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.\n8. Pour over the salad and serve.\n\n\n1. Must Step 8 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 8 requires the grapefruit juice collected in Step 3 to pour over the salad.\"\n}\n```"}
{"plan_idx": 860, "title": "spiced butternut squash soup", "question_idx": 860, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 9], "binary_question": "Must Step 10 happen after Step 3?", "why_question": "Why must Step 10 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 10 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 involves boiling potatoes in chicken stock, which is independent of placing squash halves in a baking dish in Step 3.\"\n}\n```"}
{"plan_idx": 861, "title": "chicken and vegetable pie", "question_idx": 861, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 9], "binary_question": "Must Step 10 happen after Step 2?", "why_question": "Why must Step 10 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 10 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 does not depend on Step 2 and can be done independently.\"\n}\n```"}
{"plan_idx": 862, "title": "spicy-tomato-anchovy-pasta", "question_idx": 862, "steps": ["Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;", "cook until lightly browned.", "Add anchovies and water, cover and simmer for 4 to 5 minutes.", "Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.", "While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.", "Add linguine and cook until al dente, about 7 to 8 minutes;", "drain.", "Toss with anchovy mixture and chilli flakes.", "If desired, season with black pepper.", "Serve immediately."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 5 happen after Step 2?", "why_question": "Why must Step 5 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spicy-tomato-anchovy-pasta\n\nProcedure:\n1. Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;\n2. cook until lightly browned.\n3. Add anchovies and water, cover and simmer for 4 to 5 minutes.\n4. Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.\n5. While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.\n6. Add linguine and cook until al dente, about 7 to 8 minutes;\n7. drain.\n8. Toss with anchovy mixture and chilli flakes.\n9. If desired, season with black pepper.\n10. Serve immediately.\n\n\n1. Must Step 5 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 5 can happen independently of Step 2 as it involves boiling water for the pasta, which can be done concurrently with cooking the vegetables.\"\n}\n```"}
{"plan_idx": 863, "title": "fusilli-and-meatballs", "question_idx": 863, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 18], "binary_question": "Must Step 19 happen after Step 5?", "why_question": "Why must Step 19 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 19 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 19 can happen independently of Step 5 as it involves cooking the pasta, which is separate from preparing the sauce.\"\n}\n```"}
{"plan_idx": 864, "title": "vegetable-terrine", "question_idx": 864, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 8], "binary_question": "Must Step 9 happen after Step 3?", "why_question": "Why must Step 9 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 9 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 9 involves pouring the cream mixture into the mould, which requires the cream mixture to be prepared in Steps 5-8, and the vegetables to be cooked and cooled in Steps 2-3.\"\n}\n```"}
{"plan_idx": 865, "title": "chocolate-chocolate-cake", "question_idx": 865, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 14], "binary_question": "Must Step 15 happen after Step 1?", "why_question": "Why must Step 15 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 15 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 15 can be done at any time before Step 16 as it involves preparing the tin, not the oven.\"\n}\n```"}
{"plan_idx": 866, "title": "fusilli-and-meatballs", "question_idx": 866, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 13], "binary_question": "Must Step 14 happen after Step 1?", "why_question": "Why must Step 14 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 14 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 14 involves cooking the meatballs, which can be done independently of the initial preparation of the saucepan in Step 1.\"\n}\n```"}
{"plan_idx": 867, "title": "green-tofu-curry", "question_idx": 867, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 9], "binary_question": "Must Step 10 happen after Step 8?", "why_question": "Why must Step 10 happen after Step 8?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 10 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 involves preparing the curry sauce and is independent of seasoning the tofu in Step 8.\"\n}\n```"}
{"plan_idx": 868, "title": "curried bbq mussels", "question_idx": 868, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why must Step 5 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 5 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 5 does not depend on Step 1 and can be done independently of preheating the barbecue.\"\n}\n```"}
{"plan_idx": 869, "title": "fusilli-and-meatballs", "question_idx": 869, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why must Step 5 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 5 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 5 involves processing the tomatoes, which is independent of coating the saucepan in Step 1.\"\n}\n```"}
{"plan_idx": 870, "title": "chicken-prawn-and-rice-soup", "question_idx": 870, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 9], "binary_question": "Must Step 10 happen after Step 5?", "why_question": "Why must Step 10 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 10 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 can happen independently of Step 5 as it involves heating oil for the rice, which does not affect the mixture in the pot.\"\n}\n```"}
{"plan_idx": 871, "title": "smoked-salmon-and-grapefruit-salad", "question_idx": 871, "steps": ["Top and tail the grapefruits.", "Slice the skin off the grapefruit over a bowl.", "This is to catch any juices.", "Using a small knife, segment the grapefruits over the juice bowl.", "Arrange the lamb's lettuce onto each serving plate or a large salad bowl.", "Top with grapefruit segments and smoked salmon.", "Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.", "Pour over the salad and serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 5 happen after Step 4?", "why_question": "Why must Step 5 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: smoked-salmon-and-grapefruit-salad\n\nProcedure:\n1. Top and tail the grapefruits.\n2. Slice the skin off the grapefruit over a bowl.\n3. This is to catch any juices.\n4. Using a small knife, segment the grapefruits over the juice bowl.\n5. Arrange the lamb's lettuce onto each serving plate or a large salad bowl.\n6. Top with grapefruit segments and smoked salmon.\n7. Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.\n8. Pour over the salad and serve.\n\n\n1. Must Step 5 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 must happen after Step 4 because the grapefruit segments prepared in Step 4 are needed to top the lamb's lettuce in Step 5.\"\n}\n```"}
{"plan_idx": 872, "title": "almond and apple cake", "question_idx": 872, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why must Step 6 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 6 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 6 involves mixing ingredients and does not depend on greasing the cake tin in Step 2.\"\n}\n```"}
{"plan_idx": 873, "title": "brown sugar shortbread", "question_idx": 873, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 8], "binary_question": "Must Step 9 happen after Step 1?", "why_question": "Why must Step 9 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\n1. Must Step 9 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 9 involves placing the dough on baking trays, which must be done after preheating the oven in Step 1 to ensure the oven is ready for baking.\"\n}\n```"}
{"plan_idx": 874, "title": "very-vanilla-ry-cheesecake", "question_idx": 874, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 6], "binary_question": "Must Step 7 happen after Step 5?", "why_question": "Why must Step 7 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 7 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 involves preparing the cheesecake filling, which must be done after the crust is prepared and set aside in Step 5.\"\n}\n```"}
{"plan_idx": 875, "title": "vegetable-terrine", "question_idx": 875, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why must Step 2 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 2 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The gelatin needs to be softened in cold water before it can be added to the cream mixture in later steps.\"\n}\n```"}
{"plan_idx": 876, "title": "chicken and vegetable pie", "question_idx": 876, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 6 happen after Step 3?", "why_question": "Why must Step 6 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 6 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 involves making the sauce, which requires the saucepan to be free after boiling the chicken and vegetables in Step 3.\"\n}\n```"}
{"plan_idx": 877, "title": "cloud-bread", "question_idx": 877, "steps": ["Preheat oven to 150 C / Gas mark 2.", "Line a baking tray with baking paper.", "Mix cream cheese and egg yolks together until smooth.", "Place egg whites and baking powder in a glass, metal, or ceramic bowl;", "beat together until stiff peaks form.", "Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.", "Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.", "Bake in the preheated oven until golden brown, 17 to 20 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why must Step 6 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cloud-bread\n\nProcedure:\n1. Preheat oven to 150 C / Gas mark 2.\n2. Line a baking tray with baking paper.\n3. Mix cream cheese and egg yolks together until smooth.\n4. Place egg whites and baking powder in a glass, metal, or ceramic bowl;\n5. beat together until stiff peaks form.\n6. Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.\n7. Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.\n8. Bake in the preheated oven until golden brown, 17 to 20 minutes.\n\n\n1. Must Step 6 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 6 does not depend on Step 2 and can be done independently.\"\n}\n```"}
{"plan_idx": 878, "title": "strawberry-tiramisu-trifle", "question_idx": 878, "steps": ["Set 3 strawberries for the garnish aside, and cut the rest into slices.", "In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.", "Then stir in the custard and finally fold in the whipped cream.", "Brush the sponge fingers with the remaining coffee.", "Line a glass bowl with one layer of the soaked sponge fingers.", "Spread half of the strawberries over the sponge fingers.", "Sprinkle half of the grated chocolate over that and then half of the custard mixture.", "Repeat the layers in order again.", "Cut the remaining 3 strawberries in half and lay them on top of the trifle.", "Cover and leave in the fridge for at least 4 hours, best overnight."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 4 happen after Step 2?", "why_question": "Why must Step 4 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberry-tiramisu-trifle\n\nProcedure:\n1. Set 3 strawberries for the garnish aside, and cut the rest into slices.\n2. In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.\n3. Then stir in the custard and finally fold in the whipped cream.\n4. Brush the sponge fingers with the remaining coffee.\n5. Line a glass bowl with one layer of the soaked sponge fingers.\n6. Spread half of the strawberries over the sponge fingers.\n7. Sprinkle half of the grated chocolate over that and then half of the custard mixture.\n8. Repeat the layers in order again.\n9. Cut the remaining 3 strawberries in half and lay them on top of the trifle.\n10. Cover and leave in the fridge for at least 4 hours, best overnight.\n\n\n1. Must Step 4 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 4 does not depend on Step 2 and can be done independently.\"\n}\n```"}
{"plan_idx": 879, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 879, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 11], "binary_question": "Must Step 12 happen after Step 4?", "why_question": "Why must Step 12 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 12 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 12 can be done independently of Step 4 as it involves preparing the whipped cream, which does not affect the dough preparation.\"\n}\n```"}
{"plan_idx": 880, "title": "chocolate-chocolate-cake", "question_idx": 880, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [14, 18], "binary_question": "Must Step 19 happen after Step 15?", "why_question": "Why must Step 19 happen after Step 15?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 19 happen after Step 15?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 19 is an observation about the cake's baking process and does not depend on Step 15.\"\n}\n```"}
{"plan_idx": 881, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 881, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 7 happen after Step 1?", "why_question": "Why must Step 7 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\n1. Must Step 7 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 involves mixing the peppers into the mushrooms, which requires the mushrooms to be cooked first as per the earlier steps.\"\n}\n```"}
{"plan_idx": 882, "title": "brown sugar shortbread", "question_idx": 882, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 7], "binary_question": "Must Step 8 happen after Step 1?", "why_question": "Why must Step 8 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\n1. Must Step 8 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 8 involves cutting the dough, which can only be done after the dough is prepared in the previous steps.\"\n}\n```"}
{"plan_idx": 883, "title": "vegetable-terrine", "question_idx": 883, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 7 happen after Step 3?", "why_question": "Why must Step 7 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 7 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 involves mixing the cream mixture and does not depend on the vegetables being run under cold water in Step 3.\"\n}\n```"}
{"plan_idx": 884, "title": "fusilli-and-meatballs", "question_idx": 884, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 7], "binary_question": "Must Step 8 happen after Step 3?", "why_question": "Why must Step 8 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 8 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 8 involves reducing the heat of the tomato sauce, which is added to the saucepan in Step 6, so it must happen after Step 3.\"\n}\n```"}
{"plan_idx": 885, "title": "spicy-tomato-anchovy-pasta", "question_idx": 885, "steps": ["Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;", "cook until lightly browned.", "Add anchovies and water, cover and simmer for 4 to 5 minutes.", "Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.", "While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.", "Add linguine and cook until al dente, about 7 to 8 minutes;", "drain.", "Toss with anchovy mixture and chilli flakes.", "If desired, season with black pepper.", "Serve immediately."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 5 happen after Step 3?", "why_question": "Why must Step 5 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spicy-tomato-anchovy-pasta\n\nProcedure:\n1. Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;\n2. cook until lightly browned.\n3. Add anchovies and water, cover and simmer for 4 to 5 minutes.\n4. Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.\n5. While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.\n6. Add linguine and cook until al dente, about 7 to 8 minutes;\n7. drain.\n8. Toss with anchovy mixture and chilli flakes.\n9. If desired, season with black pepper.\n10. Serve immediately.\n\n\n1. Must Step 5 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 5 can happen independently of Step 3 as it involves boiling water for the pasta, which can be done concurrently with cooking the vegetables.\"\n}\n```"}
{"plan_idx": 886, "title": "spicy-tomato-anchovy-pasta", "question_idx": 886, "steps": ["Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;", "cook until lightly browned.", "Add anchovies and water, cover and simmer for 4 to 5 minutes.", "Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.", "While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.", "Add linguine and cook until al dente, about 7 to 8 minutes;", "drain.", "Toss with anchovy mixture and chilli flakes.", "If desired, season with black pepper.", "Serve immediately."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 5 happen after Step 4?", "why_question": "Why must Step 5 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spicy-tomato-anchovy-pasta\n\nProcedure:\n1. Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;\n2. cook until lightly browned.\n3. Add anchovies and water, cover and simmer for 4 to 5 minutes.\n4. Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.\n5. While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.\n6. Add linguine and cook until al dente, about 7 to 8 minutes;\n7. drain.\n8. Toss with anchovy mixture and chilli flakes.\n9. If desired, season with black pepper.\n10. Serve immediately.\n\n\n1. Must Step 5 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 5 can happen concurrently with Step 4 as they involve separate tasks that do not depend on each other.\"\n}\n```"}
{"plan_idx": 887, "title": "chocolate-pancake-batter", "question_idx": 887, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 6 happen after Step 3?", "why_question": "Why must Step 6 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 6 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 6 involves preparing the pan for cooking and is independent of mixing the batter in Step 3.\"\n}\n```"}
{"plan_idx": 888, "title": "chocolate-chocolate-cake", "question_idx": 888, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 10], "binary_question": "Must Step 11 happen after Step 1?", "why_question": "Why must Step 11 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 11 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 can happen independently of Step 1 as it involves beating egg whites, which is unrelated to preheating the oven.\"\n}\n```"}
{"plan_idx": 889, "title": "no-sugar-rock-cakes", "question_idx": 889, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why must Step 4 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\n1. Must Step 4 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 4 does not depend on the oven being preheated and can be done independently.\"\n}\n```"}
{"plan_idx": 890, "title": "chicken and vegetable pie", "question_idx": 890, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 8], "binary_question": "Must Step 9 happen after Step 1?", "why_question": "Why must Step 9 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 9 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 9 does not depend on Step 1 and can be done independently.\"\n}\n```"}
{"plan_idx": 891, "title": "cloud-bread", "question_idx": 891, "steps": ["Preheat oven to 150 C / Gas mark 2.", "Line a baking tray with baking paper.", "Mix cream cheese and egg yolks together until smooth.", "Place egg whites and baking powder in a glass, metal, or ceramic bowl;", "beat together until stiff peaks form.", "Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.", "Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.", "Bake in the preheated oven until golden brown, 17 to 20 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why must Step 6 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cloud-bread\n\nProcedure:\n1. Preheat oven to 150 C / Gas mark 2.\n2. Line a baking tray with baking paper.\n3. Mix cream cheese and egg yolks together until smooth.\n4. Place egg whites and baking powder in a glass, metal, or ceramic bowl;\n5. beat together until stiff peaks form.\n6. Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.\n7. Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.\n8. Bake in the preheated oven until golden brown, 17 to 20 minutes.\n\n\n1. Must Step 6 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 involves combining ingredients that need to be baked, so the oven must be preheated in Step 1 to ensure it is ready for baking immediately after the batter is prepared.\"\n}\n```"}
{"plan_idx": 892, "title": "green-tofu-curry", "question_idx": 892, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 7], "binary_question": "Must Step 8 happen after Step 4?", "why_question": "Why must Step 8 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 8 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 8 must happen after Step 7, but it is independent of Step 4.\"\n}\n```"}
{"plan_idx": 893, "title": "kid-s-cheese-and-veg-kebab", "question_idx": 893, "steps": ["Shave the carrots into wide ribbons / waves using a potato peeler.", "Cut the red pepper into star shapes using a star cookie cutter.", "Cut the bread into flowers using a cookie cutter.", "Assemble all onto a skewer with bread flowers top and bottom and carrot curls, cheesy chunks and pepper stars seen as layers between."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why must Step 3 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: kid-s-cheese-and-veg-kebab\n\nProcedure:\n1. Shave the carrots into wide ribbons / waves using a potato peeler.\n2. Cut the red pepper into star shapes using a star cookie cutter.\n3. Cut the bread into flowers using a cookie cutter.\n4. Assemble all onto a skewer with bread flowers top and bottom and carrot curls, cheesy chunks and pepper stars seen as layers between.\n\n\n1. Must Step 3 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"The steps can be performed in any order as long as all components are prepared before assembling the kebab.\"\n}\n```"}
{"plan_idx": 894, "title": "banana-split-cake", "question_idx": 894, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why must Step 3 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\n1. Must Step 3 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 involves pressing the mixture into the tin, which must be done after preheating the oven in Step 1 to ensure the oven is ready for baking.\"\n}\n```"}
{"plan_idx": 895, "title": "chocolate-chocolate-cake", "question_idx": 895, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 18], "binary_question": "Must Step 19 happen after Step 2?", "why_question": "Why must Step 19 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 19 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 19 is an observation about the cake's baking process and does not need to follow Step 2.\"\n}\n```"}
{"plan_idx": 896, "title": "creamy-chayote-squash-soup", "question_idx": 896, "steps": ["Dissolve the stock in the hot water.", "Melt the butter in a large saucepan over medium heat.", "Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.", "Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.", "Stir in the stock and 1 tablespoon coriander;", "cover.", "Simmer about 20 minutes.", "Pour the mixture into a liquidiser and puree until smooth.", "Pour into bowls and garnish with a sprig of coriander to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why must Step 2 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: creamy-chayote-squash-soup\n\nProcedure:\n1. Dissolve the stock in the hot water.\n2. Melt the butter in a large saucepan over medium heat.\n3. Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.\n4. Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.\n5. Stir in the stock and 1 tablespoon coriander;\n6. cover.\n7. Simmer about 20 minutes.\n8. Pour the mixture into a liquidiser and puree until smooth.\n9. Pour into bowls and garnish with a sprig of coriander to serve.\n\n\n1. Must Step 2 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 2 can happen independently of Step 1 as melting butter in a saucepan does not depend on dissolving the stock in hot water.\"\n}\n```"}
{"plan_idx": 897, "title": "spanish-rabbit-stew", "question_idx": 897, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 6 happen after Step 5?", "why_question": "Why must Step 6 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 6 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 must happen after Step 5 to ensure the tarragon and bay leaf are submerged and can release their flavors properly.\"\n}\n```"}
{"plan_idx": 898, "title": "very-vanilla-ry-cheesecake", "question_idx": 898, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 6 happen after Step 5?", "why_question": "Why must Step 6 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 6 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 involves preparing the filling, which needs to be poured into the crust prepared in Step 5.\"\n}\n```"}
{"plan_idx": 899, "title": "fusilli-and-meatballs", "question_idx": 899, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 12], "binary_question": "Must Step 13 happen after Step 6?", "why_question": "Why must Step 13 happen after Step 6?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 13 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 13 does not depend on Step 6 and can be done independently.\"\n}\n```"}
{"plan_idx": 900, "title": "strawberry-tiramisu-trifle", "question_idx": 900, "steps": ["Set 3 strawberries for the garnish aside, and cut the rest into slices.", "In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.", "Then stir in the custard and finally fold in the whipped cream.", "Brush the sponge fingers with the remaining coffee.", "Line a glass bowl with one layer of the soaked sponge fingers.", "Spread half of the strawberries over the sponge fingers.", "Sprinkle half of the grated chocolate over that and then half of the custard mixture.", "Repeat the layers in order again.", "Cut the remaining 3 strawberries in half and lay them on top of the trifle.", "Cover and leave in the fridge for at least 4 hours, best overnight."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why must Step 6 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberry-tiramisu-trifle\n\nProcedure:\n1. Set 3 strawberries for the garnish aside, and cut the rest into slices.\n2. In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.\n3. Then stir in the custard and finally fold in the whipped cream.\n4. Brush the sponge fingers with the remaining coffee.\n5. Line a glass bowl with one layer of the soaked sponge fingers.\n6. Spread half of the strawberries over the sponge fingers.\n7. Sprinkle half of the grated chocolate over that and then half of the custard mixture.\n8. Repeat the layers in order again.\n9. Cut the remaining 3 strawberries in half and lay them on top of the trifle.\n10. Cover and leave in the fridge for at least 4 hours, best overnight.\n\n\n1. Must Step 6 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 involves spreading strawberries over the sponge fingers, which are prepared in Step 4 and layered in Step 5, both of which occur after Step 2.\"\n}\n```"}
{"plan_idx": 901, "title": "very-vanilla-ry-cheesecake", "question_idx": 901, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 7], "binary_question": "Must Step 8 happen after Step 3?", "why_question": "Why must Step 8 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 8 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 8 involves preparing the cheesecake filling, which must be poured into the biscuit base prepared in Steps 3-5.\"\n}\n```"}
{"plan_idx": 902, "title": "spiced-pumpkin-teabread", "question_idx": 902, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why must Step 4 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 4 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 4 does not depend on Step 1 and can be done independently of preheating the oven.\"\n}\n```"}
{"plan_idx": 903, "title": "chicken and vegetable pie", "question_idx": 903, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 8], "binary_question": "Must Step 9 happen after Step 2?", "why_question": "Why must Step 9 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 9 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 9 must happen after Step 8, not Step 2, as it involves setting aside the thickened liquid mixture.\"\n}\n```"}
{"plan_idx": 904, "title": "creamy-chayote-squash-soup", "question_idx": 904, "steps": ["Dissolve the stock in the hot water.", "Melt the butter in a large saucepan over medium heat.", "Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.", "Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.", "Stir in the stock and 1 tablespoon coriander;", "cover.", "Simmer about 20 minutes.", "Pour the mixture into a liquidiser and puree until smooth.", "Pour into bowls and garnish with a sprig of coriander to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why must Step 4 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: creamy-chayote-squash-soup\n\nProcedure:\n1. Dissolve the stock in the hot water.\n2. Melt the butter in a large saucepan over medium heat.\n3. Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.\n4. Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.\n5. Stir in the stock and 1 tablespoon coriander;\n6. cover.\n7. Simmer about 20 minutes.\n8. Pour the mixture into a liquidiser and puree until smooth.\n9. Pour into bowls and garnish with a sprig of coriander to serve.\n\n\n1. Must Step 4 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 requires the stock prepared in Step 1 to be added in Step 5.\"\n}\n```"}
{"plan_idx": 905, "title": "vegetable-terrine", "question_idx": 905, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why must Step 6 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 6 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The gelatin needs to be added to the cream mixture after the vegetables are cooked and set aside.\"\n}\n```"}
{"plan_idx": 906, "title": "chocolate-chocolate-cake", "question_idx": 906, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 7], "binary_question": "Must Step 8 happen after Step 3?", "why_question": "Why must Step 8 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 8 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 8 involves adding egg yolks to the mixture, which must be done after the chocolate mixture is prepared and cooled in Step 5 to ensure proper integration and texture.\"\n}\n```"}
{"plan_idx": 907, "title": "spicy-tomato-anchovy-pasta", "question_idx": 907, "steps": ["Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;", "cook until lightly browned.", "Add anchovies and water, cover and simmer for 4 to 5 minutes.", "Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.", "While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.", "Add linguine and cook until al dente, about 7 to 8 minutes;", "drain.", "Toss with anchovy mixture and chilli flakes.", "If desired, season with black pepper.", "Serve immediately."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why must Step 6 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spicy-tomato-anchovy-pasta\n\nProcedure:\n1. Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;\n2. cook until lightly browned.\n3. Add anchovies and water, cover and simmer for 4 to 5 minutes.\n4. Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.\n5. While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.\n6. Add linguine and cook until al dente, about 7 to 8 minutes;\n7. drain.\n8. Toss with anchovy mixture and chilli flakes.\n9. If desired, season with black pepper.\n10. Serve immediately.\n\n\n1. Must Step 6 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 involves cooking the linguine, which needs to be tossed with the anchovy mixture prepared in the earlier steps.\"\n}\n```"}
{"plan_idx": 908, "title": "brown sugar shortbread", "question_idx": 908, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why must Step 4 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\n1. Must Step 4 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 involves mixing ingredients that are prepared in Steps 2 and 3, which must occur after preheating the oven in Step 1.\"\n}\n```"}
{"plan_idx": 909, "title": "banana-split-cake", "question_idx": 909, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why must Step 2 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\n1. Must Step 2 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 involves preparing the crust which needs to be baked in the preheated oven from Step 1.\"\n}\n```"}
{"plan_idx": 910, "title": "fusilli-and-meatballs", "question_idx": 910, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 15], "binary_question": "Must Step 16 happen after Step 5?", "why_question": "Why must Step 16 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 16 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 16 involves draining the meatballs after cooking, which is independent of processing the tomatoes in Step 5.\"\n}\n```"}
{"plan_idx": 911, "title": "spanish-rabbit-stew", "question_idx": 911, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 6 happen after Step 3?", "why_question": "Why must Step 6 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 6 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 6 must happen after Step 4 because it involves ensuring the tarragon and bay leaf are submerged in the liquid.\"\n}\n```"}
{"plan_idx": 912, "title": "spiced-guava-cake", "question_idx": 912, "steps": ["Preheat oven to 180 C / Gas 4.", "Grease and flour one 23x13cm loaf tin.", "Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.", "In another bowl, mix together guava pulp and juice.", "In another bowl, cream together butter and sugar.", "Add eggs, one at a time.", "Add flour mixture and guava mixture alternately to creamed mixture.", "Pour batter into prepared tin.", "Bake at 180 C / Gas 4 for 30-35 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 4 happen after Step 2?", "why_question": "Why must Step 4 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-guava-cake\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Grease and flour one 23x13cm loaf tin.\n3. Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.\n4. In another bowl, mix together guava pulp and juice.\n5. In another bowl, cream together butter and sugar.\n6. Add eggs, one at a time.\n7. Add flour mixture and guava mixture alternately to creamed mixture.\n8. Pour batter into prepared tin.\n9. Bake at 180 C / Gas 4 for 30-35 minutes.\n\n\n1. Must Step 4 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 4 can happen at any time before Step 7 as it involves preparing an ingredient mixture that is combined later.\"\n}\n```"}
{"plan_idx": 913, "title": "spanish-rabbit-stew", "question_idx": 913, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 4 happen after Step 3?", "why_question": "Why must Step 4 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 4 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 4 can happen before Step 3 as mixing the ingredients can be done at any point after they are added to the slow cooker.\"\n}\n```"}
{"plan_idx": 914, "title": "spiced-guava-cake", "question_idx": 914, "steps": ["Preheat oven to 180 C / Gas 4.", "Grease and flour one 23x13cm loaf tin.", "Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.", "In another bowl, mix together guava pulp and juice.", "In another bowl, cream together butter and sugar.", "Add eggs, one at a time.", "Add flour mixture and guava mixture alternately to creamed mixture.", "Pour batter into prepared tin.", "Bake at 180 C / Gas 4 for 30-35 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 5 happen after Step 3?", "why_question": "Why must Step 5 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-guava-cake\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Grease and flour one 23x13cm loaf tin.\n3. Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.\n4. In another bowl, mix together guava pulp and juice.\n5. In another bowl, cream together butter and sugar.\n6. Add eggs, one at a time.\n7. Add flour mixture and guava mixture alternately to creamed mixture.\n8. Pour batter into prepared tin.\n9. Bake at 180 C / Gas 4 for 30-35 minutes.\n\n\n1. Must Step 5 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 5 does not depend on Step 3 and can be done independently.\"\n}\n```"}
{"plan_idx": 915, "title": "chicken and vegetable pie", "question_idx": 915, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 10], "binary_question": "Must Step 11 happen after Step 6?", "why_question": "Why must Step 11 happen after Step 6?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 11 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 must happen after Step 9, not necessarily after Step 6, as the chicken mixture needs to be placed in the pie dish after both the chicken mixture and the liquid mixture are prepared.\"\n}\n```"}
{"plan_idx": 916, "title": "almond and apple cake", "question_idx": 916, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 8], "binary_question": "Must Step 9 happen after Step 1?", "why_question": "Why must Step 9 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 9 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 9 involves mixing ingredients and is independent of preheating the oven in Step 1.\"\n}\n```"}
{"plan_idx": 917, "title": "spanish-rabbit-stew", "question_idx": 917, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why must Step 3 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 3 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 involves mixing the ingredients, which can only be done after they have been added to the slow cooker in Step 1.\"\n}\n```"}
{"plan_idx": 918, "title": "green-tofu-curry", "question_idx": 918, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 9], "binary_question": "Must Step 10 happen after Step 5?", "why_question": "Why must Step 10 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 10 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 involves preparing the curry sauce and is independent of heating the sesame oil in Step 5.\"\n}\n```"}
{"plan_idx": 919, "title": "very-vanilla-ry-cheesecake", "question_idx": 919, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 9], "binary_question": "Must Step 10 happen after Step 7?", "why_question": "Why must Step 10 happen after Step 7?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 10 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 can be done independently of Step 7 as it involves preparing the oven, not the cheesecake mixture.\"\n}\n```"}
{"plan_idx": 920, "title": "vegetable-terrine", "question_idx": 920, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 7 happen after Step 2?", "why_question": "Why must Step 7 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 7 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 involves mixing the cream, yogurt, sorrel, and gelatin, which is independent of cooking the vegetables in Step 2.\"\n}\n```"}
{"plan_idx": 921, "title": "chicken and vegetable pie", "question_idx": 921, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 12], "binary_question": "Must Step 13 happen after Step 1?", "why_question": "Why must Step 13 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 13 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 13 involves covering the pie with pastry and preparing it for baking, which must be done after preheating the oven in Step 1 to ensure the oven is ready when the pie is prepared.\"\n}\n```"}
{"plan_idx": 922, "title": "chicken and vegetable pie", "question_idx": 922, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 9], "binary_question": "Must Step 10 happen after Step 4?", "why_question": "Why must Step 10 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 10 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 can be done at any time before Step 11 as it involves preparing the pie dish and does not depend on the chicken mixture being ready.\"\n}\n```"}
{"plan_idx": 923, "title": "spiced-pumpkin-teabread", "question_idx": 923, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 6 happen after Step 3?", "why_question": "Why must Step 6 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 6 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 6 can be done independently of Step 3 as it involves preparing the dry ingredients, which does not depend on the pumpkin being cooked or mashed.\"\n}\n```"}
{"plan_idx": 924, "title": "chocolate-chocolate-cake", "question_idx": 924, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [9, 13], "binary_question": "Must Step 14 happen after Step 10?", "why_question": "Why must Step 14 happen after Step 10?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 14 happen after Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 14 can be done at any time before Step 16 as it involves preparing the cake tin, which does not depend on the mixture being ready.\"\n}\n```"}
{"plan_idx": 925, "title": "fusilli-and-meatballs", "question_idx": 925, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 14], "binary_question": "Must Step 15 happen after Step 7?", "why_question": "Why must Step 15 happen after Step 7?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 15 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 15 can happen independently of Step 7 as they involve different components (meatballs and sauce) being prepared separately.\"\n}\n```"}
{"plan_idx": 926, "title": "chicken-prawn-and-rice-soup", "question_idx": 926, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 10], "binary_question": "Must Step 11 happen after Step 1?", "why_question": "Why must Step 11 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 11 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 involves browning the rice, which can be done independently of mixing the prawns, chicken, egg, and cornflour in Step 1.\"\n}\n```"}
{"plan_idx": 927, "title": "spiced butternut squash soup", "question_idx": 927, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 10], "binary_question": "Must Step 11 happen after Step 6?", "why_question": "Why must Step 11 happen after Step 6?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 11 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 11 involves cooking the potatoes in the chicken stock, which is added in Step 9 after the squash is set aside in Step 6.\"\n}\n```"}
{"plan_idx": 928, "title": "fusilli-and-meatballs", "question_idx": 928, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 7 happen after Step 1?", "why_question": "Why must Step 7 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 7 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 involves bringing the tomato mixture to a boil in the saucepan, which must be prepared in Step 1.\"\n}\n```"}
{"plan_idx": 929, "title": "fusilli-and-meatballs", "question_idx": 929, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [9, 10], "binary_question": "Must Step 11 happen after Step 10?", "why_question": "Why must Step 11 happen after Step 10?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 11 happen after Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 is independent of Step 10 and can be done at any time before Step 12.\"\n}\n```"}
{"plan_idx": 930, "title": "green-tofu-curry", "question_idx": 930, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 7], "binary_question": "Must Step 8 happen after Step 2?", "why_question": "Why must Step 8 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 8 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 8 involves seasoning the tofu, which is prepared after the rice is boiled in Step 2.\"\n}\n```"}
{"plan_idx": 931, "title": "strawberry-tiramisu-trifle", "question_idx": 931, "steps": ["Set 3 strawberries for the garnish aside, and cut the rest into slices.", "In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.", "Then stir in the custard and finally fold in the whipped cream.", "Brush the sponge fingers with the remaining coffee.", "Line a glass bowl with one layer of the soaked sponge fingers.", "Spread half of the strawberries over the sponge fingers.", "Sprinkle half of the grated chocolate over that and then half of the custard mixture.", "Repeat the layers in order again.", "Cut the remaining 3 strawberries in half and lay them on top of the trifle.", "Cover and leave in the fridge for at least 4 hours, best overnight."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 4 happen after Step 3?", "why_question": "Why must Step 4 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberry-tiramisu-trifle\n\nProcedure:\n1. Set 3 strawberries for the garnish aside, and cut the rest into slices.\n2. In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.\n3. Then stir in the custard and finally fold in the whipped cream.\n4. Brush the sponge fingers with the remaining coffee.\n5. Line a glass bowl with one layer of the soaked sponge fingers.\n6. Spread half of the strawberries over the sponge fingers.\n7. Sprinkle half of the grated chocolate over that and then half of the custard mixture.\n8. Repeat the layers in order again.\n9. Cut the remaining 3 strawberries in half and lay them on top of the trifle.\n10. Cover and leave in the fridge for at least 4 hours, best overnight.\n\n\n1. Must Step 4 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen after Step 3 because the sponge fingers need to be brushed with the remaining coffee, which is only available after using 2 tablespoons in Step 2.\"\n}\n```"}
{"plan_idx": 932, "title": "strawberry-tiramisu-trifle", "question_idx": 932, "steps": ["Set 3 strawberries for the garnish aside, and cut the rest into slices.", "In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.", "Then stir in the custard and finally fold in the whipped cream.", "Brush the sponge fingers with the remaining coffee.", "Line a glass bowl with one layer of the soaked sponge fingers.", "Spread half of the strawberries over the sponge fingers.", "Sprinkle half of the grated chocolate over that and then half of the custard mixture.", "Repeat the layers in order again.", "Cut the remaining 3 strawberries in half and lay them on top of the trifle.", "Cover and leave in the fridge for at least 4 hours, best overnight."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why must Step 5 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberry-tiramisu-trifle\n\nProcedure:\n1. Set 3 strawberries for the garnish aside, and cut the rest into slices.\n2. In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.\n3. Then stir in the custard and finally fold in the whipped cream.\n4. Brush the sponge fingers with the remaining coffee.\n5. Line a glass bowl with one layer of the soaked sponge fingers.\n6. Spread half of the strawberries over the sponge fingers.\n7. Sprinkle half of the grated chocolate over that and then half of the custard mixture.\n8. Repeat the layers in order again.\n9. Cut the remaining 3 strawberries in half and lay them on top of the trifle.\n10. Cover and leave in the fridge for at least 4 hours, best overnight.\n\n\n1. Must Step 5 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 requires the sponge fingers to be brushed with coffee, which is prepared in Step 4, and Step 4 follows the preparation of the custard mixture in Step 3, which involves the strawberries sliced in Step 1.\"\n}\n```"}
{"plan_idx": 933, "title": "green-tofu-curry", "question_idx": 933, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 8], "binary_question": "Must Step 9 happen after Step 2?", "why_question": "Why must Step 9 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 9 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 9 can happen independently of Step 2 as they involve different components of the dish.\"\n}\n```"}
{"plan_idx": 934, "title": "chicken-prawn-and-rice-soup", "question_idx": 934, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 10], "binary_question": "Must Step 11 happen after Step 7?", "why_question": "Why must Step 11 happen after Step 7?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 11 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 can happen independently of Step 7 as it involves preparing the rice separately.\"\n}\n```"}
{"plan_idx": 935, "title": "fusilli-and-meatballs", "question_idx": 935, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 10], "binary_question": "Must Step 11 happen after Step 7?", "why_question": "Why must Step 11 happen after Step 7?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 11 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 can be done independently of Step 7 as it involves preparing bread crumbs, which does not depend on the sauce preparation.\"\n}\n```"}
{"plan_idx": 936, "title": "almond and apple cake", "question_idx": 936, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why must Step 5 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 5 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 5 involves adding eggs to the mixture and does not depend on preheating the oven.\"\n}\n```"}
{"plan_idx": 937, "title": "brown sugar shortbread", "question_idx": 937, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why must Step 6 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\n1. Must Step 6 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 involves kneading the dough, which requires the mixture prepared in the previous steps, including the preheated oven in Step 1.\"\n}\n```"}
{"plan_idx": 938, "title": "spiced butternut squash soup", "question_idx": 938, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 7 happen after Step 1?", "why_question": "Why must Step 7 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 7 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 can happen independently of Step 1 as it involves preparing ingredients on the stove, not in the oven.\"\n}\n```"}
{"plan_idx": 939, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 939, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 7 happen after Step 1?", "why_question": "Why must Step 7 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 7 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 involves shaping the dough, which is independent of the strawberry preparation in Step 1.\"\n}\n```"}
{"plan_idx": 940, "title": "chocolate-chocolate-cake", "question_idx": 940, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 9], "binary_question": "Must Step 10 happen after Step 1?", "why_question": "Why must Step 10 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 10 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 10 involves adding the cooled chocolate mixture, which requires the chocolate to be melted and cooled as per Steps 2-5, and the oven needs to be preheated as per Step 1 before baking.\"\n}\n```"}
{"plan_idx": 941, "title": "spanish-rabbit-stew", "question_idx": 941, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 4 happen after Step 2?", "why_question": "Why must Step 4 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 4 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 involves adding liquid ingredients which should be done after all solid ingredients are in the slow cooker as per Step 2.\"\n}\n```"}
{"plan_idx": 942, "title": "banana-split-cake", "question_idx": 942, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 6 happen after Step 3?", "why_question": "Why must Step 6 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\n1. Must Step 6 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 involves preparing the filling which needs to be spread over the cooled base from Step 5.\"\n}\n```"}
{"plan_idx": 943, "title": "chocolate-chocolate-cake", "question_idx": 943, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why must Step 5 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 5 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 5 does not depend on Step 1 and can be done independently.\"\n}\n```"}
{"plan_idx": 944, "title": "fusilli-and-meatballs", "question_idx": 944, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 10], "binary_question": "Must Step 11 happen after Step 4?", "why_question": "Why must Step 11 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 11 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 11 must happen after Step 4 because the bread crumbs are added to the onion mixture that was set aside in Step 4.\"\n}\n```"}
{"plan_idx": 945, "title": "spiced-guava-cake", "question_idx": 945, "steps": ["Preheat oven to 180 C / Gas 4.", "Grease and flour one 23x13cm loaf tin.", "Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.", "In another bowl, mix together guava pulp and juice.", "In another bowl, cream together butter and sugar.", "Add eggs, one at a time.", "Add flour mixture and guava mixture alternately to creamed mixture.", "Pour batter into prepared tin.", "Bake at 180 C / Gas 4 for 30-35 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 3 happen after Step 2?", "why_question": "Why must Step 3 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-guava-cake\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Grease and flour one 23x13cm loaf tin.\n3. Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.\n4. In another bowl, mix together guava pulp and juice.\n5. In another bowl, cream together butter and sugar.\n6. Add eggs, one at a time.\n7. Add flour mixture and guava mixture alternately to creamed mixture.\n8. Pour batter into prepared tin.\n9. Bake at 180 C / Gas 4 for 30-35 minutes.\n\n\n1. Must Step 3 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen after Step 2 because the tin needs to be prepared before the batter is ready to be poured into it.\"\n}\n```"}
{"plan_idx": 946, "title": "chocolate-chocolate-cake", "question_idx": 946, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 18], "binary_question": "Must Step 19 happen after Step 1?", "why_question": "Why must Step 19 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 19 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 19 is an observation about the cake's baking process and does not need to follow Step 1.\"\n}\n```"}
{"plan_idx": 947, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 947, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 10], "binary_question": "Must Step 11 happen after Step 6?", "why_question": "Why must Step 11 happen after Step 6?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 11 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 can be done at any time before the assembly in Step 14.\"\n}\n```"}
{"plan_idx": 948, "title": "spiced-pumpkin-teabread", "question_idx": 948, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 9], "binary_question": "Must Step 10 happen after Step 1?", "why_question": "Why must Step 10 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 10 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 10 involves sprinkling pumpkin seeds on the mixture, which can only be done after the mixture has been prepared and placed in the tin as described in the preceding steps.\"\n}\n```"}
{"plan_idx": 949, "title": "fusilli-and-meatballs", "question_idx": 949, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 18], "binary_question": "Must Step 19 happen after Step 3?", "why_question": "Why must Step 19 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 19 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 19 can happen at any time before serving, as it involves cooking the pasta separately from the other steps.\"\n}\n```"}
{"plan_idx": 950, "title": "fusilli-and-meatballs", "question_idx": 950, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 13], "binary_question": "Must Step 14 happen after Step 7?", "why_question": "Why must Step 14 happen after Step 7?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 14 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 14 can happen independently of Step 7 as it involves cooking the meatballs separately from the sauce preparation.\"\n}\n```"}
{"plan_idx": 951, "title": "chicken-prawn-and-rice-soup", "question_idx": 951, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 10], "binary_question": "Must Step 11 happen after Step 6?", "why_question": "Why must Step 11 happen after Step 6?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 11 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 can happen independently of Step 6 as it involves preparing the rice separately before adding it to the soup.\"\n}\n```"}
{"plan_idx": 952, "title": "vegetable-terrine", "question_idx": 952, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 5 happen after Step 4?", "why_question": "Why must Step 5 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 5 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 must happen after Step 4 because the chopped sorrel from Step 4 is added to the cream and yogurt mixture in Step 6.\"\n}\n```"}
{"plan_idx": 953, "title": "fusilli-and-meatballs", "question_idx": 953, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [8, 13], "binary_question": "Must Step 14 happen after Step 9?", "why_question": "Why must Step 14 happen after Step 9?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 14 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 14 can happen independently of Step 9 as it involves cooking the meatballs separately from the sauce.\"\n}\n```"}
{"plan_idx": 954, "title": "spiced-guava-cake", "question_idx": 954, "steps": ["Preheat oven to 180 C / Gas 4.", "Grease and flour one 23x13cm loaf tin.", "Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.", "In another bowl, mix together guava pulp and juice.", "In another bowl, cream together butter and sugar.", "Add eggs, one at a time.", "Add flour mixture and guava mixture alternately to creamed mixture.", "Pour batter into prepared tin.", "Bake at 180 C / Gas 4 for 30-35 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 7], "binary_question": "Must Step 8 happen after Step 1?", "why_question": "Why must Step 8 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-guava-cake\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Grease and flour one 23x13cm loaf tin.\n3. Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.\n4. In another bowl, mix together guava pulp and juice.\n5. In another bowl, cream together butter and sugar.\n6. Add eggs, one at a time.\n7. Add flour mixture and guava mixture alternately to creamed mixture.\n8. Pour batter into prepared tin.\n9. Bake at 180 C / Gas 4 for 30-35 minutes.\n\n\n1. Must Step 8 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 8 must happen after Step 1 because the oven needs to be preheated before baking the batter.\"\n}\n```"}
{"plan_idx": 955, "title": "halloumi-and-figs", "question_idx": 955, "steps": ["Preheat a grill for high heat.", "Break up the halloumi cheese, and toss with the fresh figs and walnuts in a small dish.", "Grill under the preheated grill until the halloumi is browned and the figs begin to caramelise, about 3 minutes.", "Drizzle with the honey."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why must Step 2 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: halloumi-and-figs\n\nProcedure:\n1. Preheat a grill for high heat.\n2. Break up the halloumi cheese, and toss with the fresh figs and walnuts in a small dish.\n3. Grill under the preheated grill until the halloumi is browned and the figs begin to caramelise, about 3 minutes.\n4. Drizzle with the honey.\n\n\n1. Must Step 2 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen after Step 1 to ensure the grill is preheated and ready for grilling the ingredients.\"\n}\n```"}
{"plan_idx": 956, "title": "chocolate-chocolate-cake", "question_idx": 956, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 13], "binary_question": "Must Step 14 happen after Step 3?", "why_question": "Why must Step 14 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 14 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 14 involves preparing the cake tin and does not depend on the chocolate melting process in Step 3.\"\n}\n```"}
{"plan_idx": 957, "title": "spanish-rabbit-stew", "question_idx": 957, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 8], "binary_question": "Must Step 9 happen after Step 2?", "why_question": "Why must Step 9 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 9 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 9 involves seasoning the stew, which should be done after all ingredients are combined and cooked for proper flavor integration.\"\n}\n```"}
{"plan_idx": 958, "title": "lightly spiced tomato and red lentil soup", "question_idx": 958, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 7 happen after Step 1?", "why_question": "Why must Step 7 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 7 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 can be done at any time while the soup is simmering, as it involves preparing the garnish and does not affect the cooking process.\"\n}\n```"}
{"plan_idx": 959, "title": "chocolate-chocolate-cake", "question_idx": 959, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 13], "binary_question": "Must Step 14 happen after Step 2?", "why_question": "Why must Step 14 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 14 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 14 can be done at any time before Step 16 as it involves preparing the cake tin, not the batter.\"\n}\n```"}
{"plan_idx": 960, "title": "feta-and-sundried-tomato-spinach-rolls", "question_idx": 960, "steps": ["Preheat grill.", "Mix together cream cheese, feta, sundried tomatoes, basil and garlic.", "Stir until creamy, with no lumps.", "Blanch the spinach leaves.", "Wrap a dollop of cheese mix in each spinach leaf.", "Brush with olive oil.", "Sprinkle almonds on the top or alternately roll them in the almonds", "Grill spinach rolls until slightly crispy on top.", "Let cool for 10 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why must Step 3 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: feta-and-sundried-tomato-spinach-rolls\n\nProcedure:\n1. Preheat grill.\n2. Mix together cream cheese, feta, sundried tomatoes, basil and garlic.\n3. Stir until creamy, with no lumps.\n4. Blanch the spinach leaves.\n5. Wrap a dollop of cheese mix in each spinach leaf.\n6. Brush with olive oil.\n7. Sprinkle almonds on the top or alternately roll them in the almonds\n8. Grill spinach rolls until slightly crispy on top.\n9. Let cool for 10 minutes.\n\n\n1. Must Step 3 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 3 does not depend on the grill being preheated, so it can happen independently of Step 1.\"\n}\n```"}
{"plan_idx": 961, "title": "sardine spread", "question_idx": 961, "steps": ["Place the sardines in a bowl and roughly mash with a fork.", "Add in all of the remaining ingredients and stir well.", "Enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why must Step 3 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: sardine spread\n\nProcedure:\n1. Place the sardines in a bowl and roughly mash with a fork.\n2. Add in all of the remaining ingredients and stir well.\n3. Enjoy!\n\n\n1. Must Step 3 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 involves enjoying the spread, which can only happen after the sardines are mashed and the ingredients are mixed.\"\n}\n```"}
{"plan_idx": 962, "title": "chicken and vegetable pie", "question_idx": 962, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why must Step 4 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 4 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 4 must happen after Step 3, not necessarily after Step 1.\"\n}\n```"}
{"plan_idx": 963, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 963, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [9, 11], "binary_question": "Must Step 12 happen after Step 10?", "why_question": "Why must Step 12 happen after Step 10?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 12 happen after Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 12 can be done independently of Step 10 as it involves preparing the whipped cream, which does not depend on the cooling of the shortcakes.\"\n}\n```"}
{"plan_idx": 964, "title": "very-vanilla-ry-cheesecake", "question_idx": 964, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 7 happen after Step 2?", "why_question": "Why must Step 7 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 7 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 involves preparing the filling, while Step 2 involves preparing the crust, and these can be done independently.\"\n}\n```"}
{"plan_idx": 965, "title": "chocolate-chocolate-cake", "question_idx": 965, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 14], "binary_question": "Must Step 15 happen after Step 6?", "why_question": "Why must Step 15 happen after Step 6?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 15 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 15 involves preparing the cake tin and can be done independently of mixing the ingredients in Step 6.\"\n}\n```"}
{"plan_idx": 966, "title": "brown sugar shortbread", "question_idx": 966, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 5 happen after Step 2?", "why_question": "Why must Step 5 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\n1. Must Step 5 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 must happen after Step 2 because the dough needs to be prepared before it can be kneaded on the floured board.\"\n}\n```"}
{"plan_idx": 967, "title": "spiced butternut squash soup", "question_idx": 967, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 7], "binary_question": "Must Step 8 happen after Step 3?", "why_question": "Why must Step 8 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 8 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 8 involves saut\u00e9ing ingredients in a pot, which should be done after the squash is baked and set aside in Step 6.\"\n}\n```"}
{"plan_idx": 968, "title": "spiced-guava-cake", "question_idx": 968, "steps": ["Preheat oven to 180 C / Gas 4.", "Grease and flour one 23x13cm loaf tin.", "Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.", "In another bowl, mix together guava pulp and juice.", "In another bowl, cream together butter and sugar.", "Add eggs, one at a time.", "Add flour mixture and guava mixture alternately to creamed mixture.", "Pour batter into prepared tin.", "Bake at 180 C / Gas 4 for 30-35 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 7 happen after Step 2?", "why_question": "Why must Step 7 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-guava-cake\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Grease and flour one 23x13cm loaf tin.\n3. Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.\n4. In another bowl, mix together guava pulp and juice.\n5. In another bowl, cream together butter and sugar.\n6. Add eggs, one at a time.\n7. Add flour mixture and guava mixture alternately to creamed mixture.\n8. Pour batter into prepared tin.\n9. Bake at 180 C / Gas 4 for 30-35 minutes.\n\n\n1. Must Step 7 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 involves adding mixtures to the creamed mixture, which needs to be poured into the prepared tin from Step 2.\"\n}\n```"}
{"plan_idx": 969, "title": "balsamic-and-mozzarella-chicken", "question_idx": 969, "steps": ["Place chicken in a shallow dish or large resealable plastic bag.", "Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.", "Coat a large frying pan lightly with oil, and set over low heat.", "Remove the chicken from the marinade and discard the marinade.", "Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.", "Arrange chicken on a serving platter.", "Place a generous slice of fresh mozzarella on top of each piece.", "Place a leaf of basil on top of the cheese, and cover with a slice of tomato.", "Drizzle balsamic vinegar over the platter, then season with salt and pepper.", "Serve!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 4 happen after Step 3?", "why_question": "Why must Step 4 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: balsamic-and-mozzarella-chicken\n\nProcedure:\n1. Place chicken in a shallow dish or large resealable plastic bag.\n2. Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.\n3. Coat a large frying pan lightly with oil, and set over low heat.\n4. Remove the chicken from the marinade and discard the marinade.\n5. Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.\n6. Arrange chicken on a serving platter.\n7. Place a generous slice of fresh mozzarella on top of each piece.\n8. Place a leaf of basil on top of the cheese, and cover with a slice of tomato.\n9. Drizzle balsamic vinegar over the platter, then season with salt and pepper.\n10. Serve!\n\n\n1. Must Step 4 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen after Step 3 because the chicken needs to be removed from the marinade and the marinade discarded before cooking in the preheated pan.\"\n}\n```"}
{"plan_idx": 970, "title": "cranachan", "question_idx": 970, "steps": ["Preheat the oven to 180 C / Gas mark 4.", "Spread oats out in a thin layer on a baking tray.", "Toast in the oven for about 10 minutes, or until lightly browned.", "Set aside to cool.", "Remove them from the tray for faster cooling.", "In a medium bowl, whip the cream to firm peaks.", "Gently fold in the icing sugar, vanilla and toasted oats.", "Spoon into 4 serving bowls, and top with fresh berries.", "For an extra touch, drizzle some whisky over each serving.", "Garnish with a mint leaf."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why must Step 6 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cranachan\n\nProcedure:\n1. Preheat the oven to 180 C / Gas mark 4.\n2. Spread oats out in a thin layer on a baking tray.\n3. Toast in the oven for about 10 minutes, or until lightly browned.\n4. Set aside to cool.\n5. Remove them from the tray for faster cooling.\n6. In a medium bowl, whip the cream to firm peaks.\n7. Gently fold in the icing sugar, vanilla and toasted oats.\n8. Spoon into 4 serving bowls, and top with fresh berries.\n9. For an extra touch, drizzle some whisky over each serving.\n10. Garnish with a mint leaf.\n\n\n1. Must Step 6 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 6 does not depend on Step 2 and can be done independently.\"\n}\n```"}
{"plan_idx": 971, "title": "chocolate-chocolate-cake", "question_idx": 971, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 10], "binary_question": "Must Step 11 happen after Step 7?", "why_question": "Why must Step 11 happen after Step 7?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 11 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 can happen independently of Step 7 as it involves beating egg whites in a separate bowl.\"\n}\n```"}
{"plan_idx": 972, "title": "fusilli-and-meatballs", "question_idx": 972, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 6], "binary_question": "Must Step 7 happen after Step 4?", "why_question": "Why must Step 7 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 7 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 involves bringing the tomato mixture to a boil, which requires the tomatoes to be added to the saucepan in Step 6, and Step 6 follows Step 4.\"\n}\n```"}
{"plan_idx": 973, "title": "fusilli-and-meatballs", "question_idx": 973, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 12], "binary_question": "Must Step 13 happen after Step 7?", "why_question": "Why must Step 13 happen after Step 7?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 13 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 13 can be done independently of Step 7 as shaping the meatballs does not depend on the sauce reaching a boil.\"\n}\n```"}
{"plan_idx": 974, "title": "cloud-bread", "question_idx": 974, "steps": ["Preheat oven to 150 C / Gas mark 2.", "Line a baking tray with baking paper.", "Mix cream cheese and egg yolks together until smooth.", "Place egg whites and baking powder in a glass, metal, or ceramic bowl;", "beat together until stiff peaks form.", "Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.", "Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.", "Bake in the preheated oven until golden brown, 17 to 20 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 7 happen after Step 1?", "why_question": "Why must Step 7 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cloud-bread\n\nProcedure:\n1. Preheat oven to 150 C / Gas mark 2.\n2. Line a baking tray with baking paper.\n3. Mix cream cheese and egg yolks together until smooth.\n4. Place egg whites and baking powder in a glass, metal, or ceramic bowl;\n5. beat together until stiff peaks form.\n6. Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.\n7. Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.\n8. Bake in the preheated oven until golden brown, 17 to 20 minutes.\n\n\n1. Must Step 7 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 involves placing the batter on a baking tray, which needs to be baked immediately in the preheated oven from Step 1.\"\n}\n```"}
{"plan_idx": 975, "title": "green-tofu-curry", "question_idx": 975, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 10], "binary_question": "Must Step 11 happen after Step 3?", "why_question": "Why must Step 11 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 11 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 involves preparing the curry sauce and is independent of cooking the rice.\"\n}\n```"}
{"plan_idx": 976, "title": "almond and apple cake", "question_idx": 976, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 4 happen after Step 3?", "why_question": "Why must Step 4 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 4 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 involves preparing the batter, which should be done after the cake tin is prepared in Step 3 to ensure the batter can be immediately transferred to the tin.\"\n}\n```"}
{"plan_idx": 977, "title": "chicken and vegetable pie", "question_idx": 977, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 11], "binary_question": "Must Step 12 happen after Step 1?", "why_question": "Why must Step 12 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 12 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 12 does not depend on Step 1 and can be done independently of preheating the oven.\"\n}\n```"}
{"plan_idx": 978, "title": "spiced-guava-cake", "question_idx": 978, "steps": ["Preheat oven to 180 C / Gas 4.", "Grease and flour one 23x13cm loaf tin.", "Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.", "In another bowl, mix together guava pulp and juice.", "In another bowl, cream together butter and sugar.", "Add eggs, one at a time.", "Add flour mixture and guava mixture alternately to creamed mixture.", "Pour batter into prepared tin.", "Bake at 180 C / Gas 4 for 30-35 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 4 happen after Step 3?", "why_question": "Why must Step 4 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-guava-cake\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Grease and flour one 23x13cm loaf tin.\n3. Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.\n4. In another bowl, mix together guava pulp and juice.\n5. In another bowl, cream together butter and sugar.\n6. Add eggs, one at a time.\n7. Add flour mixture and guava mixture alternately to creamed mixture.\n8. Pour batter into prepared tin.\n9. Bake at 180 C / Gas 4 for 30-35 minutes.\n\n\n1. Must Step 4 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 4 does not depend on Step 3 and can be done independently.\"\n}\n```"}
{"plan_idx": 979, "title": "spanish-rabbit-stew", "question_idx": 979, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 5 happen after Step 2?", "why_question": "Why must Step 5 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 5 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 involves adjusting the liquid levels after adding the wine and water in Step 4.\"\n}\n```"}
{"plan_idx": 980, "title": "green-tofu-curry", "question_idx": 980, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why must Step 6 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 6 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 6 involves preparing the tofu, which can be done independently of starting the rice in Step 1.\"\n}\n```"}
{"plan_idx": 981, "title": "chocolate-chocolate-cake", "question_idx": 981, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [12, 18], "binary_question": "Must Step 19 happen after Step 13?", "why_question": "Why must Step 19 happen after Step 13?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 19 happen after Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 19 is an observation about the cake's baking process and does not depend on Step 13.\"\n}\n```"}
{"plan_idx": 982, "title": "spiced butternut squash soup", "question_idx": 982, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 10], "binary_question": "Must Step 11 happen after Step 3?", "why_question": "Why must Step 11 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 11 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 involves cooking the potatoes in the pot, which is independent of baking the squash in Step 3.\"\n}\n```"}
{"plan_idx": 983, "title": "tangy-gammon-in-cider", "question_idx": 983, "steps": ["Preheat the oven to 200 degrees /gas mark 6.", "Start by piercing each tomato once and covering with boiling water to loosen the skins.", "Drain the onions and chop each one in half.", "Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.", "Put the onions, tomatoes and apples into a casserole dish.", "Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.", "Place in the dish and repeat with the other gammon steaks.", "Pour cider over the steaks, cover the top with a lid or tin foil.", "Cook for 1 hour."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why must Step 4 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tangy-gammon-in-cider\n\nProcedure:\n1. Preheat the oven to 200 degrees /gas mark 6.\n2. Start by piercing each tomato once and covering with boiling water to loosen the skins.\n3. Drain the onions and chop each one in half.\n4. Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.\n5. Put the onions, tomatoes and apples into a casserole dish.\n6. Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.\n7. Place in the dish and repeat with the other gammon steaks.\n8. Pour cider over the steaks, cover the top with a lid or tin foil.\n9. Cook for 1 hour.\n\n\n1. Must Step 4 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 involves draining and removing the skins of the tomatoes, which requires them to have been in boiling water for 5 minutes as stated in Step 2.\"\n}\n```"}
{"plan_idx": 984, "title": "green-tofu-curry", "question_idx": 984, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 7], "binary_question": "Must Step 8 happen after Step 1?", "why_question": "Why must Step 8 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 8 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 8 must happen after Step 7, not necessarily after Step 1.\"\n}\n```"}
{"plan_idx": 985, "title": "busters-liver-dinner", "question_idx": 985, "steps": ["Put all ingredients into a slow cooker, mix together.", "Put slow cooker on high for 4 to 5 hours or low all day.", "( If mixture starts to look too dry just add a little hot water.", ")", "Once cooked, divide between several plastic microwaveable tubs with lids.", "This mixture usually makes 6 to 7 meals, I freeze 4 and put the rest in the fridge.", "When ready to eat microwave with lid half off for 2 to 3 minutes on medium high."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 5 happen after Step 4?", "why_question": "Why must Step 5 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: busters-liver-dinner\n\nProcedure:\n1. Put all ingredients into a slow cooker, mix together.\n2. Put slow cooker on high for 4 to 5 hours or low all day.\n3. ( If mixture starts to look too dry just add a little hot water.\n4. )\n5. Once cooked, divide between several plastic microwaveable tubs with lids.\n6. This mixture usually makes 6 to 7 meals, I freeze 4 and put the rest in the fridge.\n7. When ready to eat microwave with lid half off for 2 to 3 minutes on medium high.\n\n\n1. Must Step 5 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 involves dividing the cooked mixture, which can only be done after the cooking process in Step 4 is complete.\"\n}\n```"}
{"plan_idx": 986, "title": "warm-puy-lentil-and-tomato-salad", "question_idx": 986, "steps": ["Bring a large pan of water to the boil;", "add lentils and cook over low heat for 30 minutes.", "Put tomatoes in a small bowl and season with salt.", "Set aside for 15 minutes.", "Drain lentils and tomatoes and mix together.", "Distribute mixture evenly in 6 individual bowls or ramekins, sprinkle with chopped parsley and serve warm or chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 3 happen after Step 2?", "why_question": "Why must Step 3 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: warm-puy-lentil-and-tomato-salad\n\nProcedure:\n1. Bring a large pan of water to the boil;\n2. add lentils and cook over low heat for 30 minutes.\n3. Put tomatoes in a small bowl and season with salt.\n4. Set aside for 15 minutes.\n5. Drain lentils and tomatoes and mix together.\n6. Distribute mixture evenly in 6 individual bowls or ramekins, sprinkle with chopped parsley and serve warm or chilled.\n\n\n1. Must Step 3 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 3 can happen independently of Step 2 as it involves seasoning the tomatoes, which can be done while the lentils are cooking.\"\n}\n```"}
{"plan_idx": 987, "title": "spiced-pumpkin-teabread", "question_idx": 987, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 7 happen after Step 3?", "why_question": "Why must Step 7 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 7 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 involves preparing the dry ingredients and can be done independently of cooking the pumpkin in Step 3.\"\n}\n```"}
{"plan_idx": 988, "title": "cloud-bread", "question_idx": 988, "steps": ["Preheat oven to 150 C / Gas mark 2.", "Line a baking tray with baking paper.", "Mix cream cheese and egg yolks together until smooth.", "Place egg whites and baking powder in a glass, metal, or ceramic bowl;", "beat together until stiff peaks form.", "Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.", "Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.", "Bake in the preheated oven until golden brown, 17 to 20 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why must Step 4 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cloud-bread\n\nProcedure:\n1. Preheat oven to 150 C / Gas mark 2.\n2. Line a baking tray with baking paper.\n3. Mix cream cheese and egg yolks together until smooth.\n4. Place egg whites and baking powder in a glass, metal, or ceramic bowl;\n5. beat together until stiff peaks form.\n6. Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.\n7. Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.\n8. Bake in the preheated oven until golden brown, 17 to 20 minutes.\n\n\n1. Must Step 4 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 4 does not depend on Step 1 and can be done independently.\"\n}\n```"}
{"plan_idx": 989, "title": "chicken-prawn-and-rice-soup", "question_idx": 989, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 9], "binary_question": "Must Step 10 happen after Step 8?", "why_question": "Why must Step 10 happen after Step 8?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 10 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 can happen independently of Step 8 as it involves heating oil for the rice, which can be done while the soup is boiling or simmering.\"\n}\n```"}
{"plan_idx": 990, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 990, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [9, 12], "binary_question": "Must Step 13 happen after Step 10?", "why_question": "Why must Step 13 happen after Step 10?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 13 happen after Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 13 can happen independently of Step 10 as it involves preparing the whipped cream, which does not depend on the cooling of the shortcakes.\"\n}\n```"}
{"plan_idx": 991, "title": "chocolate-chocolate-cake", "question_idx": 991, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [13, 18], "binary_question": "Must Step 19 happen after Step 14?", "why_question": "Why must Step 19 happen after Step 14?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 19 happen after Step 14?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 19 is an observation about the cake's baking process and does not need to follow Step 14.\"\n}\n```"}
{"plan_idx": 992, "title": "almost no fat banana bread", "question_idx": 992, "steps": ["Preheat oven to 180 C / Gas mark 4.", "Lightly grease a 20x10cm (8x4 in) loaf tin.", "In a large bowl, stir together flour, sugar, baking powder, bicarbonate of soda and cinnamon.", "Add egg whites, bananas and apple pur\u00c3\u00a9e; stir just until combined.", "Pour batter into prepared tin.", "Bake in preheated oven for 50 to 55 minutes, until a skewer inserted into centre of loaf comes out clean.", "Turn out onto wire rack and allow to cool before slicing."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 3 happen after Step 2?", "why_question": "Why must Step 3 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almost no fat banana bread\n\nProcedure:\n1. Preheat oven to 180 C / Gas mark 4.\n2. Lightly grease a 20x10cm (8x4 in) loaf tin.\n3. In a large bowl, stir together flour, sugar, baking powder, bicarbonate of soda and cinnamon.\n4. Add egg whites, bananas and apple pur\u00c3\u00a9e; stir just until combined.\n5. Pour batter into prepared tin.\n6. Bake in preheated oven for 50 to 55 minutes, until a skewer inserted into centre of loaf comes out clean.\n7. Turn out onto wire rack and allow to cool before slicing.\n\n\n1. Must Step 3 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 3 can happen independently of Step 2 as they do not depend on each other.\"\n}\n```"}
{"plan_idx": 993, "title": "fusilli-and-meatballs", "question_idx": 993, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 7], "binary_question": "Must Step 8 happen after Step 1?", "why_question": "Why must Step 8 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 8 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 8 must happen after Step 7, not necessarily after Step 1.\"\n}\n```"}
{"plan_idx": 994, "title": "vegetable-terrine", "question_idx": 994, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 7], "binary_question": "Must Step 8 happen after Step 2?", "why_question": "Why must Step 8 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 8 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 8 does not depend on Step 2 and can happen independently.\"\n}\n```"}
{"plan_idx": 995, "title": "almost no fat banana bread", "question_idx": 995, "steps": ["Preheat oven to 180 C / Gas mark 4.", "Lightly grease a 20x10cm (8x4 in) loaf tin.", "In a large bowl, stir together flour, sugar, baking powder, bicarbonate of soda and cinnamon.", "Add egg whites, bananas and apple pur\u00c3\u00a9e; stir just until combined.", "Pour batter into prepared tin.", "Bake in preheated oven for 50 to 55 minutes, until a skewer inserted into centre of loaf comes out clean.", "Turn out onto wire rack and allow to cool before slicing."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why must Step 5 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almost no fat banana bread\n\nProcedure:\n1. Preheat oven to 180 C / Gas mark 4.\n2. Lightly grease a 20x10cm (8x4 in) loaf tin.\n3. In a large bowl, stir together flour, sugar, baking powder, bicarbonate of soda and cinnamon.\n4. Add egg whites, bananas and apple pur\u00c3\u00a9e; stir just until combined.\n5. Pour batter into prepared tin.\n6. Bake in preheated oven for 50 to 55 minutes, until a skewer inserted into centre of loaf comes out clean.\n7. Turn out onto wire rack and allow to cool before slicing.\n\n\n1. Must Step 5 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The batter needs to be poured into a preheated oven to ensure proper baking.\"\n}\n```"}
{"plan_idx": 996, "title": "very-vanilla-ry-cheesecake", "question_idx": 996, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 7], "binary_question": "Must Step 8 happen after Step 4?", "why_question": "Why must Step 8 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 8 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 8 involves preparing the cheesecake filling, which must be poured into the biscuit base prepared in Steps 4 and 5.\"\n}\n```"}
{"plan_idx": 997, "title": "chocolate-chocolate-cake", "question_idx": 997, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [11, 13], "binary_question": "Must Step 14 happen after Step 12?", "why_question": "Why must Step 14 happen after Step 12?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 14 happen after Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 14 must happen after Step 12 because the egg whites need to be folded into the chocolate mixture before it is poured into the greased tin.\"\n}\n```"}
{"plan_idx": 998, "title": "almond and apple cake", "question_idx": 998, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 7], "binary_question": "Must Step 8 happen after Step 2?", "why_question": "Why must Step 8 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 8 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 8 involves mixing ingredients and does not depend on greasing the cake tin in Step 2.\"\n}\n```"}
{"plan_idx": 999, "title": "spanish-rabbit-stew", "question_idx": 999, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 8], "binary_question": "Must Step 9 happen after Step 5?", "why_question": "Why must Step 9 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 9 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 9 can happen at any point after the ingredients are mixed and before serving.\"\n}\n```"}
{"plan_idx": 1000, "title": "chicken and vegetable pie", "question_idx": 1000, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 9], "binary_question": "Must Step 10 happen after Step 5?", "why_question": "Why must Step 10 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 10 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 can be done at any time before Step 11 as it involves preparing the pie dish, which does not depend on cooking the onion in butter.\"\n}\n```"}
{"plan_idx": 1001, "title": "tortellini-fritto-with-almond-butter", "question_idx": 1001, "steps": ["Bring a saucepan of water to the boil.", "Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.", "In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.", "If you slightly undercooked your tortellini then it's less likely to stick to the pan.", "Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.", "Continue to gently fry and stir the tortellini until golden brown.", "Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.", "Enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 4 happen after Step 3?", "why_question": "Why must Step 4 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tortellini-fritto-with-almond-butter\n\nProcedure:\n1. Bring a saucepan of water to the boil.\n2. Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.\n3. In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.\n4. If you slightly undercooked your tortellini then it's less likely to stick to the pan.\n5. Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.\n6. Continue to gently fry and stir the tortellini until golden brown.\n7. Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.\n8. Enjoy!\n\n\n1. Must Step 4 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 provides a tip relevant to the process described in Step 3.\"\n}\n```"}
{"plan_idx": 1002, "title": "spicy-tomato-anchovy-pasta", "question_idx": 1002, "steps": ["Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;", "cook until lightly browned.", "Add anchovies and water, cover and simmer for 4 to 5 minutes.", "Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.", "While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.", "Add linguine and cook until al dente, about 7 to 8 minutes;", "drain.", "Toss with anchovy mixture and chilli flakes.", "If desired, season with black pepper.", "Serve immediately."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 6], "binary_question": "Must Step 7 happen after Step 4?", "why_question": "Why must Step 7 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spicy-tomato-anchovy-pasta\n\nProcedure:\n1. Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;\n2. cook until lightly browned.\n3. Add anchovies and water, cover and simmer for 4 to 5 minutes.\n4. Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.\n5. While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.\n6. Add linguine and cook until al dente, about 7 to 8 minutes;\n7. drain.\n8. Toss with anchovy mixture and chilli flakes.\n9. If desired, season with black pepper.\n10. Serve immediately.\n\n\n1. Must Step 7 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 can happen after Step 6, which is independent of Step 4.\"\n}\n```"}
{"plan_idx": 1003, "title": "spiced-guava-cake", "question_idx": 1003, "steps": ["Preheat oven to 180 C / Gas 4.", "Grease and flour one 23x13cm loaf tin.", "Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.", "In another bowl, mix together guava pulp and juice.", "In another bowl, cream together butter and sugar.", "Add eggs, one at a time.", "Add flour mixture and guava mixture alternately to creamed mixture.", "Pour batter into prepared tin.", "Bake at 180 C / Gas 4 for 30-35 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why must Step 6 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-guava-cake\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Grease and flour one 23x13cm loaf tin.\n3. Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.\n4. In another bowl, mix together guava pulp and juice.\n5. In another bowl, cream together butter and sugar.\n6. Add eggs, one at a time.\n7. Add flour mixture and guava mixture alternately to creamed mixture.\n8. Pour batter into prepared tin.\n9. Bake at 180 C / Gas 4 for 30-35 minutes.\n\n\n1. Must Step 6 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 6 does not depend on Step 2 and can be done independently.\"\n}\n```"}
{"plan_idx": 1004, "title": "spanish-rabbit-stew", "question_idx": 1004, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 7 happen after Step 6?", "why_question": "Why must Step 7 happen after Step 6?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 7 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 involves turning on the slow cooker, which should only be done after ensuring the tarragon and bay leaf are properly submerged in Step 6.\"\n}\n```"}
{"plan_idx": 1005, "title": "fusilli-and-meatballs", "question_idx": 1005, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 11], "binary_question": "Must Step 12 happen after Step 6?", "why_question": "Why must Step 12 happen after Step 6?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 12 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 12 involves preparing the meatball mixture and is independent of adding the tomatoes to the saucepan in Step 6.\"\n}\n```"}
{"plan_idx": 1006, "title": "almond and apple cake", "question_idx": 1006, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 8], "binary_question": "Must Step 9 happen after Step 3?", "why_question": "Why must Step 9 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 9 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 9 involves adding ingredients to the mixture, which must be done after preparing the cake tin in Step 3 to ensure the mixture is ready to be poured into the tin.\"\n}\n```"}
{"plan_idx": 1007, "title": "chocolate-chocolate-cake", "question_idx": 1007, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 18], "binary_question": "Must Step 19 happen after Step 5?", "why_question": "Why must Step 19 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 19 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 19 is an observation about the cake's baking process and does not depend on the cooling of the chocolate mixture in Step 5.\"\n}\n```"}
{"plan_idx": 1008, "title": "very-vanilla-ry-cheesecake", "question_idx": 1008, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [8, 9], "binary_question": "Must Step 10 happen after Step 9?", "why_question": "Why must Step 10 happen after Step 9?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 10 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 10 must happen after Step 9 because the boiling water in the baking dish creates a humid environment that helps the cheesecake bake evenly and prevents cracking, which is necessary once the cheesecake mixture is already in the oven.\"\n}\n```"}
{"plan_idx": 1009, "title": "chicken-prawn-and-rice-soup", "question_idx": 1009, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 10], "binary_question": "Must Step 11 happen after Step 8?", "why_question": "Why must Step 11 happen after Step 8?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 11 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 can happen after Step 9 as the soup is already simmering and the rice can be prepared in parallel.\"\n}\n```"}
{"plan_idx": 1010, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1010, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 10], "binary_question": "Must Step 11 happen after Step 7?", "why_question": "Why must Step 11 happen after Step 7?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 11 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 can be done at any time before assembling the shortcakes.\"\n}\n```"}
{"plan_idx": 1011, "title": "chocolate-chocolate-cake", "question_idx": 1011, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 11], "binary_question": "Must Step 12 happen after Step 5?", "why_question": "Why must Step 12 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 12 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 12 involves beating egg whites and is independent of the cooling process in Step 5.\"\n}\n```"}
{"plan_idx": 1012, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1012, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 11], "binary_question": "Must Step 12 happen after Step 5?", "why_question": "Why must Step 12 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 12 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 12 can be done independently of Step 5 as it involves preparing the whipped cream, which does not affect the dough preparation.\"\n}\n```"}
{"plan_idx": 1013, "title": "spanish-rabbit-stew", "question_idx": 1013, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 7], "binary_question": "Must Step 8 happen after Step 5?", "why_question": "Why must Step 8 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 8 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 8 is a humorous remark and does not affect the cooking process.\"\n}\n```"}
{"plan_idx": 1014, "title": "fusilli-and-meatballs", "question_idx": 1014, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 15], "binary_question": "Must Step 16 happen after Step 8?", "why_question": "Why must Step 16 happen after Step 8?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 16 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 16 involves draining the meatballs after browning them, which is independent of reducing the heat of the tomato sauce in Step 8.\"\n}\n```"}
{"plan_idx": 1015, "title": "chocolate-chocolate-cake", "question_idx": 1015, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 11], "binary_question": "Must Step 12 happen after Step 3?", "why_question": "Why must Step 12 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 12 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 12 involves beating egg whites and is independent of melting the chocolate in Step 3.\"\n}\n```"}
{"plan_idx": 1016, "title": "spiced butternut squash soup", "question_idx": 1016, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 7 happen after Step 3?", "why_question": "Why must Step 7 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 7 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 can happen independently of Step 3 as it involves preparing the base for the soup while the squash is baking.\"\n}\n```"}
{"plan_idx": 1017, "title": "fusilli-and-meatballs", "question_idx": 1017, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [8, 12], "binary_question": "Must Step 13 happen after Step 9?", "why_question": "Why must Step 13 happen after Step 9?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 13 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 13 can happen independently of Step 9 as it involves shaping the meatballs, which does not depend on the simmering of the sauce.\"\n}\n```"}
{"plan_idx": 1018, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1018, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 12], "binary_question": "Must Step 13 happen after Step 1?", "why_question": "Why must Step 13 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 13 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 13 does not depend on Step 1 and can be done independently.\"\n}\n```"}
{"plan_idx": 1019, "title": "chicken and vegetable pie", "question_idx": 1019, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 9], "binary_question": "Must Step 10 happen after Step 6?", "why_question": "Why must Step 10 happen after Step 6?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 10 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 can be done independently of Step 6 as it involves preparing the pie dish, not the filling.\"\n}\n```"}
{"plan_idx": 1020, "title": "almond and apple cake", "question_idx": 1020, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 7], "binary_question": "Must Step 8 happen after Step 1?", "why_question": "Why must Step 8 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 8 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 8 involves stirring the mixture, which does not depend on preheating the oven in Step 1.\"\n}\n```"}
{"plan_idx": 1021, "title": "vegetable-terrine", "question_idx": 1021, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why must Step 5 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 5 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 5 does not depend on Step 1 and can be done independently.\"\n}\n```"}
{"plan_idx": 1022, "title": "very-vanilla-ry-cheesecake", "question_idx": 1022, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why must Step 6 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 6 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 6 does not depend on Step 2 and can be done independently.\"\n}\n```"}
{"plan_idx": 1023, "title": "spanish-rabbit-stew", "question_idx": 1023, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 10], "binary_question": "Must Step 11 happen after Step 8?", "why_question": "Why must Step 11 happen after Step 8?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 11 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 11, which is to enjoy the meal, logically follows after the cooking and serving steps, including Step 8.\"\n}\n```"}
{"plan_idx": 1024, "title": "feta-and-sundried-tomato-spinach-rolls", "question_idx": 1024, "steps": ["Preheat grill.", "Mix together cream cheese, feta, sundried tomatoes, basil and garlic.", "Stir until creamy, with no lumps.", "Blanch the spinach leaves.", "Wrap a dollop of cheese mix in each spinach leaf.", "Brush with olive oil.", "Sprinkle almonds on the top or alternately roll them in the almonds", "Grill spinach rolls until slightly crispy on top.", "Let cool for 10 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why must Step 2 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: feta-and-sundried-tomato-spinach-rolls\n\nProcedure:\n1. Preheat grill.\n2. Mix together cream cheese, feta, sundried tomatoes, basil and garlic.\n3. Stir until creamy, with no lumps.\n4. Blanch the spinach leaves.\n5. Wrap a dollop of cheese mix in each spinach leaf.\n6. Brush with olive oil.\n7. Sprinkle almonds on the top or alternately roll them in the almonds\n8. Grill spinach rolls until slightly crispy on top.\n9. Let cool for 10 minutes.\n\n\n1. Must Step 2 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 2 does not depend on the grill being preheated and can be done independently.\"\n}\n```"}
{"plan_idx": 1025, "title": "chocolate-chocolate-cake", "question_idx": 1025, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 11], "binary_question": "Must Step 12 happen after Step 4?", "why_question": "Why must Step 12 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 12 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 12 involves beating egg whites, which is independent of the chocolate mixture cooling in Step 4.\"\n}\n```"}
{"plan_idx": 1026, "title": "spiced butternut squash soup", "question_idx": 1026, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 8], "binary_question": "Must Step 9 happen after Step 6?", "why_question": "Why must Step 9 happen after Step 6?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 9 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 9 involves adding chicken stock to the pot, which requires the pot to be prepared with saut\u00e9ed ingredients from Step 8.\"\n}\n```"}
{"plan_idx": 1027, "title": "tangy-gammon-in-cider", "question_idx": 1027, "steps": ["Preheat the oven to 200 degrees /gas mark 6.", "Start by piercing each tomato once and covering with boiling water to loosen the skins.", "Drain the onions and chop each one in half.", "Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.", "Put the onions, tomatoes and apples into a casserole dish.", "Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.", "Place in the dish and repeat with the other gammon steaks.", "Pour cider over the steaks, cover the top with a lid or tin foil.", "Cook for 1 hour."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why must Step 2 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tangy-gammon-in-cider\n\nProcedure:\n1. Preheat the oven to 200 degrees /gas mark 6.\n2. Start by piercing each tomato once and covering with boiling water to loosen the skins.\n3. Drain the onions and chop each one in half.\n4. Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.\n5. Put the onions, tomatoes and apples into a casserole dish.\n6. Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.\n7. Place in the dish and repeat with the other gammon steaks.\n8. Pour cider over the steaks, cover the top with a lid or tin foil.\n9. Cook for 1 hour.\n\n\n1. Must Step 2 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen after Step 1 because the oven needs to be preheated before cooking the dish.\"\n}\n```"}
{"plan_idx": 1028, "title": "green-tofu-curry", "question_idx": 1028, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 9], "binary_question": "Must Step 10 happen after Step 6?", "why_question": "Why must Step 10 happen after Step 6?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 10 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 does not depend on Step 6 and can be done independently.\"\n}\n```"}
{"plan_idx": 1029, "title": "spicy-tomato-anchovy-pasta", "question_idx": 1029, "steps": ["Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;", "cook until lightly browned.", "Add anchovies and water, cover and simmer for 4 to 5 minutes.", "Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.", "While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.", "Add linguine and cook until al dente, about 7 to 8 minutes;", "drain.", "Toss with anchovy mixture and chilli flakes.", "If desired, season with black pepper.", "Serve immediately."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why must Step 5 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spicy-tomato-anchovy-pasta\n\nProcedure:\n1. Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;\n2. cook until lightly browned.\n3. Add anchovies and water, cover and simmer for 4 to 5 minutes.\n4. Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.\n5. While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.\n6. Add linguine and cook until al dente, about 7 to 8 minutes;\n7. drain.\n8. Toss with anchovy mixture and chilli flakes.\n9. If desired, season with black pepper.\n10. Serve immediately.\n\n\n1. Must Step 5 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 5 can happen independently of Step 1 as it involves boiling water for the pasta, which can be done concurrently with cooking the vegetables.\"\n}\n```"}
{"plan_idx": 1030, "title": "spanish-rabbit-stew", "question_idx": 1030, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 8], "binary_question": "Must Step 9 happen after Step 6?", "why_question": "Why must Step 9 happen after Step 6?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 9 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 9 can happen after Step 7 as it involves seasoning the stew after it has simmered.\"\n}\n```"}
{"plan_idx": 1031, "title": "strawberry-tiramisu-trifle", "question_idx": 1031, "steps": ["Set 3 strawberries for the garnish aside, and cut the rest into slices.", "In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.", "Then stir in the custard and finally fold in the whipped cream.", "Brush the sponge fingers with the remaining coffee.", "Line a glass bowl with one layer of the soaked sponge fingers.", "Spread half of the strawberries over the sponge fingers.", "Sprinkle half of the grated chocolate over that and then half of the custard mixture.", "Repeat the layers in order again.", "Cut the remaining 3 strawberries in half and lay them on top of the trifle.", "Cover and leave in the fridge for at least 4 hours, best overnight."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 6 happen after Step 3?", "why_question": "Why must Step 6 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberry-tiramisu-trifle\n\nProcedure:\n1. Set 3 strawberries for the garnish aside, and cut the rest into slices.\n2. In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.\n3. Then stir in the custard and finally fold in the whipped cream.\n4. Brush the sponge fingers with the remaining coffee.\n5. Line a glass bowl with one layer of the soaked sponge fingers.\n6. Spread half of the strawberries over the sponge fingers.\n7. Sprinkle half of the grated chocolate over that and then half of the custard mixture.\n8. Repeat the layers in order again.\n9. Cut the remaining 3 strawberries in half and lay them on top of the trifle.\n10. Cover and leave in the fridge for at least 4 hours, best overnight.\n\n\n1. Must Step 6 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 involves spreading strawberries over the sponge fingers, which requires the custard mixture prepared in Step 3 to be ready for layering.\"\n}\n```"}
{"plan_idx": 1032, "title": "chocolate-pancake-batter", "question_idx": 1032, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why must Step 6 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 6 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 6 involves preparing the pan for cooking and is independent of mixing the batter in Step 2.\"\n}\n```"}
{"plan_idx": 1033, "title": "fusilli-and-meatballs", "question_idx": 1033, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 5 happen after Step 2?", "why_question": "Why must Step 5 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 5 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 must happen after Step 2 because the onion mixture from Step 2 is used in Step 3, which precedes Step 5.\"\n}\n```"}
{"plan_idx": 1034, "title": "chocolate-chocolate-cake", "question_idx": 1034, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 6 happen after Step 5?", "why_question": "Why must Step 6 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 6 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 involves beating butter and margarine together, which needs to be done after the chocolate mixture has been set aside to cool in Step 5 to ensure proper timing and texture.\"\n}\n```"}
{"plan_idx": 1035, "title": "spanish-rabbit-stew", "question_idx": 1035, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 9], "binary_question": "Must Step 10 happen after Step 6?", "why_question": "Why must Step 10 happen after Step 6?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 10 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 can happen at any time before serving, as it involves cooking pasta separately from the stew.\"\n}\n```"}
{"plan_idx": 1036, "title": "spiced-guava-cake", "question_idx": 1036, "steps": ["Preheat oven to 180 C / Gas 4.", "Grease and flour one 23x13cm loaf tin.", "Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.", "In another bowl, mix together guava pulp and juice.", "In another bowl, cream together butter and sugar.", "Add eggs, one at a time.", "Add flour mixture and guava mixture alternately to creamed mixture.", "Pour batter into prepared tin.", "Bake at 180 C / Gas 4 for 30-35 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 6 happen after Step 3?", "why_question": "Why must Step 6 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-guava-cake\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Grease and flour one 23x13cm loaf tin.\n3. Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.\n4. In another bowl, mix together guava pulp and juice.\n5. In another bowl, cream together butter and sugar.\n6. Add eggs, one at a time.\n7. Add flour mixture and guava mixture alternately to creamed mixture.\n8. Pour batter into prepared tin.\n9. Bake at 180 C / Gas 4 for 30-35 minutes.\n\n\n1. Must Step 6 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 6 must happen after Step 5, but it does not depend on Step 3.\"\n}\n```"}
{"plan_idx": 1037, "title": "spiced-guava-cake", "question_idx": 1037, "steps": ["Preheat oven to 180 C / Gas 4.", "Grease and flour one 23x13cm loaf tin.", "Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.", "In another bowl, mix together guava pulp and juice.", "In another bowl, cream together butter and sugar.", "Add eggs, one at a time.", "Add flour mixture and guava mixture alternately to creamed mixture.", "Pour batter into prepared tin.", "Bake at 180 C / Gas 4 for 30-35 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 5], "binary_question": "Must Step 6 happen after Step 4?", "why_question": "Why must Step 6 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-guava-cake\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Grease and flour one 23x13cm loaf tin.\n3. Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.\n4. In another bowl, mix together guava pulp and juice.\n5. In another bowl, cream together butter and sugar.\n6. Add eggs, one at a time.\n7. Add flour mixture and guava mixture alternately to creamed mixture.\n8. Pour batter into prepared tin.\n9. Bake at 180 C / Gas 4 for 30-35 minutes.\n\n\n1. Must Step 6 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 6 must happen after Step 5, but it does not depend on Step 4.\"\n}\n```"}
{"plan_idx": 1038, "title": "green-tofu-curry", "question_idx": 1038, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 9], "binary_question": "Must Step 10 happen after Step 7?", "why_question": "Why must Step 10 happen after Step 7?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 10 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 can happen independently of Step 7 as it involves preparing the curry sauce, which can be done concurrently with frying the tofu.\"\n}\n```"}
{"plan_idx": 1039, "title": "vegetable-terrine", "question_idx": 1039, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 9], "binary_question": "Must Step 10 happen after Step 8?", "why_question": "Why must Step 10 happen after Step 8?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 10 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 is a recommendation about the type of mould to use and can be considered at any point before pouring the cream mixture into the mould.\"\n}\n```"}
{"plan_idx": 1040, "title": "lamb-curry--serves-4-", "question_idx": 1040, "steps": ["Blend the garlic, ginger and one of the onions in a food processor then mix with the curry paste.", "Fry the lamb in a little oil, then add the remaining onion.", "Gently fry for a minute, then add the paste and cook for a couple of minutes.", "Add the water, tin of tomatoes, sugar, mushrooms and potatoes, and gently simmer covered for a few hours, until everything is tender.", "Add the two fresh tomatoes and the spinach and cook for a couple of minutes, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why must Step 2 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lamb-curry--serves-4-\n\nProcedure:\n1. Blend the garlic, ginger and one of the onions in a food processor then mix with the curry paste.\n2. Fry the lamb in a little oil, then add the remaining onion.\n3. Gently fry for a minute, then add the paste and cook for a couple of minutes.\n4. Add the water, tin of tomatoes, sugar, mushrooms and potatoes, and gently simmer covered for a few hours, until everything is tender.\n5. Add the two fresh tomatoes and the spinach and cook for a couple of minutes, then serve.\n\n\n1. Must Step 2 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 requires the remaining onion, which is prepared in Step 1.\"\n}\n```"}
{"plan_idx": 1041, "title": "chocolate-chocolate-cake", "question_idx": 1041, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 6 happen after Step 3?", "why_question": "Why must Step 6 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 6 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 6 can happen independently of Step 3 as they involve different ingredients and processes.\"\n}\n```"}
{"plan_idx": 1042, "title": "chocolate-chocolate-cake", "question_idx": 1042, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [10, 13], "binary_question": "Must Step 14 happen after Step 11?", "why_question": "Why must Step 14 happen after Step 11?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 14 happen after Step 11?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 14 can be done at any time before Step 16 as it involves preparing the cake tin, which does not depend on the egg whites being beaten.\"\n}\n```"}
{"plan_idx": 1043, "title": "tangy-gammon-in-cider", "question_idx": 1043, "steps": ["Preheat the oven to 200 degrees /gas mark 6.", "Start by piercing each tomato once and covering with boiling water to loosen the skins.", "Drain the onions and chop each one in half.", "Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.", "Put the onions, tomatoes and apples into a casserole dish.", "Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.", "Place in the dish and repeat with the other gammon steaks.", "Pour cider over the steaks, cover the top with a lid or tin foil.", "Cook for 1 hour."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 3 happen after Step 2?", "why_question": "Why must Step 3 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tangy-gammon-in-cider\n\nProcedure:\n1. Preheat the oven to 200 degrees /gas mark 6.\n2. Start by piercing each tomato once and covering with boiling water to loosen the skins.\n3. Drain the onions and chop each one in half.\n4. Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.\n5. Put the onions, tomatoes and apples into a casserole dish.\n6. Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.\n7. Place in the dish and repeat with the other gammon steaks.\n8. Pour cider over the steaks, cover the top with a lid or tin foil.\n9. Cook for 1 hour.\n\n\n1. Must Step 3 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 3 does not depend on Step 2 and can be done independently.\"\n}\n```"}
{"plan_idx": 1044, "title": "almond and apple cake", "question_idx": 1044, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 10], "binary_question": "Must Step 11 happen after Step 1?", "why_question": "Why must Step 11 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 11 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The oven needs to be preheated before baking the cake to ensure it cooks properly.\"\n}\n```"}
{"plan_idx": 1045, "title": "chocolate-chocolate-cake", "question_idx": 1045, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 7], "binary_question": "Must Step 8 happen after Step 4?", "why_question": "Why must Step 8 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 8 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 8 involves adding egg yolks to the butter and sugar mixture, which needs to be done after the chocolate mixture is set aside to cool in Step 5.\"\n}\n```"}
{"plan_idx": 1046, "title": "spiced-guava-cake", "question_idx": 1046, "steps": ["Preheat oven to 180 C / Gas 4.", "Grease and flour one 23x13cm loaf tin.", "Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.", "In another bowl, mix together guava pulp and juice.", "In another bowl, cream together butter and sugar.", "Add eggs, one at a time.", "Add flour mixture and guava mixture alternately to creamed mixture.", "Pour batter into prepared tin.", "Bake at 180 C / Gas 4 for 30-35 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why must Step 2 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-guava-cake\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Grease and flour one 23x13cm loaf tin.\n3. Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.\n4. In another bowl, mix together guava pulp and juice.\n5. In another bowl, cream together butter and sugar.\n6. Add eggs, one at a time.\n7. Add flour mixture and guava mixture alternately to creamed mixture.\n8. Pour batter into prepared tin.\n9. Bake at 180 C / Gas 4 for 30-35 minutes.\n\n\n1. Must Step 2 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The oven needs to be preheated before the tin is prepared to ensure it reaches the correct temperature by the time the batter is ready.\"\n}\n```"}
{"plan_idx": 1047, "title": "very-vanilla-ry-cheesecake", "question_idx": 1047, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why must Step 4 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 4 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 4 does not depend on Step 1 and can be done independently.\"\n}\n```"}
{"plan_idx": 1048, "title": "chicken-prawn-and-rice-soup", "question_idx": 1048, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 9], "binary_question": "Must Step 10 happen after Step 1?", "why_question": "Why must Step 10 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 10 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 10 involves heating the remaining oil, which is only specified after using 750ml of oil in Step 2.\"\n}\n```"}
{"plan_idx": 1049, "title": "spanish-rabbit-stew", "question_idx": 1049, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 9], "binary_question": "Must Step 10 happen after Step 5?", "why_question": "Why must Step 10 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 10 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 involves cooking pasta separately and can be done at any time before serving.\"\n}\n```"}
{"plan_idx": 1050, "title": "chocolate-chocolate-cake", "question_idx": 1050, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 15], "binary_question": "Must Step 16 happen after Step 1?", "why_question": "Why must Step 16 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 16 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 16 involves pouring the mixture into the cake tin, which requires the oven to be preheated as per Step 1.\"\n}\n```"}
{"plan_idx": 1051, "title": "vegetable-terrine", "question_idx": 1051, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 9], "binary_question": "Must Step 10 happen after Step 6?", "why_question": "Why must Step 10 happen after Step 6?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 10 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 is a recommendation about the type of mould to use and does not depend on the completion of Step 6.\"\n}\n```"}
{"plan_idx": 1052, "title": "very-vanilla-ry-cheesecake", "question_idx": 1052, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 7 happen after Step 3?", "why_question": "Why must Step 7 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 7 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 involves preparing the cheesecake filling, while Step 3 is part of preparing the biscuit base, so they can be done independently.\"\n}\n```"}
{"plan_idx": 1053, "title": "vegetable-terrine", "question_idx": 1053, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 9], "binary_question": "Must Step 10 happen after Step 3?", "why_question": "Why must Step 10 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 10 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 is a recommendation about the type of mould to use and does not depend on the completion of Step 3.\"\n}\n```"}
{"plan_idx": 1054, "title": "chicken-prawn-and-rice-soup", "question_idx": 1054, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 10], "binary_question": "Must Step 11 happen after Step 5?", "why_question": "Why must Step 11 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 11 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 can happen independently of Step 5 as it involves preparing the rice separately.\"\n}\n```"}
{"plan_idx": 1055, "title": "spiced butternut squash soup", "question_idx": 1055, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 7], "binary_question": "Must Step 8 happen after Step 4?", "why_question": "Why must Step 8 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 8 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 8 involves saut\u00e9ing ingredients in a pot, which should be done after the squash is baked and set aside in Step 6.\"\n}\n```"}
{"plan_idx": 1056, "title": "chicken and vegetable pie", "question_idx": 1056, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 9], "binary_question": "Must Step 10 happen after Step 3?", "why_question": "Why must Step 10 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 10 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 can be done at any time before Step 11 as it involves preparing the pie dish and does not depend on the boiling of the chicken and vegetables.\"\n}\n```"}
{"plan_idx": 1057, "title": "spanish-rabbit-stew", "question_idx": 1057, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 9], "binary_question": "Must Step 10 happen after Step 8?", "why_question": "Why must Step 10 happen after Step 8?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 10 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 can happen at any time as long as the pasta is ready to be served with the stew.\"\n}\n```"}
{"plan_idx": 1058, "title": "spiced-guava-cake", "question_idx": 1058, "steps": ["Preheat oven to 180 C / Gas 4.", "Grease and flour one 23x13cm loaf tin.", "Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.", "In another bowl, mix together guava pulp and juice.", "In another bowl, cream together butter and sugar.", "Add eggs, one at a time.", "Add flour mixture and guava mixture alternately to creamed mixture.", "Pour batter into prepared tin.", "Bake at 180 C / Gas 4 for 30-35 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 7 happen after Step 1?", "why_question": "Why must Step 7 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-guava-cake\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Grease and flour one 23x13cm loaf tin.\n3. Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.\n4. In another bowl, mix together guava pulp and juice.\n5. In another bowl, cream together butter and sugar.\n6. Add eggs, one at a time.\n7. Add flour mixture and guava mixture alternately to creamed mixture.\n8. Pour batter into prepared tin.\n9. Bake at 180 C / Gas 4 for 30-35 minutes.\n\n\n1. Must Step 7 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 involves adding mixtures to the creamed mixture, which requires the oven to be preheated as the batter needs to be baked immediately after preparation.\"\n}\n```"}
{"plan_idx": 1059, "title": "chicken and vegetable pie", "question_idx": 1059, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why must Step 5 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 5 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 5 does not depend on Step 1 and can be done independently.\"\n}\n```"}
{"plan_idx": 1060, "title": "strawberry-tiramisu-trifle", "question_idx": 1060, "steps": ["Set 3 strawberries for the garnish aside, and cut the rest into slices.", "In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.", "Then stir in the custard and finally fold in the whipped cream.", "Brush the sponge fingers with the remaining coffee.", "Line a glass bowl with one layer of the soaked sponge fingers.", "Spread half of the strawberries over the sponge fingers.", "Sprinkle half of the grated chocolate over that and then half of the custard mixture.", "Repeat the layers in order again.", "Cut the remaining 3 strawberries in half and lay them on top of the trifle.", "Cover and leave in the fridge for at least 4 hours, best overnight."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 5 happen after Step 3?", "why_question": "Why must Step 5 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberry-tiramisu-trifle\n\nProcedure:\n1. Set 3 strawberries for the garnish aside, and cut the rest into slices.\n2. In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.\n3. Then stir in the custard and finally fold in the whipped cream.\n4. Brush the sponge fingers with the remaining coffee.\n5. Line a glass bowl with one layer of the soaked sponge fingers.\n6. Spread half of the strawberries over the sponge fingers.\n7. Sprinkle half of the grated chocolate over that and then half of the custard mixture.\n8. Repeat the layers in order again.\n9. Cut the remaining 3 strawberries in half and lay them on top of the trifle.\n10. Cover and leave in the fridge for at least 4 hours, best overnight.\n\n\n1. Must Step 5 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 5 can happen independently of Step 3 as it involves preparing the base layer in the glass bowl, which does not depend on the custard mixture being ready.\"\n}\n```"}
{"plan_idx": 1061, "title": "spanish-rabbit-stew", "question_idx": 1061, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 5 happen after Step 3?", "why_question": "Why must Step 5 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 5 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 5 can happen after Step 4 as it involves adjusting the liquid levels, which is independent of mixing the ingredients in Step 3.\"\n}\n```"}
{"plan_idx": 1062, "title": "chocolate-chocolate-cake", "question_idx": 1062, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 13], "binary_question": "Must Step 14 happen after Step 6?", "why_question": "Why must Step 14 happen after Step 6?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 14 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 14 can be done at any time before Step 16 as it involves preparing the cake tin, not the batter.\"\n}\n```"}
{"plan_idx": 1063, "title": "cloud-bread", "question_idx": 1063, "steps": ["Preheat oven to 150 C / Gas mark 2.", "Line a baking tray with baking paper.", "Mix cream cheese and egg yolks together until smooth.", "Place egg whites and baking powder in a glass, metal, or ceramic bowl;", "beat together until stiff peaks form.", "Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.", "Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.", "Bake in the preheated oven until golden brown, 17 to 20 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why must Step 5 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cloud-bread\n\nProcedure:\n1. Preheat oven to 150 C / Gas mark 2.\n2. Line a baking tray with baking paper.\n3. Mix cream cheese and egg yolks together until smooth.\n4. Place egg whites and baking powder in a glass, metal, or ceramic bowl;\n5. beat together until stiff peaks form.\n6. Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.\n7. Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.\n8. Bake in the preheated oven until golden brown, 17 to 20 minutes.\n\n\n1. Must Step 5 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 5 does not depend on Step 1 and can be done independently.\"\n}\n```"}
{"plan_idx": 1064, "title": "spanish-rabbit-stew", "question_idx": 1064, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why must Step 2 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 2 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 2 is missing and does not provide any action or instruction.\"\n}\n```"}
{"plan_idx": 1065, "title": "chocolate-chocolate-cake", "question_idx": 1065, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 11], "binary_question": "Must Step 12 happen after Step 6?", "why_question": "Why must Step 12 happen after Step 6?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 12 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 12 involves beating egg whites, which is independent of Step 6 where butter and margarine are beaten together.\"\n}\n```"}
{"plan_idx": 1066, "title": "fusilli-and-meatballs", "question_idx": 1066, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [9, 14], "binary_question": "Must Step 15 happen after Step 10?", "why_question": "Why must Step 15 happen after Step 10?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 15 happen after Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 15 involves cooking the meatballs, which can be done independently of adding basil and oregano to the sauce in Step 10.\"\n}\n```"}
{"plan_idx": 1067, "title": "kid-s-cheese-and-veg-kebab", "question_idx": 1067, "steps": ["Shave the carrots into wide ribbons / waves using a potato peeler.", "Cut the red pepper into star shapes using a star cookie cutter.", "Cut the bread into flowers using a cookie cutter.", "Assemble all onto a skewer with bread flowers top and bottom and carrot curls, cheesy chunks and pepper stars seen as layers between."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 3 happen after Step 2?", "why_question": "Why must Step 3 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: kid-s-cheese-and-veg-kebab\n\nProcedure:\n1. Shave the carrots into wide ribbons / waves using a potato peeler.\n2. Cut the red pepper into star shapes using a star cookie cutter.\n3. Cut the bread into flowers using a cookie cutter.\n4. Assemble all onto a skewer with bread flowers top and bottom and carrot curls, cheesy chunks and pepper stars seen as layers between.\n\n\n1. Must Step 3 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"The order of cutting the bread and the red pepper does not affect the final assembly of the kebab.\"\n}\n```"}
{"plan_idx": 1068, "title": "spanish-rabbit-stew", "question_idx": 1068, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 3 happen after Step 2?", "why_question": "Why must Step 3 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 3 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 2 is missing and appears to be a placeholder, so Step 3 can logically follow Step 1.\"\n}\n```"}
{"plan_idx": 1069, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1069, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 10], "binary_question": "Must Step 11 happen after Step 3?", "why_question": "Why must Step 11 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 11 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 can be done at any time before assembling the shortcakes as it does not depend on the completion of Step 3.\"\n}\n```"}
{"plan_idx": 1070, "title": "spiced butternut squash soup", "question_idx": 1070, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 9], "binary_question": "Must Step 10 happen after Step 6?", "why_question": "Why must Step 10 happen after Step 6?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 10 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 10 involves cooking the potatoes in the chicken stock, which requires the preparation of the squash in Steps 1-6 to be completed first.\"\n}\n```"}
{"plan_idx": 1071, "title": "chocolate-chocolate-cake", "question_idx": 1071, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 7 happen after Step 2?", "why_question": "Why must Step 7 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 7 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 involves beating butter and sugar, which is independent of melting chocolate in Step 2.\"\n}\n```"}
{"plan_idx": 1072, "title": "banana-split-cake", "question_idx": 1072, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 7 happen after Step 1?", "why_question": "Why must Step 7 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\n1. Must Step 7 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 involves preparing the filling which needs to be spread over the cooled base prepared in Steps 1-5.\"\n}\n```"}
{"plan_idx": 1073, "title": "fusilli-and-meatballs", "question_idx": 1073, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 18], "binary_question": "Must Step 19 happen after Step 7?", "why_question": "Why must Step 19 happen after Step 7?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 19 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 19 can happen at any time before serving, as long as the pasta is ready when the meatballs and sauce are done.\"\n}\n```"}
{"plan_idx": 1074, "title": "green-tofu-curry", "question_idx": 1074, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 10], "binary_question": "Must Step 11 happen after Step 2?", "why_question": "Why must Step 11 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 11 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 involves simmering the coconut milk and curry paste, which is independent of boiling the rice in Step 2.\"\n}\n```"}
{"plan_idx": 1075, "title": "chocolate-pancake-batter", "question_idx": 1075, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 5 happen after Step 3?", "why_question": "Why must Step 5 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 5 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 involves heating the pan, which should be done after preparing the batter in Step 3 to ensure the batter is ready to be cooked.\"\n}\n```"}
{"plan_idx": 1076, "title": "green-tofu-curry", "question_idx": 1076, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 6 happen after Step 3?", "why_question": "Why must Step 6 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 6 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 6 can happen independently of Step 3 as they involve different components (tofu and rice) being prepared in separate saucepans.\"\n}\n```"}
{"plan_idx": 1077, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1077, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 10], "binary_question": "Must Step 11 happen after Step 1?", "why_question": "Why must Step 11 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 11 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 does not depend on Step 1 and can be done at any time before assembling the shortcakes.\"\n}\n```"}
{"plan_idx": 1078, "title": "lightly spiced tomato and red lentil soup", "question_idx": 1078, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 8], "binary_question": "Must Step 9 happen after Step 7?", "why_question": "Why must Step 9 happen after Step 7?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 9 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 9 can happen after Step 8, as Step 7 is a separate task for the garnish.\"\n}\n```"}
{"plan_idx": 1079, "title": "very-vanilla-ry-cheesecake", "question_idx": 1079, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 9], "binary_question": "Must Step 10 happen after Step 2?", "why_question": "Why must Step 10 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 10 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 involves preparing the oven for baking and does not depend on the crushing of the biscuits in Step 2.\"\n}\n```"}
{"plan_idx": 1080, "title": "simple-basic-cupcakes", "question_idx": 1080, "steps": ["Preheat oven to 180 C / Gas 4.", "Beat butter and sugar together until light and fluffy.", "Add the eggs, one at a time, beating after each addition.", "If the batter is too thick, stir in some milk.", "Gradually add the flour, mixing well each time until evenly mixed.", "Spoon tablespoons of batter into a greased muffin tin.", "Bake in preheated oven for 15-20 minutes.", "The cake is done when a skewer inserted to the cake comes out clean.", "Let rest for fives minutes, then allow to cool fully on a wire rack.", "Decorate, if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why must Step 6 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: simple-basic-cupcakes\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Beat butter and sugar together until light and fluffy.\n3. Add the eggs, one at a time, beating after each addition.\n4. If the batter is too thick, stir in some milk.\n5. Gradually add the flour, mixing well each time until evenly mixed.\n6. Spoon tablespoons of batter into a greased muffin tin.\n7. Bake in preheated oven for 15-20 minutes.\n8. The cake is done when a skewer inserted to the cake comes out clean.\n9. Let rest for fives minutes, then allow to cool fully on a wire rack.\n10. Decorate, if desired.\n\n\n1. Must Step 6 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 must happen after Step 1 because the oven needs to be preheated before baking the cupcakes.\"\n}\n```"}
{"plan_idx": 1081, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1081, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [8, 11], "binary_question": "Must Step 12 happen after Step 9?", "why_question": "Why must Step 12 happen after Step 9?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 12 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 12 can happen at any time before Step 15 as long as the whipped cream is ready for assembly.\"\n}\n```"}
{"plan_idx": 1082, "title": "spiced butternut squash soup", "question_idx": 1082, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 7 happen after Step 2?", "why_question": "Why must Step 7 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 7 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 involves preparing the soup base and can be done independently of Step 2, which is for baking the squash.\"\n}\n```"}
{"plan_idx": 1083, "title": "green-tofu-curry", "question_idx": 1083, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 5 happen after Step 4?", "why_question": "Why must Step 5 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 5 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 5 can happen independently of Step 4 as they involve different components (tofu and rice) being prepared separately.\"\n}\n```"}
{"plan_idx": 1084, "title": "fusilli-and-meatballs", "question_idx": 1084, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [13, 18], "binary_question": "Must Step 19 happen after Step 14?", "why_question": "Why must Step 19 happen after Step 14?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 19 happen after Step 14?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 19 can happen independently of Step 14 as it involves cooking the pasta, which is separate from cooking the meatballs.\"\n}\n```"}
{"plan_idx": 1085, "title": "feta-and-sundried-tomato-spinach-rolls", "question_idx": 1085, "steps": ["Preheat grill.", "Mix together cream cheese, feta, sundried tomatoes, basil and garlic.", "Stir until creamy, with no lumps.", "Blanch the spinach leaves.", "Wrap a dollop of cheese mix in each spinach leaf.", "Brush with olive oil.", "Sprinkle almonds on the top or alternately roll them in the almonds", "Grill spinach rolls until slightly crispy on top.", "Let cool for 10 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why must Step 5 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: feta-and-sundried-tomato-spinach-rolls\n\nProcedure:\n1. Preheat grill.\n2. Mix together cream cheese, feta, sundried tomatoes, basil and garlic.\n3. Stir until creamy, with no lumps.\n4. Blanch the spinach leaves.\n5. Wrap a dollop of cheese mix in each spinach leaf.\n6. Brush with olive oil.\n7. Sprinkle almonds on the top or alternately roll them in the almonds\n8. Grill spinach rolls until slightly crispy on top.\n9. Let cool for 10 minutes.\n\n\n1. Must Step 5 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 5 does not depend on Step 1 and can be done independently of preheating the grill.\"\n}\n```"}
{"plan_idx": 1086, "title": "fusilli-and-meatballs", "question_idx": 1086, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 18], "binary_question": "Must Step 19 happen after Step 4?", "why_question": "Why must Step 19 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 19 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 19 can happen at any time before Step 20 as long as the pasta is ready to be tossed with the sauce.\"\n}\n```"}
{"plan_idx": 1087, "title": "chicken-prawn-and-rice-soup", "question_idx": 1087, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 9], "binary_question": "Must Step 10 happen after Step 4?", "why_question": "Why must Step 10 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 10 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 can happen independently of Step 4 as it involves heating oil for the rice, which is a separate task from preparing the chicken and prawn mixture.\"\n}\n```"}
{"plan_idx": 1088, "title": "green-tofu-curry", "question_idx": 1088, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 9], "binary_question": "Must Step 10 happen after Step 1?", "why_question": "Why must Step 10 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 10 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 involves preparing the curry sauce and is independent of cooking the rice in Step 1.\"\n}\n```"}
{"plan_idx": 1089, "title": "chicken and vegetable pie", "question_idx": 1089, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 5 happen after Step 3?", "why_question": "Why must Step 5 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 5 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 involves cooking the onion in butter, which is part of the preparation for the sauce that will be poured over the chicken mixture, and this needs to be done after the chicken and vegetables are boiled and set aside in Step 3.\"\n}\n```"}
{"plan_idx": 1090, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1090, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [12, 13], "binary_question": "Must Step 14 happen after Step 13?", "why_question": "Why must Step 14 happen after Step 13?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 14 happen after Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 14 must happen after Step 13 because the shortcakes need to be split and assembled with the whipped cream, which is prepared in Step 13.\"\n}\n```"}
{"plan_idx": 1091, "title": "spiced butternut squash soup", "question_idx": 1091, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 7 happen after Step 6?", "why_question": "Why must Step 7 happen after Step 6?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 7 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 involves melting butter in a pot, which is necessary to start the cooking process for the onion, leek, and garlic, and this can only happen after the squash is set aside in Step 6.\"\n}\n```"}
{"plan_idx": 1092, "title": "green-tofu-curry", "question_idx": 1092, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 5 happen after Step 3?", "why_question": "Why must Step 5 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 5 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 5 can happen independently of Step 3 as they involve different components (tofu and rice) being prepared in separate saucepans.\"\n}\n```"}
{"plan_idx": 1093, "title": "no-sugar-rock-cakes", "question_idx": 1093, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why must Step 5 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\n1. Must Step 5 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 5 does not depend on Step 1 and can be done independently.\"\n}\n```"}
{"plan_idx": 1094, "title": "banana-split-cake", "question_idx": 1094, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 6], "binary_question": "Must Step 7 happen after Step 4?", "why_question": "Why must Step 7 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\n1. Must Step 7 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 involves preparing the filling which needs to be spread over the cooled base from Step 5.\"\n}\n```"}
{"plan_idx": 1095, "title": "lightly spiced tomato and red lentil soup", "question_idx": 1095, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 10], "binary_question": "Must Step 11 happen after Step 7?", "why_question": "Why must Step 11 happen after Step 7?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 11 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 must happen after Step 10, not necessarily after Step 7.\"\n}\n```"}
{"plan_idx": 1096, "title": "spiced-pumpkin-teabread", "question_idx": 1096, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 7], "binary_question": "Must Step 8 happen after Step 1?", "why_question": "Why must Step 8 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 8 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 8 involves mixing the pumpkin mixture with the flour mixture, which requires the oven to be preheated and ready for baking immediately after.\"\n}\n```"}
{"plan_idx": 1097, "title": "spiced butternut squash soup", "question_idx": 1097, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 9], "binary_question": "Must Step 10 happen after Step 2?", "why_question": "Why must Step 10 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 10 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 involves boiling potatoes in the pot, which is unrelated to pouring water in the baking dish in Step 2.\"\n}\n```"}
{"plan_idx": 1098, "title": "chicken and vegetable pie", "question_idx": 1098, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 7], "binary_question": "Must Step 8 happen after Step 2?", "why_question": "Why must Step 8 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 8 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 8 must happen after Step 2 because the chicken and vegetables need to be cooked and set aside before the liquid mixture is prepared.\"\n}\n```"}
{"plan_idx": 1099, "title": "spiced butternut squash soup", "question_idx": 1099, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 8], "binary_question": "Must Step 9 happen after Step 2?", "why_question": "Why must Step 9 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 9 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 9 involves adding chicken stock to the pot, which is unrelated to pouring water in a baking dish in Step 2.\"\n}\n```"}
{"plan_idx": 1100, "title": "spiced butternut squash soup", "question_idx": 1100, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 9], "binary_question": "Must Step 10 happen after Step 1?", "why_question": "Why must Step 10 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 10 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 involves boiling the potatoes and is independent of preheating the oven in Step 1.\"\n}\n```"}
{"plan_idx": 1101, "title": "green-tofu-curry", "question_idx": 1101, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 8], "binary_question": "Must Step 9 happen after Step 8?", "why_question": "Why must Step 9 happen after Step 8?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 9 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 9 can happen independently of Step 8 as they involve different components (coconut milk and tofu respectively).\"\n}\n```"}
{"plan_idx": 1102, "title": "banana-split-cake", "question_idx": 1102, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 6 happen after Step 5?", "why_question": "Why must Step 6 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\n1. Must Step 6 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 involves preparing the filling that needs to be spread over the cooled base from Step 5.\"\n}\n```"}
{"plan_idx": 1103, "title": "lightly spiced tomato and red lentil soup", "question_idx": 1103, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 6], "binary_question": "Must Step 7 happen after Step 4?", "why_question": "Why must Step 7 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 7 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 can be done at any time while the soup is simmering or even before starting the cooking process.\"\n}\n```"}
{"plan_idx": 1104, "title": "almond and apple cake", "question_idx": 1104, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why must Step 6 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 6 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 6 involves mixing ingredients and does not depend on preheating the oven.\"\n}\n```"}
{"plan_idx": 1105, "title": "tortellini-fritto-with-almond-butter", "question_idx": 1105, "steps": ["Bring a saucepan of water to the boil.", "Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.", "In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.", "If you slightly undercooked your tortellini then it's less likely to stick to the pan.", "Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.", "Continue to gently fry and stir the tortellini until golden brown.", "Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.", "Enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 5 happen after Step 4?", "why_question": "Why must Step 5 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tortellini-fritto-with-almond-butter\n\nProcedure:\n1. Bring a saucepan of water to the boil.\n2. Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.\n3. In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.\n4. If you slightly undercooked your tortellini then it's less likely to stick to the pan.\n5. Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.\n6. Continue to gently fry and stir the tortellini until golden brown.\n7. Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.\n8. Enjoy!\n\n\n1. Must Step 5 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 must happen after Step 4 because the tortellini needs to be gently fried first to prevent sticking before adding honey, salt, and almond butter.\"\n}\n```"}
{"plan_idx": 1106, "title": "spiced butternut squash soup", "question_idx": 1106, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 7], "binary_question": "Must Step 8 happen after Step 5?", "why_question": "Why must Step 8 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 8 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 8 involves saut\u00e9ing ingredients in a pot, which should happen after the squash is baked, peeled, and set aside in Step 5 to ensure the timing and preparation sequence is correct.\"\n}\n```"}
{"plan_idx": 1107, "title": "fusilli-and-meatballs", "question_idx": 1107, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 13], "binary_question": "Must Step 14 happen after Step 8?", "why_question": "Why must Step 14 happen after Step 8?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 14 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 14 can happen independently of Step 8 as it involves preparing the meatballs, not the sauce.\"\n}\n```"}
{"plan_idx": 1108, "title": "creamy-chayote-squash-soup", "question_idx": 1108, "steps": ["Dissolve the stock in the hot water.", "Melt the butter in a large saucepan over medium heat.", "Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.", "Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.", "Stir in the stock and 1 tablespoon coriander;", "cover.", "Simmer about 20 minutes.", "Pour the mixture into a liquidiser and puree until smooth.", "Pour into bowls and garnish with a sprig of coriander to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why must Step 3 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: creamy-chayote-squash-soup\n\nProcedure:\n1. Dissolve the stock in the hot water.\n2. Melt the butter in a large saucepan over medium heat.\n3. Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.\n4. Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.\n5. Stir in the stock and 1 tablespoon coriander;\n6. cover.\n7. Simmer about 20 minutes.\n8. Pour the mixture into a liquidiser and puree until smooth.\n9. Pour into bowls and garnish with a sprig of coriander to serve.\n\n\n1. Must Step 3 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 requires the butter to be melted, which happens in Step 2, and Step 2 follows Step 1.\"\n}\n```"}
{"plan_idx": 1109, "title": "fusilli-and-meatballs", "question_idx": 1109, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 14], "binary_question": "Must Step 15 happen after Step 8?", "why_question": "Why must Step 15 happen after Step 8?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 15 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 15 can happen independently of Step 8 as it involves cooking the meatballs, which is separate from the simmering of the sauce.\"\n}\n```"}
{"plan_idx": 1110, "title": "banana-split-cake", "question_idx": 1110, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why must Step 6 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\n1. Must Step 6 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 involves preparing the filling which needs to be spread over the cooled base prepared in Steps 2-5.\"\n}\n```"}
{"plan_idx": 1111, "title": "tangy-gammon-in-cider", "question_idx": 1111, "steps": ["Preheat the oven to 200 degrees /gas mark 6.", "Start by piercing each tomato once and covering with boiling water to loosen the skins.", "Drain the onions and chop each one in half.", "Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.", "Put the onions, tomatoes and apples into a casserole dish.", "Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.", "Place in the dish and repeat with the other gammon steaks.", "Pour cider over the steaks, cover the top with a lid or tin foil.", "Cook for 1 hour."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why must Step 6 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tangy-gammon-in-cider\n\nProcedure:\n1. Preheat the oven to 200 degrees /gas mark 6.\n2. Start by piercing each tomato once and covering with boiling water to loosen the skins.\n3. Drain the onions and chop each one in half.\n4. Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.\n5. Put the onions, tomatoes and apples into a casserole dish.\n6. Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.\n7. Place in the dish and repeat with the other gammon steaks.\n8. Pour cider over the steaks, cover the top with a lid or tin foil.\n9. Cook for 1 hour.\n\n\n1. Must Step 6 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 6 does not depend on Step 1 and can be done independently of preheating the oven.\"\n}\n```"}
{"plan_idx": 1112, "title": "simple-basic-cupcakes", "question_idx": 1112, "steps": ["Preheat oven to 180 C / Gas 4.", "Beat butter and sugar together until light and fluffy.", "Add the eggs, one at a time, beating after each addition.", "If the batter is too thick, stir in some milk.", "Gradually add the flour, mixing well each time until evenly mixed.", "Spoon tablespoons of batter into a greased muffin tin.", "Bake in preheated oven for 15-20 minutes.", "The cake is done when a skewer inserted to the cake comes out clean.", "Let rest for fives minutes, then allow to cool fully on a wire rack.", "Decorate, if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why must Step 3 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: simple-basic-cupcakes\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Beat butter and sugar together until light and fluffy.\n3. Add the eggs, one at a time, beating after each addition.\n4. If the batter is too thick, stir in some milk.\n5. Gradually add the flour, mixing well each time until evenly mixed.\n6. Spoon tablespoons of batter into a greased muffin tin.\n7. Bake in preheated oven for 15-20 minutes.\n8. The cake is done when a skewer inserted to the cake comes out clean.\n9. Let rest for fives minutes, then allow to cool fully on a wire rack.\n10. Decorate, if desired.\n\n\n1. Must Step 3 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 involves adding eggs to the butter and sugar mixture, which requires the mixture prepared in Step 2, and Step 1 ensures the oven is preheated in time for baking.\"\n}\n```"}
{"plan_idx": 1113, "title": "tortellini-fritto-with-almond-butter", "question_idx": 1113, "steps": ["Bring a saucepan of water to the boil.", "Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.", "In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.", "If you slightly undercooked your tortellini then it's less likely to stick to the pan.", "Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.", "Continue to gently fry and stir the tortellini until golden brown.", "Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.", "Enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 7], "binary_question": "Must Step 8 happen after Step 2?", "why_question": "Why must Step 8 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tortellini-fritto-with-almond-butter\n\nProcedure:\n1. Bring a saucepan of water to the boil.\n2. Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.\n3. In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.\n4. If you slightly undercooked your tortellini then it's less likely to stick to the pan.\n5. Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.\n6. Continue to gently fry and stir the tortellini until golden brown.\n7. Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.\n8. Enjoy!\n\n\n1. Must Step 8 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 8 is the final step and involves enjoying the dish, which can only happen after all the cooking steps are completed.\"\n}\n```"}
{"plan_idx": 1114, "title": "chocolate-chocolate-cake", "question_idx": 1114, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [8, 10], "binary_question": "Must Step 11 happen after Step 9?", "why_question": "Why must Step 11 happen after Step 9?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 11 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 11 must happen after Step 9 because the egg whites need to be folded into the chocolate mixture, which is prepared in Step 10.\"\n}\n```"}
{"plan_idx": 1115, "title": "spiced butternut squash soup", "question_idx": 1115, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 6], "binary_question": "Must Step 7 happen after Step 4?", "why_question": "Why must Step 7 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 7 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 involves cooking the onion, leek, and garlic in butter, which should be done after the squash is baked and set aside in Step 6 to ensure the timing and preparation sequence is correct.\"\n}\n```"}
{"plan_idx": 1116, "title": "smoked-salmon-and-grapefruit-salad", "question_idx": 1116, "steps": ["Top and tail the grapefruits.", "Slice the skin off the grapefruit over a bowl.", "This is to catch any juices.", "Using a small knife, segment the grapefruits over the juice bowl.", "Arrange the lamb's lettuce onto each serving plate or a large salad bowl.", "Top with grapefruit segments and smoked salmon.", "Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.", "Pour over the salad and serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 6], "binary_question": "Must Step 7 happen after Step 5?", "why_question": "Why must Step 7 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: smoked-salmon-and-grapefruit-salad\n\nProcedure:\n1. Top and tail the grapefruits.\n2. Slice the skin off the grapefruit over a bowl.\n3. This is to catch any juices.\n4. Using a small knife, segment the grapefruits over the juice bowl.\n5. Arrange the lamb's lettuce onto each serving plate or a large salad bowl.\n6. Top with grapefruit segments and smoked salmon.\n7. Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.\n8. Pour over the salad and serve.\n\n\n1. Must Step 7 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 can be done independently of Step 5 as it involves mixing ingredients for the dressing, which can be prepared at any time before pouring it over the salad in Step 8.\"\n}\n```"}
{"plan_idx": 1117, "title": "feta-and-sundried-tomato-spinach-rolls", "question_idx": 1117, "steps": ["Preheat grill.", "Mix together cream cheese, feta, sundried tomatoes, basil and garlic.", "Stir until creamy, with no lumps.", "Blanch the spinach leaves.", "Wrap a dollop of cheese mix in each spinach leaf.", "Brush with olive oil.", "Sprinkle almonds on the top or alternately roll them in the almonds", "Grill spinach rolls until slightly crispy on top.", "Let cool for 10 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why must Step 4 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: feta-and-sundried-tomato-spinach-rolls\n\nProcedure:\n1. Preheat grill.\n2. Mix together cream cheese, feta, sundried tomatoes, basil and garlic.\n3. Stir until creamy, with no lumps.\n4. Blanch the spinach leaves.\n5. Wrap a dollop of cheese mix in each spinach leaf.\n6. Brush with olive oil.\n7. Sprinkle almonds on the top or alternately roll them in the almonds\n8. Grill spinach rolls until slightly crispy on top.\n9. Let cool for 10 minutes.\n\n\n1. Must Step 4 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Blanching the spinach leaves does not depend on preheating the grill and can be done independently.\"\n}\n```"}
{"plan_idx": 1118, "title": "fusilli-and-meatballs", "question_idx": 1118, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 12], "binary_question": "Must Step 13 happen after Step 8?", "why_question": "Why must Step 13 happen after Step 8?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 13 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 13 can happen independently of Step 8 as it involves shaping meatballs, which does not depend on the heat adjustment of the sauce.\"\n}\n```"}
{"plan_idx": 1119, "title": "fusilli-and-meatballs", "question_idx": 1119, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [10, 18], "binary_question": "Must Step 19 happen after Step 11?", "why_question": "Why must Step 19 happen after Step 11?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 19 happen after Step 11?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 19 can happen independently of Step 11 as it involves cooking pasta, which is not directly related to processing bread into crumbs.\"\n}\n```"}
{"plan_idx": 1120, "title": "chicken and vegetable pie", "question_idx": 1120, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why must Step 3 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 3 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The oven needs to be preheated before baking, and boiling the chicken and vegetables is a preparatory step that can be done while the oven is preheating.\"\n}\n```"}
{"plan_idx": 1121, "title": "no-sugar-rock-cakes", "question_idx": 1121, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 7 happen after Step 1?", "why_question": "Why must Step 7 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\n1. Must Step 7 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 must happen after Step 6, but it is not dependent on Step 1.\"\n}\n```"}
{"plan_idx": 1122, "title": "fusilli-and-meatballs", "question_idx": 1122, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 10], "binary_question": "Must Step 11 happen after Step 5?", "why_question": "Why must Step 11 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 11 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 is independent of Step 5 and can be done at any time before Step 12.\"\n}\n```"}
{"plan_idx": 1123, "title": "no-sugar-rock-cakes", "question_idx": 1123, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why must Step 3 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\n1. Must Step 3 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 3 can be done independently of preheating the oven in Step 1.\"\n}\n```"}
{"plan_idx": 1124, "title": "chocolate-chocolate-cake", "question_idx": 1124, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 13], "binary_question": "Must Step 14 happen after Step 8?", "why_question": "Why must Step 14 happen after Step 8?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 14 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 14 can be done at any time before Step 16 as it involves preparing the cake tin, not the batter.\"\n}\n```"}
{"plan_idx": 1125, "title": "chocolate-chocolate-cake", "question_idx": 1125, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 7], "binary_question": "Must Step 8 happen after Step 5?", "why_question": "Why must Step 8 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 8 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 8 involves adding egg yolks to the mixture, which requires the butter and margarine mixture prepared in Step 6 and 7, and Step 5 must be completed to ensure the chocolate mixture is cooled before it is added in Step 10.\"\n}\n```"}
{"plan_idx": 1126, "title": "chicken-prawn-and-rice-soup", "question_idx": 1126, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why must Step 2 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 2 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen after Step 1 because the prawns and chicken mixture prepared in Step 1 is needed to be cooked in the hot oil in Step 2.\"\n}\n```"}
{"plan_idx": 1127, "title": "fusilli-and-meatballs", "question_idx": 1127, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 7], "binary_question": "Must Step 8 happen after Step 2?", "why_question": "Why must Step 8 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 8 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 8 is related to adjusting the heat for the sauce, while Step 2 is about saut\u00e9ing the onion and garlic.\"\n}\n```"}
{"plan_idx": 1128, "title": "cloud-bread", "question_idx": 1128, "steps": ["Preheat oven to 150 C / Gas mark 2.", "Line a baking tray with baking paper.", "Mix cream cheese and egg yolks together until smooth.", "Place egg whites and baking powder in a glass, metal, or ceramic bowl;", "beat together until stiff peaks form.", "Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.", "Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.", "Bake in the preheated oven until golden brown, 17 to 20 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 4 happen after Step 3?", "why_question": "Why must Step 4 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cloud-bread\n\nProcedure:\n1. Preheat oven to 150 C / Gas mark 2.\n2. Line a baking tray with baking paper.\n3. Mix cream cheese and egg yolks together until smooth.\n4. Place egg whites and baking powder in a glass, metal, or ceramic bowl;\n5. beat together until stiff peaks form.\n6. Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.\n7. Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.\n8. Bake in the preheated oven until golden brown, 17 to 20 minutes.\n\n\n1. Must Step 4 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen after Step 3 because the egg whites need to be beaten separately before being combined with the cream cheese and egg yolk mixture.\"\n}\n```"}
{"plan_idx": 1129, "title": "fusilli-and-meatballs", "question_idx": 1129, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 7 happen after Step 3?", "why_question": "Why must Step 7 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 7 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 involves bringing the tomato mixture to a boil, which requires the tomatoes to be added to the saucepan in Step 6, which in turn follows the transfer of the onion mixture in Step 3.\"\n}\n```"}
{"plan_idx": 1130, "title": "green-tofu-curry", "question_idx": 1130, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 10], "binary_question": "Must Step 11 happen after Step 5?", "why_question": "Why must Step 11 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 11 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 does not depend on Step 5 and can be done independently.\"\n}\n```"}
{"plan_idx": 1131, "title": "spiced-pumpkin-teabread", "question_idx": 1131, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 4 happen after Step 2?", "why_question": "Why must Step 4 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 4 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen after Step 2 because the pumpkin needs to be cooked and drained before it can be mashed.\"\n}\n```"}
{"plan_idx": 1132, "title": "chocolate-chocolate-cake", "question_idx": 1132, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 14], "binary_question": "Must Step 15 happen after Step 3?", "why_question": "Why must Step 15 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 15 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 15 involves preparing the cake tin and does not depend on the chocolate melting process in Step 3.\"\n}\n```"}
{"plan_idx": 1133, "title": "chocolate-chocolate-cake", "question_idx": 1133, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [12, 13], "binary_question": "Must Step 14 happen after Step 13?", "why_question": "Why must Step 14 happen after Step 13?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 14 happen after Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 14 must happen after Step 13 because the egg white mixture needs to be folded into the chocolate mixture before it is poured into the greased tin.\"\n}\n```"}
{"plan_idx": 1134, "title": "chocolate-chocolate-cake", "question_idx": 1134, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 6], "binary_question": "Must Step 7 happen after Step 4?", "why_question": "Why must Step 7 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 7 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 involves beating sugar into the butter and margarine mixture, which needs to be done after the chocolate mixture is set aside to cool in Step 5.\"\n}\n```"}
{"plan_idx": 1135, "title": "almost no fat banana bread", "question_idx": 1135, "steps": ["Preheat oven to 180 C / Gas mark 4.", "Lightly grease a 20x10cm (8x4 in) loaf tin.", "In a large bowl, stir together flour, sugar, baking powder, bicarbonate of soda and cinnamon.", "Add egg whites, bananas and apple pur\u00c3\u00a9e; stir just until combined.", "Pour batter into prepared tin.", "Bake in preheated oven for 50 to 55 minutes, until a skewer inserted into centre of loaf comes out clean.", "Turn out onto wire rack and allow to cool before slicing."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why must Step 4 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almost no fat banana bread\n\nProcedure:\n1. Preheat oven to 180 C / Gas mark 4.\n2. Lightly grease a 20x10cm (8x4 in) loaf tin.\n3. In a large bowl, stir together flour, sugar, baking powder, bicarbonate of soda and cinnamon.\n4. Add egg whites, bananas and apple pur\u00c3\u00a9e; stir just until combined.\n5. Pour batter into prepared tin.\n6. Bake in preheated oven for 50 to 55 minutes, until a skewer inserted into centre of loaf comes out clean.\n7. Turn out onto wire rack and allow to cool before slicing.\n\n\n1. Must Step 4 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 4 does not depend on the oven being preheated and can be done independently of Step 1.\"\n}\n```"}
{"plan_idx": 1136, "title": "smoked-salmon-and-grapefruit-salad", "question_idx": 1136, "steps": ["Top and tail the grapefruits.", "Slice the skin off the grapefruit over a bowl.", "This is to catch any juices.", "Using a small knife, segment the grapefruits over the juice bowl.", "Arrange the lamb's lettuce onto each serving plate or a large salad bowl.", "Top with grapefruit segments and smoked salmon.", "Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.", "Pour over the salad and serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 5 happen after Step 3?", "why_question": "Why must Step 5 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: smoked-salmon-and-grapefruit-salad\n\nProcedure:\n1. Top and tail the grapefruits.\n2. Slice the skin off the grapefruit over a bowl.\n3. This is to catch any juices.\n4. Using a small knife, segment the grapefruits over the juice bowl.\n5. Arrange the lamb's lettuce onto each serving plate or a large salad bowl.\n6. Top with grapefruit segments and smoked salmon.\n7. Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.\n8. Pour over the salad and serve.\n\n\n1. Must Step 5 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 5 can happen independently of Step 3 as it involves arranging the lamb's lettuce, which does not depend on catching grapefruit juices.\"\n}\n```"}
{"plan_idx": 1137, "title": "very-vanilla-ry-cheesecake", "question_idx": 1137, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why must Step 2 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 2 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 2 can be done independently of Step 1 as it involves crushing biscuits, which does not depend on preheating the oven.\"\n}\n```"}
{"plan_idx": 1138, "title": "fusilli-and-meatballs", "question_idx": 1138, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [10, 13], "binary_question": "Must Step 14 happen after Step 11?", "why_question": "Why must Step 14 happen after Step 11?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 14 happen after Step 11?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 14 can happen after Step 13 as it involves cooking the meatballs which are formed in Step 13.\"\n}\n```"}
{"plan_idx": 1139, "title": "chicken-prawn-and-rice-soup", "question_idx": 1139, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 10], "binary_question": "Must Step 11 happen after Step 3?", "why_question": "Why must Step 11 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 11 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 can happen independently of Step 3 as it involves preparing the rice separately from the prawn and chicken mixture.\"\n}\n```"}
{"plan_idx": 1140, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1140, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 10], "binary_question": "Must Step 11 happen after Step 2?", "why_question": "Why must Step 11 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 11 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 can be done at any time before assembling the shortcakes as it does not depend on the completion of Step 2.\"\n}\n```"}
{"plan_idx": 1141, "title": "spanish-rabbit-stew", "question_idx": 1141, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why must Step 6 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 6 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 must happen after Step 1 because the tarragon and bay leaf need to be added to the slow cooker with the other ingredients to ensure they release their flavor.\"\n}\n```"}
{"plan_idx": 1142, "title": "vegetable-terrine", "question_idx": 1142, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why must Step 3 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 3 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 3 must happen after Step 2 to stop the vegetables from cooking further.\"\n}\n```"}
{"plan_idx": 1143, "title": "green-tofu-curry", "question_idx": 1143, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 9], "binary_question": "Must Step 10 happen after Step 2?", "why_question": "Why must Step 10 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 10 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 involves mixing green curry paste into the coconut milk, which is independent of boiling the rice in Step 2.\"\n}\n```"}
{"plan_idx": 1144, "title": "chocolate-chocolate-cake", "question_idx": 1144, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [17, 18], "binary_question": "Must Step 19 happen after Step 18?", "why_question": "Why must Step 19 happen after Step 18?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 19 happen after Step 18?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 19 is an observation about the cake's baking process and does not need to follow Step 18.\"\n}\n```"}
{"plan_idx": 1145, "title": "spiced butternut squash soup", "question_idx": 1145, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 10], "binary_question": "Must Step 11 happen after Step 5?", "why_question": "Why must Step 11 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 11 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 involves cooking the potatoes in the stock, which is independent of removing the peel from the squash in Step 5.\"\n}\n```"}
{"plan_idx": 1146, "title": "chocolate-chocolate-cake", "question_idx": 1146, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 11], "binary_question": "Must Step 12 happen after Step 7?", "why_question": "Why must Step 12 happen after Step 7?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 12 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 12 involves beating egg whites, which is independent of the creaming process in Step 7.\"\n}\n```"}
{"plan_idx": 1147, "title": "chocolate-chocolate-cake", "question_idx": 1147, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 11], "binary_question": "Must Step 12 happen after Step 1?", "why_question": "Why must Step 12 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 12 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 12 involves beating egg whites and is independent of preheating the oven in Step 1.\"\n}\n```"}
{"plan_idx": 1148, "title": "chocolate-chocolate-cake", "question_idx": 1148, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 10], "binary_question": "Must Step 11 happen after Step 4?", "why_question": "Why must Step 11 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 11 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 can happen independently of Step 4 as they involve different mixtures.\"\n}\n```"}
{"plan_idx": 1149, "title": "fusilli-and-meatballs", "question_idx": 1149, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 13], "binary_question": "Must Step 14 happen after Step 6?", "why_question": "Why must Step 14 happen after Step 6?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 14 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 14 can happen independently of Step 6 as it involves preparing the meatballs, not the tomato sauce.\"\n}\n```"}
{"plan_idx": 1150, "title": "chocolate-chocolate-cake", "question_idx": 1150, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [9, 18], "binary_question": "Must Step 19 happen after Step 10?", "why_question": "Why must Step 19 happen after Step 10?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 19 happen after Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 19 is an observation about the cake's baking process and does not depend on Step 10.\"\n}\n```"}
{"plan_idx": 1151, "title": "vegetable-terrine", "question_idx": 1151, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 7], "binary_question": "Must Step 8 happen after Step 3?", "why_question": "Why must Step 8 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 8 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 8 must happen after Step 7, but it is not dependent on Step 3.\"\n}\n```"}
{"plan_idx": 1152, "title": "brown sugar shortbread", "question_idx": 1152, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why must Step 2 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\n1. Must Step 2 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Preheating the oven ensures it reaches the correct temperature by the time the dough is ready to be baked.\"\n}\n```"}
{"plan_idx": 1153, "title": "spiced-pumpkin-teabread", "question_idx": 1153, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 7], "binary_question": "Must Step 8 happen after Step 2?", "why_question": "Why must Step 8 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 8 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 8 involves adding the pumpkin mixture to the prepared tin, which must be lined in Step 2.\"\n}\n```"}
{"plan_idx": 1154, "title": "simple-basic-cupcakes", "question_idx": 1154, "steps": ["Preheat oven to 180 C / Gas 4.", "Beat butter and sugar together until light and fluffy.", "Add the eggs, one at a time, beating after each addition.", "If the batter is too thick, stir in some milk.", "Gradually add the flour, mixing well each time until evenly mixed.", "Spoon tablespoons of batter into a greased muffin tin.", "Bake in preheated oven for 15-20 minutes.", "The cake is done when a skewer inserted to the cake comes out clean.", "Let rest for fives minutes, then allow to cool fully on a wire rack.", "Decorate, if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why must Step 4 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: simple-basic-cupcakes\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Beat butter and sugar together until light and fluffy.\n3. Add the eggs, one at a time, beating after each addition.\n4. If the batter is too thick, stir in some milk.\n5. Gradually add the flour, mixing well each time until evenly mixed.\n6. Spoon tablespoons of batter into a greased muffin tin.\n7. Bake in preheated oven for 15-20 minutes.\n8. The cake is done when a skewer inserted to the cake comes out clean.\n9. Let rest for fives minutes, then allow to cool fully on a wire rack.\n10. Decorate, if desired.\n\n\n1. Must Step 4 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 involves adjusting the batter consistency, which can only be done after the initial mixing steps in Steps 2 and 3.\"\n}\n```"}
{"plan_idx": 1155, "title": "fusilli-and-meatballs", "question_idx": 1155, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [16, 18], "binary_question": "Must Step 19 happen after Step 17?", "why_question": "Why must Step 19 happen after Step 17?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 19 happen after Step 17?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 19 can happen independently of Step 17 as long as the pasta is ready by the time the meatballs and sauce are done.\"\n}\n```"}
{"plan_idx": 1156, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1156, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 10], "binary_question": "Must Step 11 happen after Step 5?", "why_question": "Why must Step 11 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 11 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 can be done at any time before assembling the shortcakes as it does not depend on the dough preparation.\"\n}\n```"}
{"plan_idx": 1157, "title": "lightly spiced tomato and red lentil soup", "question_idx": 1157, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 6], "binary_question": "Must Step 7 happen after Step 5?", "why_question": "Why must Step 7 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 7 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 can be done at any time while the soup is simmering, as it involves preparing the garnish separately.\"\n}\n```"}
{"plan_idx": 1158, "title": "fusilli-and-meatballs", "question_idx": 1158, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 11], "binary_question": "Must Step 12 happen after Step 7?", "why_question": "Why must Step 12 happen after Step 7?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 12 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 12 involves preparing the meatball mixture and can be done independently of bringing the tomato sauce to a boil in Step 7.\"\n}\n```"}
{"plan_idx": 1159, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1159, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 11], "binary_question": "Must Step 12 happen after Step 2?", "why_question": "Why must Step 12 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 12 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 12 does not depend on Step 2 and can be done independently.\"\n}\n```"}
{"plan_idx": 1160, "title": "vegetable-terrine", "question_idx": 1160, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 9], "binary_question": "Must Step 10 happen after Step 4?", "why_question": "Why must Step 10 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 10 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 is a recommendation about the type of mould to use and does not depend on the completion of Step 4.\"\n}\n```"}
{"plan_idx": 1161, "title": "almost no fat banana bread", "question_idx": 1161, "steps": ["Preheat oven to 180 C / Gas mark 4.", "Lightly grease a 20x10cm (8x4 in) loaf tin.", "In a large bowl, stir together flour, sugar, baking powder, bicarbonate of soda and cinnamon.", "Add egg whites, bananas and apple pur\u00c3\u00a9e; stir just until combined.", "Pour batter into prepared tin.", "Bake in preheated oven for 50 to 55 minutes, until a skewer inserted into centre of loaf comes out clean.", "Turn out onto wire rack and allow to cool before slicing."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why must Step 3 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almost no fat banana bread\n\nProcedure:\n1. Preheat oven to 180 C / Gas mark 4.\n2. Lightly grease a 20x10cm (8x4 in) loaf tin.\n3. In a large bowl, stir together flour, sugar, baking powder, bicarbonate of soda and cinnamon.\n4. Add egg whites, bananas and apple pur\u00c3\u00a9e; stir just until combined.\n5. Pour batter into prepared tin.\n6. Bake in preheated oven for 50 to 55 minutes, until a skewer inserted into centre of loaf comes out clean.\n7. Turn out onto wire rack and allow to cool before slicing.\n\n\n1. Must Step 3 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 3 can be done before preheating the oven as it involves mixing dry ingredients, which does not depend on the oven being preheated.\"\n}\n```"}
{"plan_idx": 1162, "title": "cloud-bread", "question_idx": 1162, "steps": ["Preheat oven to 150 C / Gas mark 2.", "Line a baking tray with baking paper.", "Mix cream cheese and egg yolks together until smooth.", "Place egg whites and baking powder in a glass, metal, or ceramic bowl;", "beat together until stiff peaks form.", "Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.", "Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.", "Bake in the preheated oven until golden brown, 17 to 20 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 3 happen after Step 2?", "why_question": "Why must Step 3 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cloud-bread\n\nProcedure:\n1. Preheat oven to 150 C / Gas mark 2.\n2. Line a baking tray with baking paper.\n3. Mix cream cheese and egg yolks together until smooth.\n4. Place egg whites and baking powder in a glass, metal, or ceramic bowl;\n5. beat together until stiff peaks form.\n6. Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.\n7. Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.\n8. Bake in the preheated oven until golden brown, 17 to 20 minutes.\n\n\n1. Must Step 3 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 3 does not depend on Step 2 and can be done independently.\"\n}\n```"}
{"plan_idx": 1163, "title": "very-vanilla-ry-cheesecake", "question_idx": 1163, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 6 happen after Step 3?", "why_question": "Why must Step 6 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 6 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 involves preparing the filling, which must be done after the crust is prepared in Step 3.\"\n}\n```"}
{"plan_idx": 1164, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1164, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why must Step 6 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 6 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 6 involves dividing the dough, which is unrelated to the preparation of strawberries in Step 1.\"\n}\n```"}
{"plan_idx": 1165, "title": "vegetable-terrine", "question_idx": 1165, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 5 happen after Step 3?", "why_question": "Why must Step 5 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 5 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 involves preparing the cream mixture which needs to be combined with the gelatin and sorrel after they are prepared in earlier steps.\"\n}\n```"}
{"plan_idx": 1166, "title": "fusilli-and-meatballs", "question_idx": 1166, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 15], "binary_question": "Must Step 16 happen after Step 7?", "why_question": "Why must Step 16 happen after Step 7?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 16 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 16 involves draining the meatballs after browning, which is independent of bringing the tomato sauce to a boil in Step 7.\"\n}\n```"}
{"plan_idx": 1167, "title": "spiced butternut squash soup", "question_idx": 1167, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 6], "binary_question": "Must Step 7 happen after Step 5?", "why_question": "Why must Step 7 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 7 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 involves cooking the onion, leek, and garlic in butter, which should be done after the squash is prepared and set aside in Step 6.\"\n}\n```"}
{"plan_idx": 1168, "title": "almond and apple cake", "question_idx": 1168, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 8], "binary_question": "Must Step 9 happen after Step 2?", "why_question": "Why must Step 9 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 9 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 9 involves mixing ingredients and does not depend on greasing the cake tin in Step 2.\"\n}\n```"}
{"plan_idx": 1169, "title": "spiced-pumpkin-teabread", "question_idx": 1169, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 6], "binary_question": "Must Step 7 happen after Step 4?", "why_question": "Why must Step 7 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 7 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 involves preparing the dry ingredients, which need to be combined with the pumpkin mixture prepared in Step 4.\"\n}\n```"}
{"plan_idx": 1170, "title": "fusilli-and-meatballs", "question_idx": 1170, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [9, 12], "binary_question": "Must Step 13 happen after Step 10?", "why_question": "Why must Step 13 happen after Step 10?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 13 happen after Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 13 can happen independently of Step 10 as shaping meatballs does not depend on adding basil and oregano to the sauce.\"\n}\n```"}
{"plan_idx": 1171, "title": "spiced butternut squash soup", "question_idx": 1171, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why must Step 3 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 3 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The oven needs to be preheated before placing the squash halves in it to ensure proper baking.\"\n}\n```"}
{"plan_idx": 1172, "title": "chicken-prawn-and-rice-soup", "question_idx": 1172, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [8, 9], "binary_question": "Must Step 10 happen after Step 9?", "why_question": "Why must Step 10 happen after Step 9?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 10 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 10 must happen after Step 9 because the rice needs to be browned and then added to the simmering soup.\"\n}\n```"}
{"plan_idx": 1173, "title": "no-sugar-rock-cakes", "question_idx": 1173, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 4 happen after Step 2?", "why_question": "Why must Step 4 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\n1. Must Step 4 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 4 involves mixing ingredients and does not depend on the baking tray being lined, so it can happen independently of Step 2.\"\n}\n```"}
{"plan_idx": 1174, "title": "fusilli-and-meatballs", "question_idx": 1174, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 10], "binary_question": "Must Step 11 happen after Step 3?", "why_question": "Why must Step 11 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 11 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 can happen independently of Step 3 as it involves processing bread into crumbs, which is unrelated to transferring the onion mixture.\"\n}\n```"}
{"plan_idx": 1175, "title": "spanish-rabbit-stew", "question_idx": 1175, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 9], "binary_question": "Must Step 10 happen after Step 2?", "why_question": "Why must Step 10 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 10 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 10 involves cooking the pasta, which should be done after the ingredients are already in the slow cooker and cooking.\"\n}\n```"}
{"plan_idx": 1176, "title": "curried bbq mussels", "question_idx": 1176, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 3 happen after Step 2?", "why_question": "Why must Step 3 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 3 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 3 can happen before Step 2 because arranging the foil sheets does not depend on the preparation of the curry mixture.\"\n}\n```"}
{"plan_idx": 1177, "title": "very-vanilla-ry-cheesecake", "question_idx": 1177, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 7], "binary_question": "Must Step 8 happen after Step 1?", "why_question": "Why must Step 8 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 8 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 8 involves preparing the cheesecake filling, which can be done independently of preheating the oven.\"\n}\n```"}
{"plan_idx": 1178, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 1178, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 7 happen after Step 6?", "why_question": "Why must Step 7 happen after Step 6?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\n1. Must Step 7 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 must happen after Step 6 because the peppers need to be mixed into the already prepared mushroom mixture.\"\n}\n```"}
{"plan_idx": 1179, "title": "spiced-pumpkin-teabread", "question_idx": 1179, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 6 happen after Step 5?", "why_question": "Why must Step 6 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 6 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 involves preparing the dry ingredients which need to be combined with the wet ingredients from Step 5.\"\n}\n```"}
{"plan_idx": 1180, "title": "chicken and vegetable pie", "question_idx": 1180, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 5 happen after Step 4?", "why_question": "Why must Step 5 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 5 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 involves cooking the onion in the same saucepan used in Step 4, which needs to be emptied first.\"\n}\n```"}
{"plan_idx": 1181, "title": "vegetable-terrine", "question_idx": 1181, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 9], "binary_question": "Must Step 10 happen after Step 5?", "why_question": "Why must Step 10 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 10 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 is a recommendation about the type of mould to use and can be considered at any point before pouring the mixture into the mould.\"\n}\n```"}
{"plan_idx": 1182, "title": "chicken and vegetable pie", "question_idx": 1182, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 7], "binary_question": "Must Step 8 happen after Step 1?", "why_question": "Why must Step 8 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 8 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 8 does not depend on Step 1 and can be done independently of preheating the oven.\"\n}\n```"}
{"plan_idx": 1183, "title": "green-tofu-curry", "question_idx": 1183, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 10], "binary_question": "Must Step 11 happen after Step 4?", "why_question": "Why must Step 11 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 11 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 involves preparing the curry sauce and is independent of the rice preparation in Step 4.\"\n}\n```"}
{"plan_idx": 1184, "title": "spanish-rabbit-stew", "question_idx": 1184, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 7], "binary_question": "Must Step 8 happen after Step 3?", "why_question": "Why must Step 8 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 8 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 8 is a humorous remark and not an actual step in the procedure.\"\n}\n```"}
{"plan_idx": 1185, "title": "fusilli-and-meatballs", "question_idx": 1185, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 14], "binary_question": "Must Step 15 happen after Step 5?", "why_question": "Why must Step 15 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 15 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 15 involves cooking the meatballs, which is independent of processing the tomatoes in Step 5.\"\n}\n```"}
{"plan_idx": 1186, "title": "chocolate-chocolate-cake", "question_idx": 1186, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [9, 14], "binary_question": "Must Step 15 happen after Step 10?", "why_question": "Why must Step 15 happen after Step 10?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 15 happen after Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 15 involves preparing the cake tin and can be done independently of mixing the ingredients in Step 10.\"\n}\n```"}
{"plan_idx": 1187, "title": "almond and apple cake", "question_idx": 1187, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 7 happen after Step 2?", "why_question": "Why must Step 7 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 7 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 involves adding ingredients to the mixture, which can be done independently of greasing the cake tin in Step 2.\"\n}\n```"}
{"plan_idx": 1188, "title": "chocolate-chocolate-cake", "question_idx": 1188, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [8, 13], "binary_question": "Must Step 14 happen after Step 9?", "why_question": "Why must Step 14 happen after Step 9?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 14 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 14 can be done at any time before Step 16 as it involves preparing the cake tin, not the batter.\"\n}\n```"}
{"plan_idx": 1189, "title": "green-tofu-curry", "question_idx": 1189, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 5], "binary_question": "Must Step 6 happen after Step 4?", "why_question": "Why must Step 6 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 6 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 6 can happen independently of Step 4 as they involve different components (tofu and rice) being prepared separately.\"\n}\n```"}
{"plan_idx": 1190, "title": "lightly spiced tomato and red lentil soup", "question_idx": 1190, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 7 happen after Step 6?", "why_question": "Why must Step 7 happen after Step 6?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 7 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 can be done at any time while the soup is simmering or even before, as it involves preparing the garnish separately.\"\n}\n```"}
{"plan_idx": 1191, "title": "spiced butternut squash soup", "question_idx": 1191, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 8], "binary_question": "Must Step 9 happen after Step 4?", "why_question": "Why must Step 9 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 9 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 9 involves adding chicken stock to the pot, which is independent of baking the squash in Step 4.\"\n}\n```"}
{"plan_idx": 1192, "title": "banana-split-cake", "question_idx": 1192, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 5], "binary_question": "Must Step 6 happen after Step 4?", "why_question": "Why must Step 6 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\n1. Must Step 6 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 involves preparing the filling that needs to be spread over the cooled base from Step 5.\"\n}\n```"}
{"plan_idx": 1193, "title": "spanish-rabbit-stew", "question_idx": 1193, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why must Step 5 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 5 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 involves adjusting the liquid levels to cover the ingredients, which can only be done after the ingredients are placed in the slow cooker in Step 1.\"\n}\n```"}
{"plan_idx": 1194, "title": "cranachan", "question_idx": 1194, "steps": ["Preheat the oven to 180 C / Gas mark 4.", "Spread oats out in a thin layer on a baking tray.", "Toast in the oven for about 10 minutes, or until lightly browned.", "Set aside to cool.", "Remove them from the tray for faster cooling.", "In a medium bowl, whip the cream to firm peaks.", "Gently fold in the icing sugar, vanilla and toasted oats.", "Spoon into 4 serving bowls, and top with fresh berries.", "For an extra touch, drizzle some whisky over each serving.", "Garnish with a mint leaf."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 5], "binary_question": "Must Step 6 happen after Step 4?", "why_question": "Why must Step 6 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cranachan\n\nProcedure:\n1. Preheat the oven to 180 C / Gas mark 4.\n2. Spread oats out in a thin layer on a baking tray.\n3. Toast in the oven for about 10 minutes, or until lightly browned.\n4. Set aside to cool.\n5. Remove them from the tray for faster cooling.\n6. In a medium bowl, whip the cream to firm peaks.\n7. Gently fold in the icing sugar, vanilla and toasted oats.\n8. Spoon into 4 serving bowls, and top with fresh berries.\n9. For an extra touch, drizzle some whisky over each serving.\n10. Garnish with a mint leaf.\n\n\n1. Must Step 6 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The toasted oats need to be cooled before being folded into the whipped cream to prevent melting the cream.\"\n}\n```"}
{"plan_idx": 1195, "title": "very-vanilla-ry-cheesecake", "question_idx": 1195, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why must Step 3 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 3 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 requires the crumbs which are prepared in Step 2, and Step 2 follows Step 1.\"\n}\n```"}
{"plan_idx": 1196, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1196, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why must Step 4 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 4 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 4 does not depend on Step 1 and can be done independently.\"\n}\n```"}
{"plan_idx": 1197, "title": "chicken and vegetable pie", "question_idx": 1197, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 9], "binary_question": "Must Step 10 happen after Step 7?", "why_question": "Why must Step 10 happen after Step 7?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 10 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 can be done at any time before Step 11 as it involves preparing the pie dish, which does not depend on the liquid mixture being ready.\"\n}\n```"}
{"plan_idx": 1198, "title": "chocolate-pancake-batter", "question_idx": 1198, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 5 happen after Step 4?", "why_question": "Why must Step 5 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 5 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 involves heating the pan, which should be done after the batter has rested for optimal results.\"\n}\n```"}
{"plan_idx": 1199, "title": "balsamic-and-mozzarella-chicken", "question_idx": 1199, "steps": ["Place chicken in a shallow dish or large resealable plastic bag.", "Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.", "Coat a large frying pan lightly with oil, and set over low heat.", "Remove the chicken from the marinade and discard the marinade.", "Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.", "Arrange chicken on a serving platter.", "Place a generous slice of fresh mozzarella on top of each piece.", "Place a leaf of basil on top of the cheese, and cover with a slice of tomato.", "Drizzle balsamic vinegar over the platter, then season with salt and pepper.", "Serve!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 3 happen after Step 2?", "why_question": "Why must Step 3 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: balsamic-and-mozzarella-chicken\n\nProcedure:\n1. Place chicken in a shallow dish or large resealable plastic bag.\n2. Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.\n3. Coat a large frying pan lightly with oil, and set over low heat.\n4. Remove the chicken from the marinade and discard the marinade.\n5. Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.\n6. Arrange chicken on a serving platter.\n7. Place a generous slice of fresh mozzarella on top of each piece.\n8. Place a leaf of basil on top of the cheese, and cover with a slice of tomato.\n9. Drizzle balsamic vinegar over the platter, then season with salt and pepper.\n10. Serve!\n\n\n1. Must Step 3 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 involves preparing the frying pan for cooking, which must be done after the chicken has been marinated in Step 2.\"\n}\n```"}
{"plan_idx": 1200, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1200, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 12], "binary_question": "Must Step 13 happen after Step 6?", "why_question": "Why must Step 13 happen after Step 6?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 13 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 13 can be done independently of Step 6 as it involves preparing the whipped cream, which does not affect the dough preparation.\"\n}\n```"}
{"plan_idx": 1201, "title": "spiced-pumpkin-teabread", "question_idx": 1201, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 7 happen after Step 1?", "why_question": "Why must Step 7 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 7 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 does not depend on the oven being preheated, so it can happen independently of Step 1.\"\n}\n```"}
{"plan_idx": 1202, "title": "tangy-gammon-in-cider", "question_idx": 1202, "steps": ["Preheat the oven to 200 degrees /gas mark 6.", "Start by piercing each tomato once and covering with boiling water to loosen the skins.", "Drain the onions and chop each one in half.", "Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.", "Put the onions, tomatoes and apples into a casserole dish.", "Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.", "Place in the dish and repeat with the other gammon steaks.", "Pour cider over the steaks, cover the top with a lid or tin foil.", "Cook for 1 hour."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why must Step 5 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tangy-gammon-in-cider\n\nProcedure:\n1. Preheat the oven to 200 degrees /gas mark 6.\n2. Start by piercing each tomato once and covering with boiling water to loosen the skins.\n3. Drain the onions and chop each one in half.\n4. Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.\n5. Put the onions, tomatoes and apples into a casserole dish.\n6. Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.\n7. Place in the dish and repeat with the other gammon steaks.\n8. Pour cider over the steaks, cover the top with a lid or tin foil.\n9. Cook for 1 hour.\n\n\n1. Must Step 5 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 5 does not depend on Step 1 and can be done independently.\"\n}\n```"}
{"plan_idx": 1203, "title": "chicken-prawn-and-rice-soup", "question_idx": 1203, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 10], "binary_question": "Must Step 11 happen after Step 2?", "why_question": "Why must Step 11 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 11 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 does not depend on Step 2 and can be done independently.\"\n}\n```"}
{"plan_idx": 1204, "title": "fusilli-and-meatballs", "question_idx": 1204, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [8, 10], "binary_question": "Must Step 11 happen after Step 9?", "why_question": "Why must Step 11 happen after Step 9?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 11 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 can happen independently of Step 9 as it involves preparing bread crumbs, which does not depend on the simmering of the sauce.\"\n}\n```"}
{"plan_idx": 1205, "title": "chocolate-chocolate-cake", "question_idx": 1205, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 7], "binary_question": "Must Step 8 happen after Step 2?", "why_question": "Why must Step 8 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 8 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 8 involves beating egg yolks into the butter and sugar mixture, which is independent of placing chocolate chips, coffee, and water in a microwave safe bowl in Step 2.\"\n}\n```"}
{"plan_idx": 1206, "title": "spiced-guava-cake", "question_idx": 1206, "steps": ["Preheat oven to 180 C / Gas 4.", "Grease and flour one 23x13cm loaf tin.", "Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.", "In another bowl, mix together guava pulp and juice.", "In another bowl, cream together butter and sugar.", "Add eggs, one at a time.", "Add flour mixture and guava mixture alternately to creamed mixture.", "Pour batter into prepared tin.", "Bake at 180 C / Gas 4 for 30-35 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why must Step 4 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-guava-cake\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Grease and flour one 23x13cm loaf tin.\n3. Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.\n4. In another bowl, mix together guava pulp and juice.\n5. In another bowl, cream together butter and sugar.\n6. Add eggs, one at a time.\n7. Add flour mixture and guava mixture alternately to creamed mixture.\n8. Pour batter into prepared tin.\n9. Bake at 180 C / Gas 4 for 30-35 minutes.\n\n\n1. Must Step 4 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 4 does not depend on Step 1 and can be done independently.\"\n}\n```"}
{"plan_idx": 1207, "title": "kid-s-cheese-and-veg-kebab", "question_idx": 1207, "steps": ["Shave the carrots into wide ribbons / waves using a potato peeler.", "Cut the red pepper into star shapes using a star cookie cutter.", "Cut the bread into flowers using a cookie cutter.", "Assemble all onto a skewer with bread flowers top and bottom and carrot curls, cheesy chunks and pepper stars seen as layers between."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why must Step 2 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: kid-s-cheese-and-veg-kebab\n\nProcedure:\n1. Shave the carrots into wide ribbons / waves using a potato peeler.\n2. Cut the red pepper into star shapes using a star cookie cutter.\n3. Cut the bread into flowers using a cookie cutter.\n4. Assemble all onto a skewer with bread flowers top and bottom and carrot curls, cheesy chunks and pepper stars seen as layers between.\n\n\n1. Must Step 2 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Steps 1 and 2 are independent and can be done in any order.\"\n}\n```"}
{"plan_idx": 1208, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1208, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [10, 12], "binary_question": "Must Step 13 happen after Step 11?", "why_question": "Why must Step 13 happen after Step 11?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 13 happen after Step 11?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 13 does not depend on Step 11 and can be done independently.\"\n}\n```"}
{"plan_idx": 1209, "title": "chocolate-chocolate-cake", "question_idx": 1209, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 8], "binary_question": "Must Step 9 happen after Step 4?", "why_question": "Why must Step 9 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 9 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 9 involves adding flour to the mixture, which must be done after the chocolate mixture has cooled and been set aside in Step 5.\"\n}\n```"}
{"plan_idx": 1210, "title": "brown sugar shortbread", "question_idx": 1210, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why must Step 5 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\n1. Must Step 5 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 must happen after Step 1 because the board needs to be prepared with flour before kneading the dough, which occurs after mixing the ingredients.\"\n}\n```"}
{"plan_idx": 1211, "title": "spiced butternut squash soup", "question_idx": 1211, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 7], "binary_question": "Must Step 8 happen after Step 1?", "why_question": "Why must Step 8 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 8 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 8 involves saut\u00e9ing ingredients which need to be added to the soup after the squash is baked and set aside in earlier steps.\"\n}\n```"}
{"plan_idx": 1212, "title": "fusilli-and-meatballs", "question_idx": 1212, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [9, 11], "binary_question": "Must Step 12 happen after Step 10?", "why_question": "Why must Step 12 happen after Step 10?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 12 happen after Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 12 involves preparing the meatball mixture and does not depend on the timing of adding basil and oregano to the sauce in Step 10.\"\n}\n```"}
{"plan_idx": 1213, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1213, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 7], "binary_question": "Must Step 8 happen after Step 1?", "why_question": "Why must Step 8 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 8 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 8 involves placing the dough on a baking tray, which is independent of combining strawberries and sugar in Step 1.\"\n}\n```"}
{"plan_idx": 1214, "title": "spiced butternut squash soup", "question_idx": 1214, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 8], "binary_question": "Must Step 9 happen after Step 5?", "why_question": "Why must Step 9 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 9 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 9 involves adding chicken stock to the pot, which requires the pot to be prepared with saut\u00e9ed ingredients from Step 8, and Step 8 must follow Step 7, which in turn follows Step 6.\"\n}\n```"}
{"plan_idx": 1215, "title": "spanish-rabbit-stew", "question_idx": 1215, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 10], "binary_question": "Must Step 11 happen after Step 6?", "why_question": "Why must Step 11 happen after Step 6?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 11 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 is about enjoying the meal, which should happen after the entire cooking process is complete, not just after Step 6.\"\n}\n```"}
{"plan_idx": 1216, "title": "vegetable-terrine", "question_idx": 1216, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 9], "binary_question": "Must Step 10 happen after Step 7?", "why_question": "Why must Step 10 happen after Step 7?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 10 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 is a recommendation about the type of mould to use and can be considered at any point before pouring the mixture into the mould.\"\n}\n```"}
{"plan_idx": 1217, "title": "cranachan", "question_idx": 1217, "steps": ["Preheat the oven to 180 C / Gas mark 4.", "Spread oats out in a thin layer on a baking tray.", "Toast in the oven for about 10 minutes, or until lightly browned.", "Set aside to cool.", "Remove them from the tray for faster cooling.", "In a medium bowl, whip the cream to firm peaks.", "Gently fold in the icing sugar, vanilla and toasted oats.", "Spoon into 4 serving bowls, and top with fresh berries.", "For an extra touch, drizzle some whisky over each serving.", "Garnish with a mint leaf."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why must Step 6 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cranachan\n\nProcedure:\n1. Preheat the oven to 180 C / Gas mark 4.\n2. Spread oats out in a thin layer on a baking tray.\n3. Toast in the oven for about 10 minutes, or until lightly browned.\n4. Set aside to cool.\n5. Remove them from the tray for faster cooling.\n6. In a medium bowl, whip the cream to firm peaks.\n7. Gently fold in the icing sugar, vanilla and toasted oats.\n8. Spoon into 4 serving bowls, and top with fresh berries.\n9. For an extra touch, drizzle some whisky over each serving.\n10. Garnish with a mint leaf.\n\n\n1. Must Step 6 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 6 does not depend on Step 1 and can be done independently.\"\n}\n```"}
{"plan_idx": 1218, "title": "spiced-pumpkin-teabread", "question_idx": 1218, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 3 happen after Step 2?", "why_question": "Why must Step 3 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 3 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen after Step 2 because the pumpkin needs to be prepared and mashed before it can be added to the mixture in the lined loaf tin.\"\n}\n```"}
{"plan_idx": 1219, "title": "tortellini-fritto-with-almond-butter", "question_idx": 1219, "steps": ["Bring a saucepan of water to the boil.", "Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.", "In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.", "If you slightly undercooked your tortellini then it's less likely to stick to the pan.", "Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.", "Continue to gently fry and stir the tortellini until golden brown.", "Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.", "Enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 7], "binary_question": "Must Step 8 happen after Step 1?", "why_question": "Why must Step 8 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tortellini-fritto-with-almond-butter\n\nProcedure:\n1. Bring a saucepan of water to the boil.\n2. Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.\n3. In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.\n4. If you slightly undercooked your tortellini then it's less likely to stick to the pan.\n5. Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.\n6. Continue to gently fry and stir the tortellini until golden brown.\n7. Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.\n8. Enjoy!\n\n\n1. Must Step 8 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 8 is the final step and involves enjoying the dish, which can only happen after the tortellini is prepared and served.\"\n}\n```"}
{"plan_idx": 1220, "title": "spanish-rabbit-stew", "question_idx": 1220, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 7], "binary_question": "Must Step 8 happen after Step 1?", "why_question": "Why must Step 8 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 8 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 8 refers to the smell filling the room, which can only happen after the ingredients have been cooking for some time.\"\n}\n```"}
{"plan_idx": 1221, "title": "chicken and vegetable pie", "question_idx": 1221, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 7], "binary_question": "Must Step 8 happen after Step 4?", "why_question": "Why must Step 8 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 8 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 8 must happen after Step 4 because the chicken and vegetables need to be cooked and set aside before the liquid mixture is prepared and thickened.\"\n}\n```"}
{"plan_idx": 1222, "title": "cranachan", "question_idx": 1222, "steps": ["Preheat the oven to 180 C / Gas mark 4.", "Spread oats out in a thin layer on a baking tray.", "Toast in the oven for about 10 minutes, or until lightly browned.", "Set aside to cool.", "Remove them from the tray for faster cooling.", "In a medium bowl, whip the cream to firm peaks.", "Gently fold in the icing sugar, vanilla and toasted oats.", "Spoon into 4 serving bowls, and top with fresh berries.", "For an extra touch, drizzle some whisky over each serving.", "Garnish with a mint leaf."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why must Step 2 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cranachan\n\nProcedure:\n1. Preheat the oven to 180 C / Gas mark 4.\n2. Spread oats out in a thin layer on a baking tray.\n3. Toast in the oven for about 10 minutes, or until lightly browned.\n4. Set aside to cool.\n5. Remove them from the tray for faster cooling.\n6. In a medium bowl, whip the cream to firm peaks.\n7. Gently fold in the icing sugar, vanilla and toasted oats.\n8. Spoon into 4 serving bowls, and top with fresh berries.\n9. For an extra touch, drizzle some whisky over each serving.\n10. Garnish with a mint leaf.\n\n\n1. Must Step 2 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The oven needs to be preheated before toasting the oats to ensure they cook evenly and properly.\"\n}\n```"}
{"plan_idx": 1223, "title": "spicy-tomato-anchovy-pasta", "question_idx": 1223, "steps": ["Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;", "cook until lightly browned.", "Add anchovies and water, cover and simmer for 4 to 5 minutes.", "Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.", "While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.", "Add linguine and cook until al dente, about 7 to 8 minutes;", "drain.", "Toss with anchovy mixture and chilli flakes.", "If desired, season with black pepper.", "Serve immediately."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why must Step 6 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spicy-tomato-anchovy-pasta\n\nProcedure:\n1. Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;\n2. cook until lightly browned.\n3. Add anchovies and water, cover and simmer for 4 to 5 minutes.\n4. Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.\n5. While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.\n6. Add linguine and cook until al dente, about 7 to 8 minutes;\n7. drain.\n8. Toss with anchovy mixture and chilli flakes.\n9. If desired, season with black pepper.\n10. Serve immediately.\n\n\n1. Must Step 6 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 6 can happen independently of Step 2 as long as the linguine is ready to be tossed with the anchovy mixture at the end.\"\n}\n```"}
{"plan_idx": 1224, "title": "fusilli-and-meatballs", "question_idx": 1224, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [8, 11], "binary_question": "Must Step 12 happen after Step 9?", "why_question": "Why must Step 12 happen after Step 9?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 12 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 12 can happen independently of Step 9 as it involves preparing the meatball mixture, which does not depend on the tomato sauce simmering.\"\n}\n```"}
{"plan_idx": 1225, "title": "chocolate-chocolate-cake", "question_idx": 1225, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 14], "binary_question": "Must Step 15 happen after Step 8?", "why_question": "Why must Step 15 happen after Step 8?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 15 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 15 involves preparing the cake tin and does not depend on the mixing of ingredients in Step 8.\"\n}\n```"}
{"plan_idx": 1226, "title": "fusilli-and-meatballs", "question_idx": 1226, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 5], "binary_question": "Must Step 6 happen after Step 4?", "why_question": "Why must Step 6 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 6 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 involves adding the processed tomatoes to the saucepan, which requires the onion mixture to be set aside in Step 4.\"\n}\n```"}
{"plan_idx": 1227, "title": "chocolate-chocolate-cake", "question_idx": 1227, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 8], "binary_question": "Must Step 9 happen after Step 1?", "why_question": "Why must Step 9 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 9 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 9 involves adding flour to the mixture, which requires the earlier steps to be completed first.\"\n}\n```"}
{"plan_idx": 1228, "title": "strawberry-tiramisu-trifle", "question_idx": 1228, "steps": ["Set 3 strawberries for the garnish aside, and cut the rest into slices.", "In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.", "Then stir in the custard and finally fold in the whipped cream.", "Brush the sponge fingers with the remaining coffee.", "Line a glass bowl with one layer of the soaked sponge fingers.", "Spread half of the strawberries over the sponge fingers.", "Sprinkle half of the grated chocolate over that and then half of the custard mixture.", "Repeat the layers in order again.", "Cut the remaining 3 strawberries in half and lay them on top of the trifle.", "Cover and leave in the fridge for at least 4 hours, best overnight."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why must Step 2 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberry-tiramisu-trifle\n\nProcedure:\n1. Set 3 strawberries for the garnish aside, and cut the rest into slices.\n2. In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.\n3. Then stir in the custard and finally fold in the whipped cream.\n4. Brush the sponge fingers with the remaining coffee.\n5. Line a glass bowl with one layer of the soaked sponge fingers.\n6. Spread half of the strawberries over the sponge fingers.\n7. Sprinkle half of the grated chocolate over that and then half of the custard mixture.\n8. Repeat the layers in order again.\n9. Cut the remaining 3 strawberries in half and lay them on top of the trifle.\n10. Cover and leave in the fridge for at least 4 hours, best overnight.\n\n\n1. Must Step 2 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen after Step 1 because Step 1 involves preparing the strawberries, which are needed for later steps, while Step 2 involves preparing the cream cheese mixture.\"\n}\n```"}
{"plan_idx": 1229, "title": "spiced butternut squash soup", "question_idx": 1229, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why must Step 2 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 2 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen after Step 1 because the oven needs to be preheated before baking the squash.\"\n}\n```"}
{"plan_idx": 1230, "title": "spiced butternut squash soup", "question_idx": 1230, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 9], "binary_question": "Must Step 10 happen after Step 4?", "why_question": "Why must Step 10 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 10 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 involves boiling potatoes in chicken stock, which is independent of baking the squash in Step 4.\"\n}\n```"}
{"plan_idx": 1231, "title": "very-vanilla-ry-cheesecake", "question_idx": 1231, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 9], "binary_question": "Must Step 10 happen after Step 5?", "why_question": "Why must Step 10 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 10 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 can be done independently of Step 5 as it involves preparing the oven environment, not the cheesecake mixture or base.\"\n}\n```"}
{"plan_idx": 1232, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 1232, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 7 happen after Step 2?", "why_question": "Why must Step 7 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\n1. Must Step 7 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 involves preparing the roasted red peppers which are mixed into the mushrooms after they are cooked and seasoned in earlier steps.\"\n}\n```"}
{"plan_idx": 1233, "title": "busters-liver-dinner", "question_idx": 1233, "steps": ["Put all ingredients into a slow cooker, mix together.", "Put slow cooker on high for 4 to 5 hours or low all day.", "( If mixture starts to look too dry just add a little hot water.", ")", "Once cooked, divide between several plastic microwaveable tubs with lids.", "This mixture usually makes 6 to 7 meals, I freeze 4 and put the rest in the fridge.", "When ready to eat microwave with lid half off for 2 to 3 minutes on medium high."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 4 happen after Step 3?", "why_question": "Why must Step 4 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: busters-liver-dinner\n\nProcedure:\n1. Put all ingredients into a slow cooker, mix together.\n2. Put slow cooker on high for 4 to 5 hours or low all day.\n3. ( If mixture starts to look too dry just add a little hot water.\n4. )\n5. Once cooked, divide between several plastic microwaveable tubs with lids.\n6. This mixture usually makes 6 to 7 meals, I freeze 4 and put the rest in the fridge.\n7. When ready to eat microwave with lid half off for 2 to 3 minutes on medium high.\n\n\n1. Must Step 4 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 is the closing parenthesis for the conditional statement in Step 3, so it must follow Step 3.\"\n}\n```"}
{"plan_idx": 1234, "title": "chicken and vegetable pie", "question_idx": 1234, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 8], "binary_question": "Must Step 9 happen after Step 3?", "why_question": "Why must Step 9 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 9 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 9 must happen after Step 8, not necessarily after Step 3.\"\n}\n```"}
{"plan_idx": 1235, "title": "fusilli-and-meatballs", "question_idx": 1235, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [17, 18], "binary_question": "Must Step 19 happen after Step 18?", "why_question": "Why must Step 19 happen after Step 18?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 19 happen after Step 18?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 19 can happen concurrently with Step 18 as long as the pasta is ready by the time the meatballs and sauce are done.\"\n}\n```"}
{"plan_idx": 1236, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1236, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 13], "binary_question": "Must Step 14 happen after Step 1?", "why_question": "Why must Step 14 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 14 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 14 must happen after Step 1 because the strawberries need time to macerate in the sugar before being used in the assembly of the shortcakes.\"\n}\n```"}
{"plan_idx": 1237, "title": "fusilli-and-meatballs", "question_idx": 1237, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 5 happen after Step 4?", "why_question": "Why must Step 5 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 5 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 involves processing the tomatoes which are then added to the saucepan in Step 6, so it must follow the previous steps to ensure the sequence is correct.\"\n}\n```"}
{"plan_idx": 1238, "title": "chocolate-chocolate-cake", "question_idx": 1238, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [11, 14], "binary_question": "Must Step 15 happen after Step 12?", "why_question": "Why must Step 15 happen after Step 12?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 15 happen after Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 15 involves preparing the cake tin and can be done independently of beating the egg whites in Step 12.\"\n}\n```"}
{"plan_idx": 1239, "title": "chocolate-chocolate-cake", "question_idx": 1239, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why must Step 2 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 2 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 involves preparing ingredients that will be used in the baking process, which requires the oven to be preheated in Step 1.\"\n}\n```"}
{"plan_idx": 1240, "title": "busters-liver-dinner", "question_idx": 1240, "steps": ["Put all ingredients into a slow cooker, mix together.", "Put slow cooker on high for 4 to 5 hours or low all day.", "( If mixture starts to look too dry just add a little hot water.", ")", "Once cooked, divide between several plastic microwaveable tubs with lids.", "This mixture usually makes 6 to 7 meals, I freeze 4 and put the rest in the fridge.", "When ready to eat microwave with lid half off for 2 to 3 minutes on medium high."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why must Step 4 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: busters-liver-dinner\n\nProcedure:\n1. Put all ingredients into a slow cooker, mix together.\n2. Put slow cooker on high for 4 to 5 hours or low all day.\n3. ( If mixture starts to look too dry just add a little hot water.\n4. )\n5. Once cooked, divide between several plastic microwaveable tubs with lids.\n6. This mixture usually makes 6 to 7 meals, I freeze 4 and put the rest in the fridge.\n7. When ready to eat microwave with lid half off for 2 to 3 minutes on medium high.\n\n\n1. Must Step 4 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 4 is a continuation of Step 3 and does not need to happen after Step 1.\"\n}\n```"}
{"plan_idx": 1241, "title": "chocolate-chocolate-cake", "question_idx": 1241, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 5], "binary_question": "Must Step 6 happen after Step 4?", "why_question": "Why must Step 6 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 6 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 involves preparing the butter and margarine mixture which needs to be combined with the cooled chocolate mixture from Step 5.\"\n}\n```"}
{"plan_idx": 1242, "title": "almond and apple cake", "question_idx": 1242, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why must Step 3 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 3 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The oven needs to be preheated before the cake tin is prepared to ensure it reaches the correct temperature by the time the batter is ready.\"\n}\n```"}
{"plan_idx": 1243, "title": "chocolate-pancake-batter", "question_idx": 1243, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 5], "binary_question": "Must Step 6 happen after Step 4?", "why_question": "Why must Step 6 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 6 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 involves preparing the pan for cooking, which should happen after the batter has rested in Step 4.\"\n}\n```"}
{"plan_idx": 1244, "title": "brown sugar shortbread", "question_idx": 1244, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 7 happen after Step 1?", "why_question": "Why must Step 7 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\n1. Must Step 7 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 involves rolling the dough, which can only be done after the dough is prepared in the previous steps.\"\n}\n```"}
{"plan_idx": 1245, "title": "spiced butternut squash soup", "question_idx": 1245, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 10], "binary_question": "Must Step 11 happen after Step 2?", "why_question": "Why must Step 11 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 11 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 11 involves cooking the potatoes in the chicken stock, which is added in Step 9, and the squash needs to be prepared and set aside in earlier steps.\"\n}\n```"}
{"plan_idx": 1246, "title": "simple-basic-cupcakes", "question_idx": 1246, "steps": ["Preheat oven to 180 C / Gas 4.", "Beat butter and sugar together until light and fluffy.", "Add the eggs, one at a time, beating after each addition.", "If the batter is too thick, stir in some milk.", "Gradually add the flour, mixing well each time until evenly mixed.", "Spoon tablespoons of batter into a greased muffin tin.", "Bake in preheated oven for 15-20 minutes.", "The cake is done when a skewer inserted to the cake comes out clean.", "Let rest for fives minutes, then allow to cool fully on a wire rack.", "Decorate, if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why must Step 5 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: simple-basic-cupcakes\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Beat butter and sugar together until light and fluffy.\n3. Add the eggs, one at a time, beating after each addition.\n4. If the batter is too thick, stir in some milk.\n5. Gradually add the flour, mixing well each time until evenly mixed.\n6. Spoon tablespoons of batter into a greased muffin tin.\n7. Bake in preheated oven for 15-20 minutes.\n8. The cake is done when a skewer inserted to the cake comes out clean.\n9. Let rest for fives minutes, then allow to cool fully on a wire rack.\n10. Decorate, if desired.\n\n\n1. Must Step 5 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 involves adding flour to the batter, which requires the batter to be prepared in the previous steps, and the oven needs to be preheated in Step 1 to ensure it reaches the correct temperature by the time the batter is ready.\"\n}\n```"}
{"plan_idx": 1247, "title": "butternut-squash-pastry-for-pies", "question_idx": 1247, "steps": ["Place the flour, egg and squash into the container of a food processor.", "Pulse until mixed into a doughy ball.", "You may need to add a little extra flour.", "Divide into two equal parts.", "Use in a pie or pastie recipe."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 3 happen after Step 2?", "why_question": "Why must Step 3 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: butternut-squash-pastry-for-pies\n\nProcedure:\n1. Place the flour, egg and squash into the container of a food processor.\n2. Pulse until mixed into a doughy ball.\n3. You may need to add a little extra flour.\n4. Divide into two equal parts.\n5. Use in a pie or pastie recipe.\n\n\n1. Must Step 3 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen after Step 2 because you need to see if the mixture forms a doughy ball before deciding if extra flour is needed.\"\n}\n```"}
{"plan_idx": 1248, "title": "chicken and vegetable pie", "question_idx": 1248, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why must Step 6 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 6 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 involves making a sauce that will be poured over the chicken mixture, which is prepared in Step 2.\"\n}\n```"}
{"plan_idx": 1249, "title": "fusilli-and-meatballs", "question_idx": 1249, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [11, 18], "binary_question": "Must Step 19 happen after Step 12?", "why_question": "Why must Step 19 happen after Step 12?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 19 happen after Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 19 can happen independently of Step 12 as it involves cooking the pasta, which is not directly related to mixing the meatball ingredients.\"\n}\n```"}
{"plan_idx": 1250, "title": "spanish-rabbit-stew", "question_idx": 1250, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 8], "binary_question": "Must Step 9 happen after Step 8?", "why_question": "Why must Step 9 happen after Step 8?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 9 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 9 can happen before Step 8 as it involves seasoning the stew, which can be done before serving.\"\n}\n```"}
{"plan_idx": 1251, "title": "sardine spread", "question_idx": 1251, "steps": ["Place the sardines in a bowl and roughly mash with a fork.", "Add in all of the remaining ingredients and stir well.", "Enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 3 happen after Step 2?", "why_question": "Why must Step 3 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: sardine spread\n\nProcedure:\n1. Place the sardines in a bowl and roughly mash with a fork.\n2. Add in all of the remaining ingredients and stir well.\n3. Enjoy!\n\n\n1. Must Step 3 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen after Step 2 because you need to mix all the ingredients together before you can enjoy the sardine spread.\"\n}\n```"}
{"plan_idx": 1252, "title": "spiced butternut squash soup", "question_idx": 1252, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 10], "binary_question": "Must Step 11 happen after Step 1?", "why_question": "Why must Step 11 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 11 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 11 involves cooking the potatoes in the chicken stock, which requires the preparation steps in Steps 1-10 to be completed first.\"\n}\n```"}
{"plan_idx": 1253, "title": "chocolate-chocolate-cake", "question_idx": 1253, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [9, 11], "binary_question": "Must Step 12 happen after Step 10?", "why_question": "Why must Step 12 happen after Step 10?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 12 happen after Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 12 must happen after Step 10 because the egg whites need to be folded into the chocolate mixture, which is prepared in Step 10.\"\n}\n```"}
{"plan_idx": 1254, "title": "chocolate-chocolate-cake", "question_idx": 1254, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [18, 20], "binary_question": "Must Step 21 happen after Step 19?", "why_question": "Why must Step 21 happen after Step 19?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 21 happen after Step 19?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 21 involves removing the cake from the tin, which can only be done after the cake has set and cooled for 10 minutes as described in Step 19.\"\n}\n```"}
{"plan_idx": 1255, "title": "almond and apple cake", "question_idx": 1255, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 9], "binary_question": "Must Step 10 happen after Step 8?", "why_question": "Why must Step 10 happen after Step 8?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 10 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 10 involves arranging the apple in the tin, which must be done before adding the cake mixture in Step 11.\"\n}\n```"}
{"plan_idx": 1256, "title": "tortellini-fritto-with-almond-butter", "question_idx": 1256, "steps": ["Bring a saucepan of water to the boil.", "Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.", "In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.", "If you slightly undercooked your tortellini then it's less likely to stick to the pan.", "Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.", "Continue to gently fry and stir the tortellini until golden brown.", "Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.", "Enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 6], "binary_question": "Must Step 7 happen after Step 4?", "why_question": "Why must Step 7 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tortellini-fritto-with-almond-butter\n\nProcedure:\n1. Bring a saucepan of water to the boil.\n2. Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.\n3. In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.\n4. If you slightly undercooked your tortellini then it's less likely to stick to the pan.\n5. Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.\n6. Continue to gently fry and stir the tortellini until golden brown.\n7. Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.\n8. Enjoy!\n\n\n1. Must Step 7 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 involves serving the tortellini, which can only happen after the cooking process in Step 4 is completed.\"\n}\n```"}
{"plan_idx": 1257, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1257, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 9], "binary_question": "Must Step 10 happen after Step 1?", "why_question": "Why must Step 10 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 10 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 involves cooling the baked shortcakes, which is independent of the preparation of strawberries in Step 1.\"\n}\n```"}
{"plan_idx": 1258, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1258, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why must Step 2 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 2 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 2 involves preparing the dry ingredients for the shortcakes, which can be done independently of Step 1 where strawberries are being prepared and refrigerated.\"\n}\n```"}
{"plan_idx": 1259, "title": "chocolate-chocolate-cake", "question_idx": 1259, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [10, 18], "binary_question": "Must Step 19 happen after Step 11?", "why_question": "Why must Step 19 happen after Step 11?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 19 happen after Step 11?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 19 is an observation about the cake's baking process and does not depend on Step 11.\"\n}\n```"}
{"plan_idx": 1260, "title": "almost no fat banana bread", "question_idx": 1260, "steps": ["Preheat oven to 180 C / Gas mark 4.", "Lightly grease a 20x10cm (8x4 in) loaf tin.", "In a large bowl, stir together flour, sugar, baking powder, bicarbonate of soda and cinnamon.", "Add egg whites, bananas and apple pur\u00c3\u00a9e; stir just until combined.", "Pour batter into prepared tin.", "Bake in preheated oven for 50 to 55 minutes, until a skewer inserted into centre of loaf comes out clean.", "Turn out onto wire rack and allow to cool before slicing."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 4 happen after Step 2?", "why_question": "Why must Step 4 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almost no fat banana bread\n\nProcedure:\n1. Preheat oven to 180 C / Gas mark 4.\n2. Lightly grease a 20x10cm (8x4 in) loaf tin.\n3. In a large bowl, stir together flour, sugar, baking powder, bicarbonate of soda and cinnamon.\n4. Add egg whites, bananas and apple pur\u00c3\u00a9e; stir just until combined.\n5. Pour batter into prepared tin.\n6. Bake in preheated oven for 50 to 55 minutes, until a skewer inserted into centre of loaf comes out clean.\n7. Turn out onto wire rack and allow to cool before slicing.\n\n\n1. Must Step 4 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 4 does not depend on Step 2 and can be done independently.\"\n}\n```"}
{"plan_idx": 1261, "title": "brown sugar shortbread", "question_idx": 1261, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why must Step 3 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\n1. Must Step 3 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 involves adding flour to the creamed butter and sugar, which requires the mixture prepared in Step 2.\"\n}\n```"}
{"plan_idx": 1262, "title": "chocolate-chocolate-cake", "question_idx": 1262, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [15, 18], "binary_question": "Must Step 19 happen after Step 16?", "why_question": "Why must Step 19 happen after Step 16?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 19 happen after Step 16?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 19 is an observation about the cake's baking process and does not need to follow Step 16 directly.\"\n}\n```"}
{"plan_idx": 1263, "title": "tangy-gammon-in-cider", "question_idx": 1263, "steps": ["Preheat the oven to 200 degrees /gas mark 6.", "Start by piercing each tomato once and covering with boiling water to loosen the skins.", "Drain the onions and chop each one in half.", "Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.", "Put the onions, tomatoes and apples into a casserole dish.", "Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.", "Place in the dish and repeat with the other gammon steaks.", "Pour cider over the steaks, cover the top with a lid or tin foil.", "Cook for 1 hour."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why must Step 3 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tangy-gammon-in-cider\n\nProcedure:\n1. Preheat the oven to 200 degrees /gas mark 6.\n2. Start by piercing each tomato once and covering with boiling water to loosen the skins.\n3. Drain the onions and chop each one in half.\n4. Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.\n5. Put the onions, tomatoes and apples into a casserole dish.\n6. Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.\n7. Place in the dish and repeat with the other gammon steaks.\n8. Pour cider over the steaks, cover the top with a lid or tin foil.\n9. Cook for 1 hour.\n\n\n1. Must Step 3 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 3 does not depend on the oven being preheated and can be done independently.\"\n}\n```"}
{"plan_idx": 1264, "title": "green-tofu-curry", "question_idx": 1264, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 7 happen after Step 1?", "why_question": "Why must Step 7 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 7 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 involves frying tofu, which is independent of cooking the rice in Step 1.\"\n}\n```"}
{"plan_idx": 1265, "title": "almond and apple cake", "question_idx": 1265, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 5 happen after Step 3?", "why_question": "Why must Step 5 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 5 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 involves adding eggs to the butter and sugar mixture, which needs to be prepared in Step 4, and Step 3 is necessary to prepare the cake tin for the mixture.\"\n}\n```"}
{"plan_idx": 1266, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1266, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 12], "binary_question": "Must Step 13 happen after Step 8?", "why_question": "Why must Step 13 happen after Step 8?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 13 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 13 does not depend on Step 8 and can be done independently.\"\n}\n```"}
{"plan_idx": 1267, "title": "green-tofu-curry", "question_idx": 1267, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 9], "binary_question": "Must Step 10 happen after Step 3?", "why_question": "Why must Step 10 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 10 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 does not depend on Step 3 and can be done independently.\"\n}\n```"}
{"plan_idx": 1268, "title": "busters-liver-dinner", "question_idx": 1268, "steps": ["Put all ingredients into a slow cooker, mix together.", "Put slow cooker on high for 4 to 5 hours or low all day.", "( If mixture starts to look too dry just add a little hot water.", ")", "Once cooked, divide between several plastic microwaveable tubs with lids.", "This mixture usually makes 6 to 7 meals, I freeze 4 and put the rest in the fridge.", "When ready to eat microwave with lid half off for 2 to 3 minutes on medium high."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 6], "binary_question": "Must Step 7 happen after Step 4?", "why_question": "Why must Step 7 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: busters-liver-dinner\n\nProcedure:\n1. Put all ingredients into a slow cooker, mix together.\n2. Put slow cooker on high for 4 to 5 hours or low all day.\n3. ( If mixture starts to look too dry just add a little hot water.\n4. )\n5. Once cooked, divide between several plastic microwaveable tubs with lids.\n6. This mixture usually makes 6 to 7 meals, I freeze 4 and put the rest in the fridge.\n7. When ready to eat microwave with lid half off for 2 to 3 minutes on medium high.\n\n\n1. Must Step 7 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 involves reheating the meal, which can only happen after the mixture has been cooked and divided into tubs in Step 4.\"\n}\n```"}
{"plan_idx": 1269, "title": "fusilli-and-meatballs", "question_idx": 1269, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 8], "binary_question": "Must Step 9 happen after Step 2?", "why_question": "Why must Step 9 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 9 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 9 involves simmering the tomato sauce, which requires the saut\u00e9ed onion and garlic from Step 2 to be added first.\"\n}\n```"}
{"plan_idx": 1270, "title": "smoked-salmon-and-grapefruit-salad", "question_idx": 1270, "steps": ["Top and tail the grapefruits.", "Slice the skin off the grapefruit over a bowl.", "This is to catch any juices.", "Using a small knife, segment the grapefruits over the juice bowl.", "Arrange the lamb's lettuce onto each serving plate or a large salad bowl.", "Top with grapefruit segments and smoked salmon.", "Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.", "Pour over the salad and serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 3 happen after Step 2?", "why_question": "Why must Step 3 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: smoked-salmon-and-grapefruit-salad\n\nProcedure:\n1. Top and tail the grapefruits.\n2. Slice the skin off the grapefruit over a bowl.\n3. This is to catch any juices.\n4. Using a small knife, segment the grapefruits over the juice bowl.\n5. Arrange the lamb's lettuce onto each serving plate or a large salad bowl.\n6. Top with grapefruit segments and smoked salmon.\n7. Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.\n8. Pour over the salad and serve.\n\n\n1. Must Step 3 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 3 is an explanation for Step 2 and does not need to occur sequentially.\"\n}\n```"}
{"plan_idx": 1271, "title": "vegetable-terrine", "question_idx": 1271, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [8, 9], "binary_question": "Must Step 10 happen after Step 9?", "why_question": "Why must Step 10 happen after Step 9?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 10 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 is a recommendation and can be considered at any point before pouring the cream mixture into the mould.\"\n}\n```"}
{"plan_idx": 1272, "title": "banana-split-cake", "question_idx": 1272, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 6], "binary_question": "Must Step 7 happen after Step 5?", "why_question": "Why must Step 7 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\n1. Must Step 7 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 involves preparing the filling which needs to be spread over the cooled base from Step 5.\"\n}\n```"}
{"plan_idx": 1273, "title": "best-ever-margarita", "question_idx": 1273, "steps": ["Rim 2 margarita glasses with salt if desired and fill with ice.", "Pour the tequila, lime cordial, triple sec and lemon-lime soft drink into a cocktail shaker filled with ice.", "Hold your hand firmly over over the top of the shaker so the top doesn't pop off from the fizzy soft drink and shake vigorously.", "Pour into prepared margarita glasses and serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why must Step 2 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: best-ever-margarita\n\nProcedure:\n1. Rim 2 margarita glasses with salt if desired and fill with ice.\n2. Pour the tequila, lime cordial, triple sec and lemon-lime soft drink into a cocktail shaker filled with ice.\n3. Hold your hand firmly over over the top of the shaker so the top doesn't pop off from the fizzy soft drink and shake vigorously.\n4. Pour into prepared margarita glasses and serve.\n\n\n1. Must Step 2 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 prepares the glasses, which are needed to serve the margarita after mixing in Step 2.\"\n}\n```"}
{"plan_idx": 1274, "title": "spanish-rabbit-stew", "question_idx": 1274, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 10], "binary_question": "Must Step 11 happen after Step 5?", "why_question": "Why must Step 11 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 11 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 is about enjoying the meal, which naturally happens after the cooking process is complete, not specifically after Step 5.\"\n}\n```"}
{"plan_idx": 1275, "title": "vegetable-terrine", "question_idx": 1275, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 9], "binary_question": "Must Step 10 happen after Step 1?", "why_question": "Why must Step 10 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 10 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 is a recommendation about the type of mould to use and does not depend on Step 1.\"\n}\n```"}
{"plan_idx": 1276, "title": "fusilli-and-meatballs", "question_idx": 1276, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 18], "binary_question": "Must Step 19 happen after Step 6?", "why_question": "Why must Step 19 happen after Step 6?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 19 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 19 can happen independently of Step 6 as it involves cooking the pasta, which can be done at any time before serving.\"\n}\n```"}
{"plan_idx": 1277, "title": "vegetable-terrine", "question_idx": 1277, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 4 happen after Step 2?", "why_question": "Why must Step 4 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 4 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 4 can be done independently of Step 2 as it involves preparing sorrel, which does not affect the cooking of the vegetables.\"\n}\n```"}
{"plan_idx": 1278, "title": "chocolate-chocolate-cake", "question_idx": 1278, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 8], "binary_question": "Must Step 9 happen after Step 2?", "why_question": "Why must Step 9 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 9 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 9 involves adding flour to the mixture, which is independent of placing chocolate chips, coffee, and water in a bowl in Step 2.\"\n}\n```"}
{"plan_idx": 1279, "title": "fusilli-and-meatballs", "question_idx": 1279, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 10], "binary_question": "Must Step 11 happen after Step 6?", "why_question": "Why must Step 11 happen after Step 6?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 11 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 can be done independently of Step 6 as it involves preparing breadcrumbs, which does not affect the tomato sauce preparation.\"\n}\n```"}
{"plan_idx": 1280, "title": "curried bbq mussels", "question_idx": 1280, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 6], "binary_question": "Must Step 7 happen after Step 5?", "why_question": "Why must Step 7 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 7 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 must happen after Step 5 because the lime slices need to be placed on top of the mussels after they have been dotted with the curry mixture.\"\n}\n```"}
{"plan_idx": 1281, "title": "very-vanilla-ry-cheesecake", "question_idx": 1281, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 5], "binary_question": "Must Step 6 happen after Step 4?", "why_question": "Why must Step 6 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 6 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 involves preparing the cheesecake filling, which must be done after the crust is prepared in Step 4.\"\n}\n```"}
{"plan_idx": 1282, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1282, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 12], "binary_question": "Must Step 13 happen after Step 7?", "why_question": "Why must Step 13 happen after Step 7?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 13 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 13 can happen independently of Step 7 as it involves preparing the whipped cream, which does not affect the dough preparation.\"\n}\n```"}
{"plan_idx": 1283, "title": "spiced-pumpkin-teabread", "question_idx": 1283, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why must Step 2 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 2 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The oven needs to be preheated before the loaf tin is prepared to ensure the oven reaches the correct temperature by the time the mixture is ready to be baked.\"\n}\n```"}
{"plan_idx": 1284, "title": "spiced-pumpkin-teabread", "question_idx": 1284, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why must Step 5 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 5 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 5 does not depend on Step 1 and can be done independently of preheating the oven.\"\n}\n```"}
{"plan_idx": 1285, "title": "green-tofu-curry", "question_idx": 1285, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 7], "binary_question": "Must Step 8 happen after Step 3?", "why_question": "Why must Step 8 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 8 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 8 must happen after Step 3 because the tofu needs to be fried and seasoned after the rice is cooked and set aside.\"\n}\n```"}
{"plan_idx": 1286, "title": "balsamic-and-mozzarella-chicken", "question_idx": 1286, "steps": ["Place chicken in a shallow dish or large resealable plastic bag.", "Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.", "Coat a large frying pan lightly with oil, and set over low heat.", "Remove the chicken from the marinade and discard the marinade.", "Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.", "Arrange chicken on a serving platter.", "Place a generous slice of fresh mozzarella on top of each piece.", "Place a leaf of basil on top of the cheese, and cover with a slice of tomato.", "Drizzle balsamic vinegar over the platter, then season with salt and pepper.", "Serve!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why must Step 3 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: balsamic-and-mozzarella-chicken\n\nProcedure:\n1. Place chicken in a shallow dish or large resealable plastic bag.\n2. Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.\n3. Coat a large frying pan lightly with oil, and set over low heat.\n4. Remove the chicken from the marinade and discard the marinade.\n5. Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.\n6. Arrange chicken on a serving platter.\n7. Place a generous slice of fresh mozzarella on top of each piece.\n8. Place a leaf of basil on top of the cheese, and cover with a slice of tomato.\n9. Drizzle balsamic vinegar over the platter, then season with salt and pepper.\n10. Serve!\n\n\n1. Must Step 3 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 3 can happen after Step 2 as it involves preparing the frying pan for cooking the marinated chicken.\"\n}\n```"}
{"plan_idx": 1287, "title": "tangy-gammon-in-cider", "question_idx": 1287, "steps": ["Preheat the oven to 200 degrees /gas mark 6.", "Start by piercing each tomato once and covering with boiling water to loosen the skins.", "Drain the onions and chop each one in half.", "Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.", "Put the onions, tomatoes and apples into a casserole dish.", "Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.", "Place in the dish and repeat with the other gammon steaks.", "Pour cider over the steaks, cover the top with a lid or tin foil.", "Cook for 1 hour."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 4 happen after Step 3?", "why_question": "Why must Step 4 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tangy-gammon-in-cider\n\nProcedure:\n1. Preheat the oven to 200 degrees /gas mark 6.\n2. Start by piercing each tomato once and covering with boiling water to loosen the skins.\n3. Drain the onions and chop each one in half.\n4. Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.\n5. Put the onions, tomatoes and apples into a casserole dish.\n6. Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.\n7. Place in the dish and repeat with the other gammon steaks.\n8. Pour cider over the steaks, cover the top with a lid or tin foil.\n9. Cook for 1 hour.\n\n\n1. Must Step 4 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 requires the tomatoes to be in boiling water for 5 minutes, which starts in Step 2, and Step 3 involves preparing the onions, which can be done simultaneously or before draining the tomatoes.\"\n}\n```"}
{"plan_idx": 1288, "title": "chicken and vegetable pie", "question_idx": 1288, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 10], "binary_question": "Must Step 11 happen after Step 8?", "why_question": "Why must Step 11 happen after Step 8?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 11 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 11 must happen after Step 8 because the chicken mixture needs to be combined with the thickened liquid mixture prepared in Step 8 before being placed in the pie dish.\"\n}\n```"}
{"plan_idx": 1289, "title": "strawberry-tiramisu-trifle", "question_idx": 1289, "steps": ["Set 3 strawberries for the garnish aside, and cut the rest into slices.", "In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.", "Then stir in the custard and finally fold in the whipped cream.", "Brush the sponge fingers with the remaining coffee.", "Line a glass bowl with one layer of the soaked sponge fingers.", "Spread half of the strawberries over the sponge fingers.", "Sprinkle half of the grated chocolate over that and then half of the custard mixture.", "Repeat the layers in order again.", "Cut the remaining 3 strawberries in half and lay them on top of the trifle.", "Cover and leave in the fridge for at least 4 hours, best overnight."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 5 happen after Step 2?", "why_question": "Why must Step 5 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberry-tiramisu-trifle\n\nProcedure:\n1. Set 3 strawberries for the garnish aside, and cut the rest into slices.\n2. In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.\n3. Then stir in the custard and finally fold in the whipped cream.\n4. Brush the sponge fingers with the remaining coffee.\n5. Line a glass bowl with one layer of the soaked sponge fingers.\n6. Spread half of the strawberries over the sponge fingers.\n7. Sprinkle half of the grated chocolate over that and then half of the custard mixture.\n8. Repeat the layers in order again.\n9. Cut the remaining 3 strawberries in half and lay them on top of the trifle.\n10. Cover and leave in the fridge for at least 4 hours, best overnight.\n\n\n1. Must Step 5 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 5 does not depend on Step 2 and can be done independently.\"\n}\n```"}
{"plan_idx": 1290, "title": "curried bbq mussels", "question_idx": 1290, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 7 happen after Step 1?", "why_question": "Why must Step 7 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 7 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 involves topping the mussels with lime slices, which does not depend on preheating the barbecue in Step 1.\"\n}\n```"}
{"plan_idx": 1291, "title": "almost no fat banana bread", "question_idx": 1291, "steps": ["Preheat oven to 180 C / Gas mark 4.", "Lightly grease a 20x10cm (8x4 in) loaf tin.", "In a large bowl, stir together flour, sugar, baking powder, bicarbonate of soda and cinnamon.", "Add egg whites, bananas and apple pur\u00c3\u00a9e; stir just until combined.", "Pour batter into prepared tin.", "Bake in preheated oven for 50 to 55 minutes, until a skewer inserted into centre of loaf comes out clean.", "Turn out onto wire rack and allow to cool before slicing."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why must Step 2 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almost no fat banana bread\n\nProcedure:\n1. Preheat oven to 180 C / Gas mark 4.\n2. Lightly grease a 20x10cm (8x4 in) loaf tin.\n3. In a large bowl, stir together flour, sugar, baking powder, bicarbonate of soda and cinnamon.\n4. Add egg whites, bananas and apple pur\u00c3\u00a9e; stir just until combined.\n5. Pour batter into prepared tin.\n6. Bake in preheated oven for 50 to 55 minutes, until a skewer inserted into centre of loaf comes out clean.\n7. Turn out onto wire rack and allow to cool before slicing.\n\n\n1. Must Step 2 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 2 can be done independently of Step 1 as greasing the tin does not depend on the oven being preheated.\"\n}\n```"}
{"plan_idx": 1292, "title": "lightly spiced tomato and red lentil soup", "question_idx": 1292, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 9], "binary_question": "Must Step 10 happen after Step 7?", "why_question": "Why must Step 10 happen after Step 7?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 10 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 must happen after Step 9, not necessarily after Step 7.\"\n}\n```"}
{"plan_idx": 1293, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1293, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 12], "binary_question": "Must Step 13 happen after Step 5?", "why_question": "Why must Step 13 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 13 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 13 involves preparing the whipped cream and is independent of kneading the dough in Step 5.\"\n}\n```"}
{"plan_idx": 1294, "title": "banana-split-cake", "question_idx": 1294, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why must Step 6 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\n1. Must Step 6 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 6 does not depend on Step 1 and can be done independently.\"\n}\n```"}
{"plan_idx": 1295, "title": "green-tofu-curry", "question_idx": 1295, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 8], "binary_question": "Must Step 9 happen after Step 3?", "why_question": "Why must Step 9 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 9 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 9 does not depend on Step 3 and can be done independently.\"\n}\n```"}
{"plan_idx": 1296, "title": "cloud-bread", "question_idx": 1296, "steps": ["Preheat oven to 150 C / Gas mark 2.", "Line a baking tray with baking paper.", "Mix cream cheese and egg yolks together until smooth.", "Place egg whites and baking powder in a glass, metal, or ceramic bowl;", "beat together until stiff peaks form.", "Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.", "Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.", "Bake in the preheated oven until golden brown, 17 to 20 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 5 happen after Step 3?", "why_question": "Why must Step 5 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cloud-bread\n\nProcedure:\n1. Preheat oven to 150 C / Gas mark 2.\n2. Line a baking tray with baking paper.\n3. Mix cream cheese and egg yolks together until smooth.\n4. Place egg whites and baking powder in a glass, metal, or ceramic bowl;\n5. beat together until stiff peaks form.\n6. Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.\n7. Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.\n8. Bake in the preheated oven until golden brown, 17 to 20 minutes.\n\n\n1. Must Step 5 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 must happen after Step 3 because the egg whites need to be beaten to stiff peaks before folding in the cream cheese and egg yolk mixture to maintain the batter's structure.\"\n}\n```"}
{"plan_idx": 1297, "title": "spanish-rabbit-stew", "question_idx": 1297, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 7 happen after Step 2?", "why_question": "Why must Step 7 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 7 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 involves turning on the slow cooker, which must happen after all ingredients are added in Step 2.\"\n}\n```"}
{"plan_idx": 1298, "title": "curried bbq mussels", "question_idx": 1298, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 7 happen after Step 2?", "why_question": "Why must Step 7 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 7 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 must happen after Step 2 because the curry mixture prepared in Step 2 is used in Step 5, which precedes Step 7.\"\n}\n```"}
{"plan_idx": 1299, "title": "feta-and-sundried-tomato-spinach-rolls", "question_idx": 1299, "steps": ["Preheat grill.", "Mix together cream cheese, feta, sundried tomatoes, basil and garlic.", "Stir until creamy, with no lumps.", "Blanch the spinach leaves.", "Wrap a dollop of cheese mix in each spinach leaf.", "Brush with olive oil.", "Sprinkle almonds on the top or alternately roll them in the almonds", "Grill spinach rolls until slightly crispy on top.", "Let cool for 10 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 4 happen after Step 3?", "why_question": "Why must Step 4 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: feta-and-sundried-tomato-spinach-rolls\n\nProcedure:\n1. Preheat grill.\n2. Mix together cream cheese, feta, sundried tomatoes, basil and garlic.\n3. Stir until creamy, with no lumps.\n4. Blanch the spinach leaves.\n5. Wrap a dollop of cheese mix in each spinach leaf.\n6. Brush with olive oil.\n7. Sprinkle almonds on the top or alternately roll them in the almonds\n8. Grill spinach rolls until slightly crispy on top.\n9. Let cool for 10 minutes.\n\n\n1. Must Step 4 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Blanching the spinach leaves (Step 4) must happen after mixing the cheese (Step 3) to ensure the spinach is ready to wrap the cheese mixture.\"\n}\n```"}
{"plan_idx": 1300, "title": "spanish-rabbit-stew", "question_idx": 1300, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 10], "binary_question": "Must Step 11 happen after Step 3?", "why_question": "Why must Step 11 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 11 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 is about enjoying the meal, which should happen after the entire cooking process, not just after Step 3.\"\n}\n```"}
{"plan_idx": 1301, "title": "chocolate-chocolate-cake", "question_idx": 1301, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 18], "binary_question": "Must Step 19 happen after Step 8?", "why_question": "Why must Step 19 happen after Step 8?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 19 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 19 is an observation about the cake's baking process and does not depend on Step 8.\"\n}\n```"}
{"plan_idx": 1302, "title": "chicken and vegetable pie", "question_idx": 1302, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [8, 10], "binary_question": "Must Step 11 happen after Step 9?", "why_question": "Why must Step 11 happen after Step 9?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 11 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 11 must happen after Step 9 because the chicken mixture needs to be placed in the pie dish before the hot liquid mixture is poured over it.\"\n}\n```"}
{"plan_idx": 1303, "title": "lightly spiced tomato and red lentil soup", "question_idx": 1303, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 7 happen after Step 3?", "why_question": "Why must Step 7 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 7 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 can be done at any time while the soup is simmering, as it involves preparing the garnish and does not affect the cooking process.\"\n}\n```"}
{"plan_idx": 1304, "title": "chocolate-chocolate-cake", "question_idx": 1304, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 8], "binary_question": "Must Step 9 happen after Step 3?", "why_question": "Why must Step 9 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 9 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 9 involves adding flour to the mixture, which requires the earlier steps to be completed to ensure the proper consistency and integration of ingredients.\"\n}\n```"}
{"plan_idx": 1305, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1305, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 11], "binary_question": "Must Step 12 happen after Step 3?", "why_question": "Why must Step 12 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 12 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 12 can be done independently of Step 3 as it involves preparing the whipped cream, which does not affect the dough preparation.\"\n}\n```"}
{"plan_idx": 1306, "title": "fusilli-and-meatballs", "question_idx": 1306, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 12], "binary_question": "Must Step 13 happen after Step 5?", "why_question": "Why must Step 13 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 13 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 13 can happen independently of Step 5 as they involve different components of the dish.\"\n}\n```"}
{"plan_idx": 1307, "title": "vegetable-terrine", "question_idx": 1307, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 8], "binary_question": "Must Step 9 happen after Step 2?", "why_question": "Why must Step 9 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 9 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 9 must happen after Step 8, not necessarily after Step 2.\"\n}\n```"}
{"plan_idx": 1308, "title": "chocolate-chocolate-cake", "question_idx": 1308, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [18, 19], "binary_question": "Must Step 20 happen after Step 19?", "why_question": "Why must Step 20 happen after Step 19?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 20 happen after Step 19?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 20 must happen after Step 19 because the cake needs to be baked and potentially cracked before it can be cooled in the tin.\"\n}\n```"}
{"plan_idx": 1309, "title": "tortellini-fritto-with-almond-butter", "question_idx": 1309, "steps": ["Bring a saucepan of water to the boil.", "Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.", "In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.", "If you slightly undercooked your tortellini then it's less likely to stick to the pan.", "Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.", "Continue to gently fry and stir the tortellini until golden brown.", "Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.", "Enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 4 happen after Step 2?", "why_question": "Why must Step 4 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tortellini-fritto-with-almond-butter\n\nProcedure:\n1. Bring a saucepan of water to the boil.\n2. Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.\n3. In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.\n4. If you slightly undercooked your tortellini then it's less likely to stick to the pan.\n5. Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.\n6. Continue to gently fry and stir the tortellini until golden brown.\n7. Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.\n8. Enjoy!\n\n\n1. Must Step 4 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 provides a reason for slightly undercooking the tortellini in Step 2 to prevent it from sticking to the pan.\"\n}\n```"}
{"plan_idx": 1310, "title": "fusilli-and-meatballs", "question_idx": 1310, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [9, 13], "binary_question": "Must Step 14 happen after Step 10?", "why_question": "Why must Step 14 happen after Step 10?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 14 happen after Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 14 can happen independently of Step 10 as it involves cooking the meatballs, which can be done while the sauce is simmering.\"\n}\n```"}
{"plan_idx": 1311, "title": "curried bbq mussels", "question_idx": 1311, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 7], "binary_question": "Must Step 8 happen after Step 1?", "why_question": "Why must Step 8 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 8 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 8 can happen independently of Step 1 as it involves wrapping the mussels in foil, which does not require the barbecue to be preheated.\"\n}\n```"}
{"plan_idx": 1312, "title": "chocolate-chocolate-cake", "question_idx": 1312, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 10], "binary_question": "Must Step 11 happen after Step 8?", "why_question": "Why must Step 11 happen after Step 8?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 11 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 11 must happen after Step 8 because the egg whites need to be folded into the chocolate mixture, which includes the egg yolks added in Step 8.\"\n}\n```"}
{"plan_idx": 1313, "title": "very-vanilla-ry-cheesecake", "question_idx": 1313, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 9], "binary_question": "Must Step 10 happen after Step 8?", "why_question": "Why must Step 10 happen after Step 8?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 10 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 can happen at any time before Step 11 as it involves preparing the oven environment for baking the cheesecake.\"\n}\n```"}
{"plan_idx": 1314, "title": "feta-and-sundried-tomato-spinach-rolls", "question_idx": 1314, "steps": ["Preheat grill.", "Mix together cream cheese, feta, sundried tomatoes, basil and garlic.", "Stir until creamy, with no lumps.", "Blanch the spinach leaves.", "Wrap a dollop of cheese mix in each spinach leaf.", "Brush with olive oil.", "Sprinkle almonds on the top or alternately roll them in the almonds", "Grill spinach rolls until slightly crispy on top.", "Let cool for 10 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why must Step 6 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: feta-and-sundried-tomato-spinach-rolls\n\nProcedure:\n1. Preheat grill.\n2. Mix together cream cheese, feta, sundried tomatoes, basil and garlic.\n3. Stir until creamy, with no lumps.\n4. Blanch the spinach leaves.\n5. Wrap a dollop of cheese mix in each spinach leaf.\n6. Brush with olive oil.\n7. Sprinkle almonds on the top or alternately roll them in the almonds\n8. Grill spinach rolls until slightly crispy on top.\n9. Let cool for 10 minutes.\n\n\n1. Must Step 6 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 6 does not depend on Step 1 and can be done independently.\"\n}\n```"}
{"plan_idx": 1315, "title": "spiced butternut squash soup", "question_idx": 1315, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 7], "binary_question": "Must Step 8 happen after Step 6?", "why_question": "Why must Step 8 happen after Step 6?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 8 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 8 involves saut\u00e9ing ingredients in a pot, which requires the squash to be set aside after baking and peeling in Step 6.\"\n}\n```"}
{"plan_idx": 1316, "title": "chocolate-chocolate-cake", "question_idx": 1316, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 12], "binary_question": "Must Step 13 happen after Step 1?", "why_question": "Why must Step 13 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 13 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 13 does not depend on Step 1, which is preheating the oven.\"\n}\n```"}
{"plan_idx": 1317, "title": "very-vanilla-ry-cheesecake", "question_idx": 1317, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 7], "binary_question": "Must Step 8 happen after Step 2?", "why_question": "Why must Step 8 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 8 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 8 involves preparing the filling, which can be done independently of crushing the biscuits in Step 2.\"\n}\n```"}
{"plan_idx": 1318, "title": "curried bbq mussels", "question_idx": 1318, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why must Step 4 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 4 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 4 does not depend on the barbecue being preheated and can be done independently.\"\n}\n```"}
{"plan_idx": 1319, "title": "chocolate-chocolate-cake", "question_idx": 1319, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 14], "binary_question": "Must Step 15 happen after Step 5?", "why_question": "Why must Step 15 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 15 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 15 can be done at any time before Step 16 as it involves preparing the cake tin, which is independent of the cooling process in Step 5.\"\n}\n```"}
{"plan_idx": 1320, "title": "busters-liver-dinner", "question_idx": 1320, "steps": ["Put all ingredients into a slow cooker, mix together.", "Put slow cooker on high for 4 to 5 hours or low all day.", "( If mixture starts to look too dry just add a little hot water.", ")", "Once cooked, divide between several plastic microwaveable tubs with lids.", "This mixture usually makes 6 to 7 meals, I freeze 4 and put the rest in the fridge.", "When ready to eat microwave with lid half off for 2 to 3 minutes on medium high."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 4 happen after Step 2?", "why_question": "Why must Step 4 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: busters-liver-dinner\n\nProcedure:\n1. Put all ingredients into a slow cooker, mix together.\n2. Put slow cooker on high for 4 to 5 hours or low all day.\n3. ( If mixture starts to look too dry just add a little hot water.\n4. )\n5. Once cooked, divide between several plastic microwaveable tubs with lids.\n6. This mixture usually makes 6 to 7 meals, I freeze 4 and put the rest in the fridge.\n7. When ready to eat microwave with lid half off for 2 to 3 minutes on medium high.\n\n\n1. Must Step 4 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 is a continuation of Step 3, which occurs during the cooking process in Step 2.\"\n}\n```"}
{"plan_idx": 1321, "title": "fusilli-and-meatballs", "question_idx": 1321, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [15, 18], "binary_question": "Must Step 19 happen after Step 16?", "why_question": "Why must Step 19 happen after Step 16?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 19 happen after Step 16?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 19 can happen at any time as long as the pasta is ready by the time the meatballs and sauce are finished.\"\n}\n```"}
{"plan_idx": 1322, "title": "cloud-bread", "question_idx": 1322, "steps": ["Preheat oven to 150 C / Gas mark 2.", "Line a baking tray with baking paper.", "Mix cream cheese and egg yolks together until smooth.", "Place egg whites and baking powder in a glass, metal, or ceramic bowl;", "beat together until stiff peaks form.", "Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.", "Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.", "Bake in the preheated oven until golden brown, 17 to 20 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why must Step 2 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cloud-bread\n\nProcedure:\n1. Preheat oven to 150 C / Gas mark 2.\n2. Line a baking tray with baking paper.\n3. Mix cream cheese and egg yolks together until smooth.\n4. Place egg whites and baking powder in a glass, metal, or ceramic bowl;\n5. beat together until stiff peaks form.\n6. Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.\n7. Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.\n8. Bake in the preheated oven until golden brown, 17 to 20 minutes.\n\n\n1. Must Step 2 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 2 can be done before Step 1 as it involves preparing the baking tray, which does not depend on the oven being preheated.\"\n}\n```"}
{"plan_idx": 1323, "title": "chicken and vegetable pie", "question_idx": 1323, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 7], "binary_question": "Must Step 8 happen after Step 3?", "why_question": "Why must Step 8 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 8 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 8 involves simmering the liquid mixture which includes ingredients prepared in Step 3.\"\n}\n```"}
{"plan_idx": 1324, "title": "smoked-salmon-and-grapefruit-salad", "question_idx": 1324, "steps": ["Top and tail the grapefruits.", "Slice the skin off the grapefruit over a bowl.", "This is to catch any juices.", "Using a small knife, segment the grapefruits over the juice bowl.", "Arrange the lamb's lettuce onto each serving plate or a large salad bowl.", "Top with grapefruit segments and smoked salmon.", "Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.", "Pour over the salad and serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 4 happen after Step 3?", "why_question": "Why must Step 4 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: smoked-salmon-and-grapefruit-salad\n\nProcedure:\n1. Top and tail the grapefruits.\n2. Slice the skin off the grapefruit over a bowl.\n3. This is to catch any juices.\n4. Using a small knife, segment the grapefruits over the juice bowl.\n5. Arrange the lamb's lettuce onto each serving plate or a large salad bowl.\n6. Top with grapefruit segments and smoked salmon.\n7. Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.\n8. Pour over the salad and serve.\n\n\n1. Must Step 4 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen after Step 3 to ensure the grapefruit segments are cut over the bowl to catch the juices.\"\n}\n```"}
{"plan_idx": 1325, "title": "cloud-bread", "question_idx": 1325, "steps": ["Preheat oven to 150 C / Gas mark 2.", "Line a baking tray with baking paper.", "Mix cream cheese and egg yolks together until smooth.", "Place egg whites and baking powder in a glass, metal, or ceramic bowl;", "beat together until stiff peaks form.", "Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.", "Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.", "Bake in the preheated oven until golden brown, 17 to 20 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 4 happen after Step 2?", "why_question": "Why must Step 4 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cloud-bread\n\nProcedure:\n1. Preheat oven to 150 C / Gas mark 2.\n2. Line a baking tray with baking paper.\n3. Mix cream cheese and egg yolks together until smooth.\n4. Place egg whites and baking powder in a glass, metal, or ceramic bowl;\n5. beat together until stiff peaks form.\n6. Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.\n7. Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.\n8. Bake in the preheated oven until golden brown, 17 to 20 minutes.\n\n\n1. Must Step 4 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 4 does not depend on Step 2 and can be done independently.\"\n}\n```"}
{"plan_idx": 1326, "title": "spiced-pumpkin-teabread", "question_idx": 1326, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why must Step 3 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 3 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 3 can be done independently of preheating the oven in Step 1.\"\n}\n```"}
{"plan_idx": 1327, "title": "almond and apple cake", "question_idx": 1327, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 9], "binary_question": "Must Step 10 happen after Step 5?", "why_question": "Why must Step 10 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 10 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 10 involves arranging the apple in the tin, which must be done after preparing the batter in Step 5 to ensure the batter is ready to be added on top of the apples.\"\n}\n```"}
{"plan_idx": 1328, "title": "butternut-squash-pastry-for-pies", "question_idx": 1328, "steps": ["Place the flour, egg and squash into the container of a food processor.", "Pulse until mixed into a doughy ball.", "You may need to add a little extra flour.", "Divide into two equal parts.", "Use in a pie or pastie recipe."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why must Step 3 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: butternut-squash-pastry-for-pies\n\nProcedure:\n1. Place the flour, egg and squash into the container of a food processor.\n2. Pulse until mixed into a doughy ball.\n3. You may need to add a little extra flour.\n4. Divide into two equal parts.\n5. Use in a pie or pastie recipe.\n\n\n1. Must Step 3 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen after Step 1 because you need to see the consistency of the dough after the initial mixing to determine if extra flour is needed.\"\n}\n```"}
{"plan_idx": 1329, "title": "green-tofu-curry", "question_idx": 1329, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 5 happen after Step 2?", "why_question": "Why must Step 5 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 5 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 5 can happen independently of Step 2 as they involve different components (tofu and rice) being prepared in separate saucepans.\"\n}\n```"}
{"plan_idx": 1330, "title": "spiced-pumpkin-teabread", "question_idx": 1330, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why must Step 6 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 6 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 6 does not depend on the oven being preheated and can be done independently.\"\n}\n```"}
{"plan_idx": 1331, "title": "green-tofu-curry", "question_idx": 1331, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 8], "binary_question": "Must Step 9 happen after Step 4?", "why_question": "Why must Step 9 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 9 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 9 can happen independently of Step 4 as they involve different components of the dish.\"\n}\n```"}
{"plan_idx": 1332, "title": "spiced-guava-cake", "question_idx": 1332, "steps": ["Preheat oven to 180 C / Gas 4.", "Grease and flour one 23x13cm loaf tin.", "Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.", "In another bowl, mix together guava pulp and juice.", "In another bowl, cream together butter and sugar.", "Add eggs, one at a time.", "Add flour mixture and guava mixture alternately to creamed mixture.", "Pour batter into prepared tin.", "Bake at 180 C / Gas 4 for 30-35 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 5 happen after Step 2?", "why_question": "Why must Step 5 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-guava-cake\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Grease and flour one 23x13cm loaf tin.\n3. Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.\n4. In another bowl, mix together guava pulp and juice.\n5. In another bowl, cream together butter and sugar.\n6. Add eggs, one at a time.\n7. Add flour mixture and guava mixture alternately to creamed mixture.\n8. Pour batter into prepared tin.\n9. Bake at 180 C / Gas 4 for 30-35 minutes.\n\n\n1. Must Step 5 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 5 does not depend on Step 2 and can be done independently.\"\n}\n```"}
{"plan_idx": 1333, "title": "green-tofu-curry", "question_idx": 1333, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why must Step 6 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 6 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 6 involves preparing the tofu, which can be done independently of boiling the rice in Step 2.\"\n}\n```"}
{"plan_idx": 1334, "title": "fusilli-and-meatballs", "question_idx": 1334, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 8], "binary_question": "Must Step 9 happen after Step 1?", "why_question": "Why must Step 9 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 9 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 9 involves simmering the tomato sauce, which requires the initial preparation and saut\u00e9ing of the onion and garlic in Step 1.\"\n}\n```"}
{"plan_idx": 1335, "title": "chicken and vegetable pie", "question_idx": 1335, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 9], "binary_question": "Must Step 10 happen after Step 1?", "why_question": "Why must Step 10 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 10 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 does not depend on preheating the oven and can be done at any time before Step 11.\"\n}\n```"}
{"plan_idx": 1336, "title": "fusilli-and-meatballs", "question_idx": 1336, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [14, 18], "binary_question": "Must Step 19 happen after Step 15?", "why_question": "Why must Step 19 happen after Step 15?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 19 happen after Step 15?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 19 can happen independently of Step 15 as it involves cooking the pasta, which can be done concurrently or at any time before Step 21.\"\n}\n```"}
{"plan_idx": 1337, "title": "fusilli-and-meatballs", "question_idx": 1337, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 13], "binary_question": "Must Step 14 happen after Step 4?", "why_question": "Why must Step 14 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 14 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 14 can happen independently of Step 4 as it involves preparing the frying pan for cooking meatballs, which is a separate task from setting aside the onion mixture.\"\n}\n```"}
{"plan_idx": 1338, "title": "fusilli-and-meatballs", "question_idx": 1338, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 18], "binary_question": "Must Step 19 happen after Step 8?", "why_question": "Why must Step 19 happen after Step 8?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 19 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 19 can happen at any time before Step 20 as long as the pasta is ready to be tossed with the sauce.\"\n}\n```"}
{"plan_idx": 1339, "title": "chocolate-chocolate-cake", "question_idx": 1339, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [11, 18], "binary_question": "Must Step 19 happen after Step 12?", "why_question": "Why must Step 19 happen after Step 12?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 19 happen after Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 19 is an observation about the cake's baking process and does not depend on Step 12.\"\n}\n```"}
{"plan_idx": 1340, "title": "almond and apple cake", "question_idx": 1340, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 7 happen after Step 1?", "why_question": "Why must Step 7 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 7 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 involves adding flour and milk to the mixture, which does not depend on preheating the oven.\"\n}\n```"}
{"plan_idx": 1341, "title": "tortellini-fritto-with-almond-butter", "question_idx": 1341, "steps": ["Bring a saucepan of water to the boil.", "Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.", "In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.", "If you slightly undercooked your tortellini then it's less likely to stick to the pan.", "Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.", "Continue to gently fry and stir the tortellini until golden brown.", "Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.", "Enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 7], "binary_question": "Must Step 8 happen after Step 5?", "why_question": "Why must Step 8 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tortellini-fritto-with-almond-butter\n\nProcedure:\n1. Bring a saucepan of water to the boil.\n2. Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.\n3. In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.\n4. If you slightly undercooked your tortellini then it's less likely to stick to the pan.\n5. Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.\n6. Continue to gently fry and stir the tortellini until golden brown.\n7. Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.\n8. Enjoy!\n\n\n1. Must Step 8 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 8 is the final step where you enjoy the dish, so it must happen after all the previous steps, not just Step 5.\"\n}\n```"}
{"plan_idx": 1342, "title": "almond and apple cake", "question_idx": 1342, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 9], "binary_question": "Must Step 10 happen after Step 6?", "why_question": "Why must Step 10 happen after Step 6?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 10 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 can happen after Step 3 as it involves preparing the tin, which can be done before mixing the batter.\"\n}\n```"}
{"plan_idx": 1343, "title": "chocolate-pancake-batter", "question_idx": 1343, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why must Step 6 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 6 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 6 involves greasing the pan, which is unrelated to sifting the flour and cocoa powder in Step 1.\"\n}\n```"}
{"plan_idx": 1344, "title": "vegetable-terrine", "question_idx": 1344, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 5 happen after Step 2?", "why_question": "Why must Step 5 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 5 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 5 can happen independently of Step 2 as they involve different components and do not depend on each other.\"\n}\n```"}
{"plan_idx": 1345, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1345, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why must Step 3 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 3 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 3 does not depend on Step 1 and can be done independently.\"\n}\n```"}
{"plan_idx": 1346, "title": "spanish-rabbit-stew", "question_idx": 1346, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 7], "binary_question": "Must Step 8 happen after Step 7?", "why_question": "Why must Step 8 happen after Step 7?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 8 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 8 refers to the smell filling the room, which happens after the stew has been simmering for about 5 hours in Step 7.\"\n}\n```"}
{"plan_idx": 1347, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1347, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [10, 11], "binary_question": "Must Step 12 happen after Step 11?", "why_question": "Why must Step 12 happen after Step 11?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 12 happen after Step 11?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 12 does not depend on Step 11 and can be done independently.\"\n}\n```"}
{"plan_idx": 1348, "title": "chocolate-chocolate-cake", "question_idx": 1348, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [8, 11], "binary_question": "Must Step 12 happen after Step 9?", "why_question": "Why must Step 12 happen after Step 9?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 12 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 12 must happen after Step 9 because the egg whites need to be folded into the chocolate mixture, which is prepared in Step 10 after adding the flour in Step 9.\"\n}\n```"}
{"plan_idx": 1349, "title": "fusilli-and-meatballs", "question_idx": 1349, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 13], "binary_question": "Must Step 14 happen after Step 3?", "why_question": "Why must Step 14 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 14 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 14 can happen independently of Step 3 as it involves preparing the frying pan for cooking meatballs, which is a separate task from transferring the onion mixture.\"\n}\n```"}
{"plan_idx": 1350, "title": "fusilli-and-meatballs", "question_idx": 1350, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 10], "binary_question": "Must Step 11 happen after Step 2?", "why_question": "Why must Step 11 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 11 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 can be done independently of Step 2 as it involves processing bread into crumbs, which does not depend on the saut\u00e9ing of the onion and garlic.\"\n}\n```"}
{"plan_idx": 1351, "title": "no-sugar-rock-cakes", "question_idx": 1351, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 4 happen after Step 3?", "why_question": "Why must Step 4 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\n1. Must Step 4 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 4 is a continuation of Step 3, as they describe the same mixing process.\"\n}\n```"}
{"plan_idx": 1352, "title": "chicken and vegetable pie", "question_idx": 1352, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 13], "binary_question": "Must Step 14 happen after Step 1?", "why_question": "Why must Step 14 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 14 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 14 does not depend on Step 1 and can be done independently of preheating the oven.\"\n}\n```"}
{"plan_idx": 1353, "title": "almond and apple cake", "question_idx": 1353, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why must Step 4 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 4 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 4 can be done independently of preheating the oven in Step 1.\"\n}\n```"}
{"plan_idx": 1354, "title": "strawberry-tiramisu-trifle", "question_idx": 1354, "steps": ["Set 3 strawberries for the garnish aside, and cut the rest into slices.", "In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.", "Then stir in the custard and finally fold in the whipped cream.", "Brush the sponge fingers with the remaining coffee.", "Line a glass bowl with one layer of the soaked sponge fingers.", "Spread half of the strawberries over the sponge fingers.", "Sprinkle half of the grated chocolate over that and then half of the custard mixture.", "Repeat the layers in order again.", "Cut the remaining 3 strawberries in half and lay them on top of the trifle.", "Cover and leave in the fridge for at least 4 hours, best overnight."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why must Step 3 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberry-tiramisu-trifle\n\nProcedure:\n1. Set 3 strawberries for the garnish aside, and cut the rest into slices.\n2. In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.\n3. Then stir in the custard and finally fold in the whipped cream.\n4. Brush the sponge fingers with the remaining coffee.\n5. Line a glass bowl with one layer of the soaked sponge fingers.\n6. Spread half of the strawberries over the sponge fingers.\n7. Sprinkle half of the grated chocolate over that and then half of the custard mixture.\n8. Repeat the layers in order again.\n9. Cut the remaining 3 strawberries in half and lay them on top of the trifle.\n10. Cover and leave in the fridge for at least 4 hours, best overnight.\n\n\n1. Must Step 3 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 3 does not depend on Step 1 and can be done independently.\"\n}\n```"}
{"plan_idx": 1355, "title": "spiced butternut squash soup", "question_idx": 1355, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 8], "binary_question": "Must Step 9 happen after Step 3?", "why_question": "Why must Step 9 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 9 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 9 involves adding chicken stock to the pot, which is unrelated to placing the squash halves in the baking dish in Step 3.\"\n}\n```"}
{"plan_idx": 1356, "title": "very-vanilla-ry-cheesecake", "question_idx": 1356, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 9], "binary_question": "Must Step 10 happen after Step 6?", "why_question": "Why must Step 10 happen after Step 6?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 10 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 can be done independently of Step 6 as it involves preparing the oven, not the cheesecake mixture.\"\n}\n```"}
{"plan_idx": 1357, "title": "chicken-prawn-and-rice-soup", "question_idx": 1357, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 9], "binary_question": "Must Step 10 happen after Step 7?", "why_question": "Why must Step 10 happen after Step 7?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 10 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 can happen independently of Step 7 as it involves heating oil for the rice, which is a separate task from adding salt and sherry to the soup.\"\n}\n```"}
{"plan_idx": 1358, "title": "chicken and vegetable pie", "question_idx": 1358, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 9], "binary_question": "Must Step 10 happen after Step 8?", "why_question": "Why must Step 10 happen after Step 8?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 10 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 can be done at any time before Step 11 as it involves preparing the pie dish, which does not depend on the liquid mixture being thickened.\"\n}\n```"}
{"plan_idx": 1359, "title": "tortellini-fritto-with-almond-butter", "question_idx": 1359, "steps": ["Bring a saucepan of water to the boil.", "Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.", "In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.", "If you slightly undercooked your tortellini then it's less likely to stick to the pan.", "Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.", "Continue to gently fry and stir the tortellini until golden brown.", "Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.", "Enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 7], "binary_question": "Must Step 8 happen after Step 3?", "why_question": "Why must Step 8 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tortellini-fritto-with-almond-butter\n\nProcedure:\n1. Bring a saucepan of water to the boil.\n2. Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.\n3. In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.\n4. If you slightly undercooked your tortellini then it's less likely to stick to the pan.\n5. Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.\n6. Continue to gently fry and stir the tortellini until golden brown.\n7. Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.\n8. Enjoy!\n\n\n1. Must Step 8 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 8 is about enjoying the dish, which should happen after the entire cooking process is complete.\"\n}\n```"}
{"plan_idx": 1360, "title": "spanish-rabbit-stew", "question_idx": 1360, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 5 happen after Step 4?", "why_question": "Why must Step 5 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 5 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 involves adjusting the liquid added in Step 4 to ensure the correct ratio and coverage of ingredients.\"\n}\n```"}
{"plan_idx": 1361, "title": "curried bbq mussels", "question_idx": 1361, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 4 happen after Step 2?", "why_question": "Why must Step 4 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 4 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 4 can happen before Step 2 because dividing the mussels into portions does not depend on the curry mixture being prepared.\"\n}\n```"}
{"plan_idx": 1362, "title": "banana-split-cake", "question_idx": 1362, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 7 happen after Step 2?", "why_question": "Why must Step 7 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\n1. Must Step 7 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 involves beating a mixture that includes ingredients combined in Step 6, which must happen after Step 2.\"\n}\n```"}
{"plan_idx": 1363, "title": "green-tofu-curry", "question_idx": 1363, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 7 happen after Step 2?", "why_question": "Why must Step 7 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 7 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 involves frying tofu, which is independent of boiling water for rice in Step 2.\"\n}\n```"}
{"plan_idx": 1364, "title": "tortellini-fritto-with-almond-butter", "question_idx": 1364, "steps": ["Bring a saucepan of water to the boil.", "Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.", "In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.", "If you slightly undercooked your tortellini then it's less likely to stick to the pan.", "Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.", "Continue to gently fry and stir the tortellini until golden brown.", "Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.", "Enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 7], "binary_question": "Must Step 8 happen after Step 4?", "why_question": "Why must Step 8 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tortellini-fritto-with-almond-butter\n\nProcedure:\n1. Bring a saucepan of water to the boil.\n2. Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.\n3. In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.\n4. If you slightly undercooked your tortellini then it's less likely to stick to the pan.\n5. Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.\n6. Continue to gently fry and stir the tortellini until golden brown.\n7. Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.\n8. Enjoy!\n\n\n1. Must Step 8 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 8 is the final step and is meant to be done after all the cooking steps are completed.\"\n}\n```"}
{"plan_idx": 1365, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1365, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 11], "binary_question": "Must Step 12 happen after Step 8?", "why_question": "Why must Step 12 happen after Step 8?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 12 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 12 can be done independently of Step 8 as it involves preparing the whipped cream, which does not depend on the baking process.\"\n}\n```"}
{"plan_idx": 1366, "title": "fusilli-and-meatballs", "question_idx": 1366, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 9], "binary_question": "Must Step 10 happen after Step 2?", "why_question": "Why must Step 10 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 10 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 10 involves adding herbs to the simmering tomato sauce, which is prepared using the onion mixture from Step 2.\"\n}\n```"}
{"plan_idx": 1367, "title": "spicy-tomato-anchovy-pasta", "question_idx": 1367, "steps": ["Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;", "cook until lightly browned.", "Add anchovies and water, cover and simmer for 4 to 5 minutes.", "Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.", "While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.", "Add linguine and cook until al dente, about 7 to 8 minutes;", "drain.", "Toss with anchovy mixture and chilli flakes.", "If desired, season with black pepper.", "Serve immediately."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 6 happen after Step 3?", "why_question": "Why must Step 6 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spicy-tomato-anchovy-pasta\n\nProcedure:\n1. Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;\n2. cook until lightly browned.\n3. Add anchovies and water, cover and simmer for 4 to 5 minutes.\n4. Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.\n5. While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.\n6. Add linguine and cook until al dente, about 7 to 8 minutes;\n7. drain.\n8. Toss with anchovy mixture and chilli flakes.\n9. If desired, season with black pepper.\n10. Serve immediately.\n\n\n1. Must Step 6 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 6 can happen independently of Step 3 as long as the linguine is ready to be tossed with the anchovy mixture at the end.\"\n}\n```"}
{"plan_idx": 1368, "title": "spanish-rabbit-stew", "question_idx": 1368, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 5], "binary_question": "Must Step 6 happen after Step 4?", "why_question": "Why must Step 6 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 6 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 must happen after Step 4 because the tarragon and bay leaf need to be submerged in the liquid to release their flavor.\"\n}\n```"}
{"plan_idx": 1369, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1369, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 12], "binary_question": "Must Step 13 happen after Step 4?", "why_question": "Why must Step 13 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 13 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 13 does not depend on Step 4 and can be done independently.\"\n}\n```"}
{"plan_idx": 1370, "title": "spiced-guava-cake", "question_idx": 1370, "steps": ["Preheat oven to 180 C / Gas 4.", "Grease and flour one 23x13cm loaf tin.", "Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.", "In another bowl, mix together guava pulp and juice.", "In another bowl, cream together butter and sugar.", "Add eggs, one at a time.", "Add flour mixture and guava mixture alternately to creamed mixture.", "Pour batter into prepared tin.", "Bake at 180 C / Gas 4 for 30-35 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why must Step 3 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-guava-cake\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Grease and flour one 23x13cm loaf tin.\n3. Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.\n4. In another bowl, mix together guava pulp and juice.\n5. In another bowl, cream together butter and sugar.\n6. Add eggs, one at a time.\n7. Add flour mixture and guava mixture alternately to creamed mixture.\n8. Pour batter into prepared tin.\n9. Bake at 180 C / Gas 4 for 30-35 minutes.\n\n\n1. Must Step 3 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 3 does not depend on the oven being preheated and can be done independently.\"\n}\n```"}
{"plan_idx": 1371, "title": "chicken-prawn-and-rice-soup", "question_idx": 1371, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 9], "binary_question": "Must Step 10 happen after Step 3?", "why_question": "Why must Step 10 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 10 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 can happen independently of Step 3 as it involves heating oil for the rice, which is a separate task from cooking the prawn and chicken mixture.\"\n}\n```"}
{"plan_idx": 1372, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1372, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 8], "binary_question": "Must Step 9 happen after Step 1?", "why_question": "Why must Step 9 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 9 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 9 involves baking the dough, which is independent of the strawberries being refrigerated in Step 1.\"\n}\n```"}
{"plan_idx": 1373, "title": "spanish-rabbit-stew", "question_idx": 1373, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 7], "binary_question": "Must Step 8 happen after Step 4?", "why_question": "Why must Step 8 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 8 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 8 is a humorous remark and not an actual step in the procedure.\"\n}\n```"}
{"plan_idx": 1374, "title": "green-tofu-curry", "question_idx": 1374, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 6], "binary_question": "Must Step 7 happen after Step 4?", "why_question": "Why must Step 7 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 7 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 involves frying the tofu and is independent of the rice preparation in Step 4.\"\n}\n```"}
{"plan_idx": 1375, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1375, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 11], "binary_question": "Must Step 12 happen after Step 7?", "why_question": "Why must Step 12 happen after Step 7?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 12 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 12 does not depend on Step 7 and can be done independently.\"\n}\n```"}
{"plan_idx": 1376, "title": "chocolate-chocolate-cake", "question_idx": 1376, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [8, 14], "binary_question": "Must Step 15 happen after Step 9?", "why_question": "Why must Step 15 happen after Step 9?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 15 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 15 involves preparing the cake tin and can be done independently of mixing the ingredients in Step 9.\"\n}\n```"}
{"plan_idx": 1377, "title": "fusilli-and-meatballs", "question_idx": 1377, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 7], "binary_question": "Must Step 8 happen after Step 4?", "why_question": "Why must Step 8 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 8 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 8 is part of the sauce preparation and is independent of setting aside the onion mixture in Step 4.\"\n}\n```"}
{"plan_idx": 1378, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1378, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 12], "binary_question": "Must Step 13 happen after Step 3?", "why_question": "Why must Step 13 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 13 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 13 involves preparing the whipped cream, which is independent of Step 3 where the butter is rubbed into the flour.\"\n}\n```"}
{"plan_idx": 1379, "title": "spanish-rabbit-stew", "question_idx": 1379, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 7], "binary_question": "Must Step 8 happen after Step 6?", "why_question": "Why must Step 8 happen after Step 6?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 8 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 8 is a humorous remark about the smell of the stew and logically follows the cooking process described in Step 7.\"\n}\n```"}
{"plan_idx": 1380, "title": "warm-puy-lentil-and-tomato-salad", "question_idx": 1380, "steps": ["Bring a large pan of water to the boil;", "add lentils and cook over low heat for 30 minutes.", "Put tomatoes in a small bowl and season with salt.", "Set aside for 15 minutes.", "Drain lentils and tomatoes and mix together.", "Distribute mixture evenly in 6 individual bowls or ramekins, sprinkle with chopped parsley and serve warm or chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why must Step 4 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: warm-puy-lentil-and-tomato-salad\n\nProcedure:\n1. Bring a large pan of water to the boil;\n2. add lentils and cook over low heat for 30 minutes.\n3. Put tomatoes in a small bowl and season with salt.\n4. Set aside for 15 minutes.\n5. Drain lentils and tomatoes and mix together.\n6. Distribute mixture evenly in 6 individual bowls or ramekins, sprinkle with chopped parsley and serve warm or chilled.\n\n\n1. Must Step 4 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 4 can happen independently of Step 1 as it involves seasoning and setting aside the tomatoes, which does not depend on the boiling of water or cooking of lentils.\"\n}\n```"}
{"plan_idx": 1381, "title": "smoked-salmon-and-grapefruit-salad", "question_idx": 1381, "steps": ["Top and tail the grapefruits.", "Slice the skin off the grapefruit over a bowl.", "This is to catch any juices.", "Using a small knife, segment the grapefruits over the juice bowl.", "Arrange the lamb's lettuce onto each serving plate or a large salad bowl.", "Top with grapefruit segments and smoked salmon.", "Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.", "Pour over the salad and serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 6 happen after Step 3?", "why_question": "Why must Step 6 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: smoked-salmon-and-grapefruit-salad\n\nProcedure:\n1. Top and tail the grapefruits.\n2. Slice the skin off the grapefruit over a bowl.\n3. This is to catch any juices.\n4. Using a small knife, segment the grapefruits over the juice bowl.\n5. Arrange the lamb's lettuce onto each serving plate or a large salad bowl.\n6. Top with grapefruit segments and smoked salmon.\n7. Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.\n8. Pour over the salad and serve.\n\n\n1. Must Step 6 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 requires the grapefruit segments prepared in Step 4, which depends on the juice-catching process in Step 3.\"\n}\n```"}
{"plan_idx": 1382, "title": "feta-and-sundried-tomato-spinach-rolls", "question_idx": 1382, "steps": ["Preheat grill.", "Mix together cream cheese, feta, sundried tomatoes, basil and garlic.", "Stir until creamy, with no lumps.", "Blanch the spinach leaves.", "Wrap a dollop of cheese mix in each spinach leaf.", "Brush with olive oil.", "Sprinkle almonds on the top or alternately roll them in the almonds", "Grill spinach rolls until slightly crispy on top.", "Let cool for 10 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 4 happen after Step 2?", "why_question": "Why must Step 4 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: feta-and-sundried-tomato-spinach-rolls\n\nProcedure:\n1. Preheat grill.\n2. Mix together cream cheese, feta, sundried tomatoes, basil and garlic.\n3. Stir until creamy, with no lumps.\n4. Blanch the spinach leaves.\n5. Wrap a dollop of cheese mix in each spinach leaf.\n6. Brush with olive oil.\n7. Sprinkle almonds on the top or alternately roll them in the almonds\n8. Grill spinach rolls until slightly crispy on top.\n9. Let cool for 10 minutes.\n\n\n1. Must Step 4 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Blanching the spinach leaves (Step 4) can be done before or after mixing the cheese (Step 2) as they are independent steps.\"\n}\n```"}
{"plan_idx": 1383, "title": "spanish-rabbit-stew", "question_idx": 1383, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 7], "binary_question": "Must Step 8 happen after Step 2?", "why_question": "Why must Step 8 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 8 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 8 is a humorous remark and not an actual step in the procedure.\"\n}\n```"}
{"plan_idx": 1384, "title": "fusilli-and-meatballs", "question_idx": 1384, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 10], "binary_question": "Must Step 11 happen after Step 1?", "why_question": "Why must Step 11 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 11 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 is independent of Step 1 and can be done at any time before Step 12.\"\n}\n```"}
{"plan_idx": 1385, "title": "chocolate-chocolate-cake", "question_idx": 1385, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [4, 13], "binary_question": "Must Step 14 happen after Step 5?", "why_question": "Why must Step 14 happen after Step 5?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 14 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 14 can be done at any time before Step 16 as it involves preparing the cake tin, which is independent of the cooling process in Step 5.\"\n}\n```"}
{"plan_idx": 1386, "title": "lightly spiced tomato and red lentil soup", "question_idx": 1386, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 7 happen after Step 2?", "why_question": "Why must Step 7 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 7 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 can be done at any time while the soup is simmering, as it involves preparing the garnish and does not depend on the earlier steps.\"\n}\n```"}
{"plan_idx": 1387, "title": "chicken and vegetable pie", "question_idx": 1387, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [8, 9], "binary_question": "Must Step 10 happen after Step 9?", "why_question": "Why must Step 10 happen after Step 9?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 10 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 10 must happen after Step 9 because the liquid mixture needs to be prepared and set aside before assembling the pie in the dish.\"\n}\n```"}
{"plan_idx": 1388, "title": "busters-liver-dinner", "question_idx": 1388, "steps": ["Put all ingredients into a slow cooker, mix together.", "Put slow cooker on high for 4 to 5 hours or low all day.", "( If mixture starts to look too dry just add a little hot water.", ")", "Once cooked, divide between several plastic microwaveable tubs with lids.", "This mixture usually makes 6 to 7 meals, I freeze 4 and put the rest in the fridge.", "When ready to eat microwave with lid half off for 2 to 3 minutes on medium high."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 5], "binary_question": "Must Step 6 happen after Step 4?", "why_question": "Why must Step 6 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: busters-liver-dinner\n\nProcedure:\n1. Put all ingredients into a slow cooker, mix together.\n2. Put slow cooker on high for 4 to 5 hours or low all day.\n3. ( If mixture starts to look too dry just add a little hot water.\n4. )\n5. Once cooked, divide between several plastic microwaveable tubs with lids.\n6. This mixture usually makes 6 to 7 meals, I freeze 4 and put the rest in the fridge.\n7. When ready to eat microwave with lid half off for 2 to 3 minutes on medium high.\n\n\n1. Must Step 6 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 involves dividing the cooked mixture, which can only be done after the cooking process in Step 4 is complete.\"\n}\n```"}
{"plan_idx": 1389, "title": "very-vanilla-ry-cheesecake", "question_idx": 1389, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 9], "binary_question": "Must Step 10 happen after Step 3?", "why_question": "Why must Step 10 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 10 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 involves preparing the oven for baking and does not depend on the completion of Step 3, which is about preparing the biscuit crumbs.\"\n}\n```"}
{"plan_idx": 1390, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1390, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [8, 12], "binary_question": "Must Step 13 happen after Step 9?", "why_question": "Why must Step 13 happen after Step 9?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 13 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 13 can happen independently of Step 9 as it involves preparing whipped cream, which does not depend on the baking process.\"\n}\n```"}
{"plan_idx": 1391, "title": "chocolate-chocolate-cake", "question_idx": 1391, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 18], "binary_question": "Must Step 19 happen after Step 4?", "why_question": "Why must Step 19 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 19 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 19 is an observation about the cake's baking process and does not depend on Step 4.\"\n}\n```"}
{"plan_idx": 1392, "title": "almond and apple cake", "question_idx": 1392, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 4 happen after Step 2?", "why_question": "Why must Step 4 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 4 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 4 can be done independently of Step 2 as they involve different preparations.\"\n}\n```"}
{"plan_idx": 1393, "title": "fusilli-and-meatballs", "question_idx": 1393, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [8, 14], "binary_question": "Must Step 15 happen after Step 9?", "why_question": "Why must Step 15 happen after Step 9?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 15 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 15 can happen independently of Step 9 as they involve different components (meatballs and sauce) being prepared separately.\"\n}\n```"}
{"plan_idx": 1394, "title": "green-tofu-curry", "question_idx": 1394, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 10], "binary_question": "Must Step 11 happen after Step 1?", "why_question": "Why must Step 11 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 11 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 involves simmering the coconut milk and green curry paste, which is independent of the initial step of preparing the rice.\"\n}\n```"}
{"plan_idx": 1395, "title": "spicy-tomato-anchovy-pasta", "question_idx": 1395, "steps": ["Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;", "cook until lightly browned.", "Add anchovies and water, cover and simmer for 4 to 5 minutes.", "Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.", "While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.", "Add linguine and cook until al dente, about 7 to 8 minutes;", "drain.", "Toss with anchovy mixture and chilli flakes.", "If desired, season with black pepper.", "Serve immediately."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 7 happen after Step 1?", "why_question": "Why must Step 7 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spicy-tomato-anchovy-pasta\n\nProcedure:\n1. Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;\n2. cook until lightly browned.\n3. Add anchovies and water, cover and simmer for 4 to 5 minutes.\n4. Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.\n5. While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.\n6. Add linguine and cook until al dente, about 7 to 8 minutes;\n7. drain.\n8. Toss with anchovy mixture and chilli flakes.\n9. If desired, season with black pepper.\n10. Serve immediately.\n\n\n1. Must Step 7 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 involves draining the pasta, which must be cooked first, and the cooking of the pasta starts in Step 5, which is after Step 1.\"\n}\n```"}
{"plan_idx": 1396, "title": "chicken-prawn-and-rice-soup", "question_idx": 1396, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 9], "binary_question": "Must Step 10 happen after Step 2?", "why_question": "Why must Step 10 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 10 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 does not depend on Step 2 and can be done independently.\"\n}\n```"}
{"plan_idx": 1397, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 1397, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 7 happen after Step 3?", "why_question": "Why must Step 7 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\n1. Must Step 7 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 can be done independently of Step 3 as it involves preparing the peppers while the mushrooms are cooking.\"\n}\n```"}
{"plan_idx": 1398, "title": "fusilli-and-meatballs", "question_idx": 1398, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 18], "binary_question": "Must Step 19 happen after Step 1?", "why_question": "Why must Step 19 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 19 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 19 involves cooking the pasta, which can be done independently of Step 1 and does not need to follow it directly.\"\n}\n```"}
{"plan_idx": 1399, "title": "tortellini-fritto-with-almond-butter", "question_idx": 1399, "steps": ["Bring a saucepan of water to the boil.", "Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.", "In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.", "If you slightly undercooked your tortellini then it's less likely to stick to the pan.", "Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.", "Continue to gently fry and stir the tortellini until golden brown.", "Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.", "Enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 5], "binary_question": "Must Step 6 happen after Step 4?", "why_question": "Why must Step 6 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tortellini-fritto-with-almond-butter\n\nProcedure:\n1. Bring a saucepan of water to the boil.\n2. Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.\n3. In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.\n4. If you slightly undercooked your tortellini then it's less likely to stick to the pan.\n5. Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.\n6. Continue to gently fry and stir the tortellini until golden brown.\n7. Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.\n8. Enjoy!\n\n\n1. Must Step 6 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 involves continuing to fry and stir the tortellini, which logically follows the addition of ingredients in Step 5 that occurs after ensuring the tortellini doesn't stick in Step 4.\"\n}\n```"}
{"plan_idx": 1400, "title": "chocolate-chocolate-cake", "question_idx": 1400, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [16, 18], "binary_question": "Must Step 19 happen after Step 17?", "why_question": "Why must Step 19 happen after Step 17?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 19 happen after Step 17?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 19 is an observation about the cake during baking, which can only be noted after the cake has been baked in Step 17.\"\n}\n```"}
{"plan_idx": 1401, "title": "banana-split-cake", "question_idx": 1401, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 7 happen after Step 3?", "why_question": "Why must Step 7 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\n1. Must Step 7 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 involves preparing the filling which needs to be spread over the cooled base from Step 3.\"\n}\n```"}
{"plan_idx": 1402, "title": "chocolate-chocolate-cake", "question_idx": 1402, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [1, 10], "binary_question": "Must Step 11 happen after Step 2?", "why_question": "Why must Step 11 happen after Step 2?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 11 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 involves beating egg whites, which is independent of placing chocolate chips, coffee, and water in a microwave safe bowl in Step 2.\"\n}\n```"}
{"plan_idx": 1403, "title": "cloud-bread", "question_idx": 1403, "steps": ["Preheat oven to 150 C / Gas mark 2.", "Line a baking tray with baking paper.", "Mix cream cheese and egg yolks together until smooth.", "Place egg whites and baking powder in a glass, metal, or ceramic bowl;", "beat together until stiff peaks form.", "Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.", "Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.", "Bake in the preheated oven until golden brown, 17 to 20 minutes."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why must Step 3 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cloud-bread\n\nProcedure:\n1. Preheat oven to 150 C / Gas mark 2.\n2. Line a baking tray with baking paper.\n3. Mix cream cheese and egg yolks together until smooth.\n4. Place egg whites and baking powder in a glass, metal, or ceramic bowl;\n5. beat together until stiff peaks form.\n6. Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.\n7. Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.\n8. Bake in the preheated oven until golden brown, 17 to 20 minutes.\n\n\n1. Must Step 3 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 3 does not depend on the oven being preheated and can be done independently.\"\n}\n```"}
{"plan_idx": 1404, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 1404, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [7, 10], "binary_question": "Must Step 11 happen after Step 8?", "why_question": "Why must Step 11 happen after Step 8?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 11 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 can be done at any time before assembling the shortcakes in Step 14.\"\n}\n```"}
{"plan_idx": 1405, "title": "smoked-salmon-and-grapefruit-salad", "question_idx": 1405, "steps": ["Top and tail the grapefruits.", "Slice the skin off the grapefruit over a bowl.", "This is to catch any juices.", "Using a small knife, segment the grapefruits over the juice bowl.", "Arrange the lamb's lettuce onto each serving plate or a large salad bowl.", "Top with grapefruit segments and smoked salmon.", "Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.", "Pour over the salad and serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 7 happen after Step 3?", "why_question": "Why must Step 7 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: smoked-salmon-and-grapefruit-salad\n\nProcedure:\n1. Top and tail the grapefruits.\n2. Slice the skin off the grapefruit over a bowl.\n3. This is to catch any juices.\n4. Using a small knife, segment the grapefruits over the juice bowl.\n5. Arrange the lamb's lettuce onto each serving plate or a large salad bowl.\n6. Top with grapefruit segments and smoked salmon.\n7. Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.\n8. Pour over the salad and serve.\n\n\n1. Must Step 7 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 requires grapefruit juice which is collected in Step 3.\"\n}\n```"}
{"plan_idx": 1406, "title": "tortellini-fritto-with-almond-butter", "question_idx": 1406, "steps": ["Bring a saucepan of water to the boil.", "Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.", "In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.", "If you slightly undercooked your tortellini then it's less likely to stick to the pan.", "Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.", "Continue to gently fry and stir the tortellini until golden brown.", "Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.", "Enjoy!"], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 7], "binary_question": "Must Step 8 happen after Step 6?", "why_question": "Why must Step 8 happen after Step 6?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tortellini-fritto-with-almond-butter\n\nProcedure:\n1. Bring a saucepan of water to the boil.\n2. Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.\n3. In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.\n4. If you slightly undercooked your tortellini then it's less likely to stick to the pan.\n5. Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.\n6. Continue to gently fry and stir the tortellini until golden brown.\n7. Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.\n8. Enjoy!\n\n\n1. Must Step 8 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 8 is the final step where you enjoy the dish, which can only happen after the tortellini is cooked and served in Step 7.\"\n}\n```"}
{"plan_idx": 1407, "title": "fusilli-and-meatballs", "question_idx": 1407, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [11, 13], "binary_question": "Must Step 14 happen after Step 12?", "why_question": "Why must Step 14 happen after Step 12?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 14 happen after Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 14 must happen after Step 12 because the meatballs need to be formed before they can be cooked in the frying pan.\"\n}\n```"}
{"plan_idx": 1408, "title": "almond and apple cake", "question_idx": 1408, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 6 happen after Step 3?", "why_question": "Why must Step 6 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 6 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 involves mixing ingredients for the batter, which needs to be poured into the prepared tin from Step 3.\"\n}\n```"}
{"plan_idx": 1409, "title": "chocolate-chocolate-cake", "question_idx": 1409, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [6, 14], "binary_question": "Must Step 15 happen after Step 7?", "why_question": "Why must Step 15 happen after Step 7?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 15 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 15 involves preparing the cake tin and does not depend on the mixing of ingredients in Step 7.\"\n}\n```"}
{"plan_idx": 1410, "title": "chicken and vegetable pie", "question_idx": 1410, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why must Step 2 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 2 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 involves cooking ingredients that will be baked, so the oven needs to be preheated in Step 1 to ensure it reaches the required temperature by the time the pie is ready to be baked.\"\n}\n```"}
{"plan_idx": 1411, "title": "chicken and vegetable pie", "question_idx": 1411, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 6], "binary_question": "Must Step 7 happen after Step 4?", "why_question": "Why must Step 7 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 7 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 involves making the sauce which requires the saucepan to be free from the chicken and vegetables boiled in Step 4.\"\n}\n```"}
{"plan_idx": 1412, "title": "chocolate-chocolate-cake", "question_idx": 1412, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 14], "binary_question": "Must Step 15 happen after Step 4?", "why_question": "Why must Step 15 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 15 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 15 involves preparing the cake tin and does not depend on the chocolate mixture cooling in Step 4.\"\n}\n```"}
{"plan_idx": 1413, "title": "spiced butternut squash soup", "question_idx": 1413, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 10], "binary_question": "Must Step 11 happen after Step 4?", "why_question": "Why must Step 11 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 11 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 11 involves cooking the potatoes in the chicken stock, which is a separate process from baking the squash in Step 4.\"\n}\n```"}
{"plan_idx": 1414, "title": "spiced butternut squash soup", "question_idx": 1414, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 8], "binary_question": "Must Step 9 happen after Step 1?", "why_question": "Why must Step 9 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 9 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 9 does not depend on Step 1 and can be done independently.\"\n}\n```"}
{"plan_idx": 1415, "title": "chocolate-chocolate-cake", "question_idx": 1415, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [2, 18], "binary_question": "Must Step 19 happen after Step 3?", "why_question": "Why must Step 19 happen after Step 3?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 19 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 19 is an observation about the cake's baking process and does not depend on Step 3.\"\n}\n```"}
{"plan_idx": 1416, "title": "chocolate-chocolate-cake", "question_idx": 1416, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [5, 18], "binary_question": "Must Step 19 happen after Step 6?", "why_question": "Why must Step 19 happen after Step 6?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 19 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 19 is an observation about the cake's baking process and does not need to follow Step 6.\"\n}\n```"}
{"plan_idx": 1417, "title": "chicken and vegetable pie", "question_idx": 1417, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [3, 5], "binary_question": "Must Step 6 happen after Step 4?", "why_question": "Why must Step 6 happen after Step 4?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 6 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 involves making the sauce which requires the saucepan to be free from the chicken and vegetables cooked in Step 4.\"\n}\n```"}
{"plan_idx": 1418, "title": "chocolate-chocolate-cake", "question_idx": 1418, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [10, 14], "binary_question": "Must Step 15 happen after Step 11?", "why_question": "Why must Step 15 happen after Step 11?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 15 happen after Step 11?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 15 involves preparing the cake tin and can be done independently of beating the egg whites in Step 11.\"\n}\n```"}
{"plan_idx": 1419, "title": "vegetable-terrine", "question_idx": 1419, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "nondependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why must Step 4 happen after Step 1?", "model_name": "gpt-4o-2024-05-13", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 4 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "```json\n{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 4 can happen independently of Step 1 as they involve different ingredients and processes.\"\n}\n```"}
